Criminal penalties may be incurred when a taxpayer : willfully fails to file a tax return, fails to keep records, fails to supply required information, or fails to pay any tax or estimated tax. You don’t want to risk the IRS construing your not filing as being willful. The cost of hiring a criminal tax attorney is expensive and the mental anguish of undergoing a criminal investigation can be devastating.