Qualifications
You may be great with numbers, but unless your uncle runs the department, you're going to need some qualifications to get your foot in the door.
The most common qualification for becoming an IRS auditor is a bachelor's degree in some discipline related to accounting. Having coursework in business or law can also be extremely helpful. Combine your bachelor's degree with a certification in public accounting and you're bound to get the gig.
Once hired, most positions will require up to a year of on-the-job training to make sure that you're current on all new tax codes and laws. This type of job experience will make you much more desirable in the future should you need to look for a similar job elsewhere.