Many tax payers are afraid of the IRS because their rules are some complex and complicated. Also, it is unknown how they decide to audit people. If the IRS were more transparent and their rules and regulations were simpler, they would have much better image. No one likes to pay taxes, but America's tax service is particularly unpopular.
The last thing we need right now is people finding more things to get up in arms about regarding governmental procedures. The danger here is not people getting a better look at what the IRS truly does, the danger is people that let a biased media outlet tell them what the IRS does spinning new information they get their hands on. When people can be more responsible about forming their own opinions, only then is more transparency from the IRS warranted.