Your Government both gave and protects your rights, why wouldn't they be the ones who could take them away as well? So long as its not a permanent removal of the rights, rather a case by case real credible reason to remove a specific right for a specific person your government will do it regardless of what the people say if they feel its justified.
Just look up some history, you will see many examples of what governments are capable of, the US government has its fair share of skeleton's in the closet.
The government has violated our rights in the past but they made mistakes. All humans make mistakes and the government will use them to correct their mistakes in the future. All humans make mistakes. All humans make mistakes. All humans make mistakes. All humans make mistakes. All humans make mistakes.
All the evidence says that when it does violate citizens' rights, it doesn't actually help much anyway. The idea that to protect from terrorism, which is a MINOR THREAT (You are 404 times more likely to die from FALLING OVER) one must forgo one's civil liberties, is ridiculous. The real way to stop terrorism is to stop occupying foreign countries.
That's right, you need a 2/3 majority to take rights away. We don't need another instance of government taking away freedom for a little bit of peace. Each time you do that, you're encroaching on someone elses life/business.
Do i think we should regulate certain rights? We already do that. That's what government is for. Albeit i think a little too much.