You should not have the right to murder. You should not have the right to steal. You should not have the right to rape someone. This is why the government should limit some rights and liberty in order to provide a better society for everyone. Without this small limitation we would be a third world nation.
As long as people are violating no laws and harming no one, they should have unlimited rights and liberty. If they do violate the law, then they should have their rights taken away, according to the law. Otherwise, what people do is certainly not the government's business, and the government should not interfere.