Justice Hugo Black ".. We repeat and again reaffirm that neither a State nor the Federal Government can constitutionally force a person "to profess a belief or disbelief in any religion." Neither can constitutionally pass laws or impose requirements which aid all religions as against non-believers, and neither can aid those religions based on a belief in the existence of God as against those religions founded on different beliefs" Freedom from means no influence or persuasion either for any or against any belief or disbelief.
Another aspect is that Any freedom is limited to the capacity in that it doesn't infringe on another persons individuals freedoms. Your freedom of "life, liberty and the pursuit of happiness" does not give you the right to take another person's life or liberty no matter how much happiness that would bring you in your pursuit of happiness. If in your pursuit of a religious observance such as evangelizing, you infringe a right to privacy, or property, you have violated another person's individual freedoms and therefore exceeded your freedoms inherent rights.
The Constitution was written by people who were decendents of people trying to escape persecution by the Church of England. It is a widely known but hardly accepted fact that when they wrote the "Freedom of Religion" part of the First Amendment that they meant "Freedom of Religion, as long as it's Christianity". No where does it say "Freedom FROM Religion" , and it never has. Our founding fathers were staunch Christians. There is a reason "In God we trust" is written on our money.