This truly depends on this drugs being used in my opinion.
If it's not performance enhancing, it shouldn't even be an issue as it doesn't effect the outcome of a game.
Recreational drug use, while illegal depending on the drug and the state, shouldn't result in a punishment in the sports world.
I've stated my point and you have yourself, let's begin the arguments!
When it comes to steroids, I agree with you. It's unfair and should be a full ban. Should have been more specific in the title of the debate though, because it looks like this is ending up with an agreement instead of one side winning.