The short-term yes because most drugs give you a positive feeling and it is doubtful it can hurt anyone early in using it. In the long term no it does hurt people around you. It is really rare that no one has anyone around them. By you becoming addicted to a drug you are hurting a friend or significant other. It is not a victimless crime if it does affect the people around.
For the long term I think drug abuse should be punishable by law so that the person can find help in rehab and live like he did again pleasing the people that he affected when he/she was addicted.