Bringing meds with you into public places?

Is this like.. generally illegal? I like hanging out at the library but since I have instant release, the effects wear odd after 4 hours and that kinda sucks. I was wondering if it's generally illegal to bring the meds with me into public places like that? Has anyone run into any trouble?