All pharmaceuticals are now of concern because not only are fish affected but also humans. Intersexuality of fish occurs due to endocrine disrupting contaminants and there have been several studies done on the subject. When such compounds are released to streams, there is also a high probability that other users will collect this water to produce drinking water. The scientific community already has debates, studies, etc. on the subject The standards are tightening more and more and some WWTP already move on to add treatment step in order to reduce those kind of contaminants.
If you want more information on the subject you can go to the EPA site. You will see that the subject is of interest