Can a police officer bring up a crime you committed during another violation against you in court?

I received a traffic citation and the officer claimed my car smelled like marijuana, so he searched it. I have a doctors recommendation, which the officer claims to have no authority on the matter at all and is virtually useless. I had no marijuana on me, but I did have a grinder with residue in it as well as an empty jar with some residue. No smoking utensils, scales, baggies, etc. He threatened me with a DUI, considering I had smoked 9 hours before getting pulled and would therefore have THC in my system. Ultimately, he gave me a sobriety test (following the pen with the tip of my eye and checking my tongue) and let me go afterward. I was just wondering, if I decided to fight this unjust traffic citation, could he bring up the whole marijuana ordeal and make things worse for me in court?