Just did a little bit of research, but this should not be taken as actionable medical or scientific advice.
The active component of Prime is hydrosulfite salts. Since this product is intended for use on live animals, one can only assume it would be one of the safer salts with lower toxicity -- otherwise it would harm or kill your fish. For the most part, the toxic/deadly dose is very high on these chemicals and you'd probably end up with gastrointestinal upset and nausea before you could consume a lethal dose.
In addition, these products react and degrade quickly in water (they react with chlorine/chloramine) and the resulting products are less toxic/dangerous than the salts themselves.
Couple this with the fact that you're using such a minute amount of Prime -- so long as you're following the directions -- and the fact that the fish aren't actively ingesting it, and I personally wouldn't worry about any ill effects or health consequences.
That being said, as far as I can tell, Prime isn't labelled for use in food production, so I wouldn't go around selling the fish for food purposes, but for personal use, I'm guessing it's all okay.