This is usually the case with very narrow or custom audiences. As your add frequency rises, conversions go down and costs goes up.

One easy fix would be regularly changing your media and text.