I’ve actually run into something similar once. A steady pressure drop usually points to something disrupting the pump’s ability to maintain consistent flow. Air leaks, like Manikshaw mentioned, are a common cause, but another thing to check is whether your pump basket or impeller is getting partially clogged and then clearing itself as debris shifts around.
That can cause pressure to dip instead of climb. Also, make sure the water level in your pool is high enough and the skimmer weir isn’t sticking, because low water level can let the pump draw in a bit of air over time. If those all check out, I’d also take a look at the gauge itself, sometimes a failing gauge gives odd readings and makes you chase a problem that isn’t really there.