One other angle that hasn’t really been touched yet is what your “clean” baseline actually is and whether the gauge is telling you the full story.
I ran into a stretch where my pressure was climbing crazy fast and everyone kept saying pollen or circulation. Turned out my gauge zero had drifted. After a backwash it looked “normal,” but it was already reading a few psi higher than true clean pressure. So when it climbed again two days later, it felt dramatic, but in reality the filter wasn’t loading nearly as fast as I thought. Swapping the gauge made it obvious I’d been chasing a ghost.
Another thing that can accelerate pressure without the pool looking filthy is weather. After a windy day or a light rain, you can get a lot of ultra-fine dust and organic film that never really clouds the water but packs the sand tight. I noticed it most when pressure jumped overnight even though the pool looked unchanged in the evening.
If it were mine, I’d note pressure immediately after a long backwash and proper rinse, write that number down, then see how fast it rises from that true clean point. If it’s still climbing hard in 48 hours, then yeah, you’re loading the sand fast. If not, the gauge or baseline may be misleading you. Curious if your pressure rise is gradual or if it feels like it suddenly shoots up all at once.