Yeah, you are right, a clogged filter usually makes pressure rise. If the pressure slowly drops after a backwash and the return flow gets weaker, I usually suspect something on the suction side: air getting in at the pump lid O-ring, a slightly loose suction connection, or a flexible hose collapsing when the pump pulls (it can look fine from the outside). I would start by checking the pump lid gasket, making sure the basket is clean and the pump stays full of water, and watching for bubbles in the pump basket. If that looks good, then I would check the hose and unions from the skimmer to the pump and over to the filter.