You’re not imagining it, heavy rain basically forces worms to go wandering, and a smooth, damp pool deck is like a highway straight into the deep end. One thing that helped cut it down for me was changing the edge conditions rather than chasing the worms themselves. Worms don’t like crossing hot, dry, or rough surfaces.
If you’ve got concrete or pavers right up to the pool, keeping that area swept clean and allowed to dry quickly after rain helps more than you’d think. Standing moisture on the deck gives them cover. Some people also have luck with a narrow strip of coarse material (like rough mulch or crushed stone) set a little farther back from the coping, so worms don’t easily reach the pool edge in the first place.
Timing helps too. If you can skim them out early, before the sun comes up strong, you’ll usually catch most of them floating before they sink and break apart. Not glamorous, but it’s quicker and keeps the water from getting cloudy.
Realistically, you may never get it to zero after big storms, but reducing how inviting the deck and perimeter are makes it go from “gross problem” to “annoying but manageable.”