Hey Josh, I noticed the same thing when I first started using mine. I don’t think it’s broken or anything, but the chlorine readings were definitely on the low side compared to my old strips.
I figured maybe I wasn’t dipping it deep enough or waiting long enough to read it. Once I started grabbing water from a little below the surface, like elbow deep, and giving it a consistent light when comparing the colour, it got more reliable. still not a perfect match to my strips, but closer.
Some folks say it just takes getting used to how Eagle Ray reads vs other kits. Maybe run both sides by side for a bit and see how it evens out? Curious to hear if others had the same weird results at first.