Figured out it was the pump when the stop leak made it run better. My guess is that it was losing pressure at the seals, which makes sense as I saw some residue around the ends.
I did end up replacing the rack, got it from rock auto and went to a dealership for install. I believe it was 2.5 hrs of labor. Steering has been perfect since.
I will also say that load range E tires negatively impacted the steering feel, when I put on C rated tires their lighter weight was noticeable. Not related but figured I'd mention, it's not a strong setup I guess.