OP, 100% your issue is the blend actuator in the bottom center and is the hardest to service by far. I believe this controls driver side temps.
Just did both mine last week and before I tore into it, I was convinced it was the upper one behind the radio because that was where the sound appeared to be coming from. When I changed that upper one out, realized it had been recently done by a previous owner.
When you seemed to be casually pulling out the lower one, I knew you weren't talking about the right one. So upper one behind radio controls passenger side (I believe) temp. Lower one controls driver side temp. Above the glove is the recirc. as we know and the one I think you were talking about (in the Driver footwell) is mode door. So if you have a problem switching modes between vent, floor, and defrost look there. Temp, the two centers, and re-circulation is in the passenger dash.
To get the lower one without pulling the entire system, you have to remove the center flow through console. I also pulled the seats, carpet and rear floor vent ducting to get a good look at her. Then you literally have to hack off a plastic mounting boss that holds the plastic ducting up, just to be able to wiggle it out because it is smack dab in front of it. You also have to break the rear mounting tab to get out the old one as the screw is pretty much inaccessible, and then you won't be able to put a screw back in there either. You have to sort of hold it with one screw and wedge it into position with all the duct work beneath it. Super hacky, but get's the job done. It's not bad once you just commit to getting it done. The hardest bits for me were reconnecting the harness to the lower actuator and getting the shifter cable on and off the shifter assembly.
And I did not have to disconnect any airbags on my 2011 if that's helpful to anybody. Just worked from left to right and shimmied the trim panels loose.
Hope that helps. Let me know if you have any questions.