I switched tactics. I stopped, and then disabled the service that controls the fan. Now it just runs continuously when the Pi is on. My temps are now around ~40c with moderate use. Half what I was getting with just the heat sink. And more constant with no swings up and down.