Correct me if I'm wrong, but I thought if you weren't carrying a firearm, you weren't required to show your CHL? Yea or no?
Correct. Gov't Code 411.205.
Sec. 411.205. REQUIREMENT TO DISPLAY LICENSE. If a license holder is carrying a handgun on or about the license holder's person when a magistrate or a peace officer demands that the license holder display identification, the license holder shall display both the license holder's driver's license or identification certificate issued by the department and the license holder's handgun license.
Once you go out with a CHL and a handgun you're required to ID with BOTH whenever asked. No handgun, no requirement to carry or show CHL. The transportation code has specific provisions about showing a DL when driving, but again, that wasn't what was being discussed.
That is NOT, however, what the OP stated. The OP stated that ANYONE is required to ID when asked which is provably false.