The Hidden Cost of Running LLMs at Scale (And How to Cut It in Half)