Tbf, we should be starting with 16GB for gaming GPUs too, especially for those prices. But … NVidia.
But yeah, modern HPC Processors have at least 48GB or so. And max. is the AMD Mi355X with 288GB VRAM afaik. Which is actually less than my servers RAM, ha! But also probably like a thousand times fasted, considering my RAM runs at 1600 MT/s.
Afaik for consumers only the 5090 has 32GB VRAM. So you’re correct, practically impossible to find. And even if you find it, prone to spontaneous combustion.
For servers, it tops out at 288GB currently, with the AMD Mi355X.