This creates very long labels in LaTex. Also one can not add equations ( math) to caption.
We have kept labels and captions same for now. Maybe this can be changed in future.
You can add math in caption using inline latex writing syntax.
E.g. Sample figure caption with \( \alpha + \beta \) math.
It won’t be visible in Google Docs but after export to LaTeX PDF you can see it as compiledmath equation.