Improving compatibility with the (continuously changing) Gutenberg blocks is on our to-do list. We already did it once but then WordPress updates adjusted the HTML markup for caption blocks.
Classic captions should continue to appear the same as before – I see you have a mix of both on the indicated page.