In the editor it looks fine, but in the frontend our styles seem to be overridden by some of WP 5.9's new styles

It should be styled as a secondary button, as it is in the backend