Indeed, Aria Label has only Button addon in current version.
If the button contains text that clearly describes its function, adding aria-label according to the guidelines is not necessary.
But of course, I already asked our team to add it so that you can fill in these fields later.
Instead of aria-label, many web accessibility experts prefer to use the so-called .visually-hidden (or .sr-only) class. It allows you to place plain text inside a button that is invisible to the eye but readable by machines. This is often a more stable solution than ARIA attributes.

This solution you can use even today, and will help a lot, if your buttons have short names, like single word. I used that on medical website which as you know must have Web Accessibility tests.