Yes there is.
You will need the properties pop-up window. It's the same one you can get on
the VBA editor, but you'll need it on the Excel side.
I don't know how to get at it from the ordinary menu structure (although it's
probably buried there somewhere), but there are a couple of other ways.
Bring up the control toolbox toolbar. (Right click on the toolbar area and
select "control toolbox".) That should have a properties icon - probably as the
second from the left. Click that icon and the properties pop-up will ... pop
up. You'll also need to go into design mode, if you're not there already. That
should be the leftmost icon in the same toolbar. Then click on your button and
its properties will show in the properties box. Then just change the name of
the button.
Alternatively, go into design mode then right-click on the button and select
properties.
Remember that you'll need to change the names of any event subroutines you've
already defined for the buttons. VBA will not detect any old subroutines as
being orphans, it just won't use them.
If you don't already have event subroutines (or even if you do), just
double-click the button while still in design mode and Excel will take you to
the click handler for the button (creating it for you if it doesn't already
exist).