Is there any way for me to translate the subscribe button found in subscribe_form.hbs without altering the core code?
Yes, see 2. Ensure core templates in theme in the internationalization docs:
subscribe_form.hbs - copy from
and an example.
Thank you! I just completely missed this.