Like you said, you can replace it in the Ghost Admin area, simply deleting the current icon and uploading your own icon.
Another option is using the code injection section (header).
Assuming you have your icon in the root folder, you can add the following line:
<link rel="icon" href="you_icon.png" type="image/png">