Yes that all makes perfect sense. I suppose the “back to top” button could just be re-purposed so that it just goes back up to the TOC instead of above the image whenever there is a TOC.
I’m not sure about the left sidebar… hmm… maybe the left sidebar items could be more collapsed in some way to make everything fit in a clean way.