My issue resolved. Changing secure connection port from “587” to “465” as mentioned here by @rozhok got my transactional emails working.
I’m not sure the two things were connected. But thanks to @rozhok in any case.