Continue to close connections when we enter rollback or removed state

The same code path is used for closing connections when we enter ROLLBACK or REMOVED as for stepping down. We need to separate them so that even after the "don't close connections on stepdown" project is done, we do continue to close connections on ROLLBACK and REMOVED.