If you follow the instructions here, you create a new Truststore and Keystore, if you don't import any of the Root CA certs into this new Truststore, MMS is unable to validate any commonly used SSL certificates on the internet. This effectively breaks HipChat and PagerDuty integration. A workaround is to export all of the Root CA certs from the default Java Truststore and import them into this new Truststore.