Windows Azure Dev Fabric: Keyset does not exist

If you see this error while dealing with X509 Certificates when your service is running on Windows Azure Dev Fabric:
Keyset does not exist

The fix is to grant Network Service account permissions on the corresponding certificate