That's indeed a known issue, and something we'd like to fix in the next Jetpack release.
Would you mind testing the patch we've worked on, and let me know if that works for you?
https://github.com/Automattic/jetpack/pull/4056/files
Let me know how it goes!