Always remove observers in destroy().

4 jobs for !1658 with 2292-contact-mailbox-download-worker in 8 minutes and 23 seconds (queued for 2 seconds)
latest merge request