Contact can't be invited: Not supported by this contact

Steps to reproduce:

1. Add a new contact
2. exchange some messages
3. try inviting to a private group: Boom!

Normally, it can take some time for client versioning info to be exchanged which can cause this message early on, but here it seems we receive the messages, but don't update the contact state:

2023-05-23 10:50:49,512 [pool-1-thread-22] INFO  o.b.b.s.v.ValidationManagerImpl - Validating message for org.briarproject.bramble.versioning
2023-05-23 10:52:00,827 [pool-1-thread-16] INFO  o.b.b.s.v.ValidationManagerImpl - Delivering message for org.briarproject.briar.privategroup
2023-05-23 10:52:00,831 [pool-1-thread-16] INFO  o.b.b.s.v.ValidationManagerImpl - Delivering message for org.briarproject.briar.privategroup.invitation

This happens even after 10min and after we were already invited to private groups by that contact.