Add option to hide expiry warning banner

We want to keep the expiry banner #183 (closed) for now, but some users have given the feedback that it's annoying. I think we already discussed some time ago that it might be a good middle ground to offer an option to hide it and that it would reappear after a certain time, for example 24 hours.