Web push notifications can be extremely quircky, not just for the admins but the board users. The alerts do not necessarily behave as you'd expect when used to traditional apps, for example, most browser won't show alerts if they aren't open and running, while others might. We should add some FAQ entries answering some of the common questions users may have about how and why and what this web push stuff works.