Entry sensor alert tuning

I’d like to have my door entry sensor to chime with every opening, then alert my phone or maybe alarm during sleep hours.

Currently, it’s sending push notifications to my app with every door opening event, which is pretty annoying. I don’t want to suppress all push notifications from the app because I have a doorbell too. I’d appreciate any help getting this device more useful.

Thanks