Don't dismiss all Pushover notifications upon opening the app

The issue I have with this is that upon clicking on "acknowledge" to not get spammed by a reoccuring Pushover priority notification, you automatically get redirected to the Pushover app, thus dismissing all Pushover notifications. This is a problem because I oftentimes have multiple notifications I haven't looked at and if I dismiss them like that there's a chance I will forget looking at them in the future.