Until the day comes that I get a letter in the mail from the government saying, “Here’s how much you paid in taxes, if you’re cool with that then please disregard”, I will not be satisfied.

NZ does that. More accurately, they email you to tell you that there’s a letter available online - I don’t think they send physical mail by default.

Then they pay any refund straight into your nominated bank account.