Didn't want to give away all of what the suggestion is in the title, but to explain:
Currently, if you are infected by a zombie, you'll get up as a zombie whenever you die regardless of how that death happens.
I think, if you die from a cause other than infection or zombie-induced damage (bites, scratches, lacerations), your body shouldn't get back up. This would include getting shot, being poisoned, and other such death methods.
So if you get bitten and want to take the easy way out, you can effectively just down some bleach or something and not trouble the world with yet another undead.