You can delete the save folder, but you can also just manually delete the saves from the menu. The only persistent element in the game save is the Endless Mode unlock, which is just unlocked anyways using a code.