The single button can be located somewhere unlikely to be accidentally clicked. You can keep the 14 day timespan so that undoes are possible. Your concern over accidental clicks is valid as is your classification of are you sure dialogs as false security. But an undo alleviates that concern and is the proper way to handle them. Making it difficult to do that task is not the right way to handle it.

It should still be a button not a painful complicated set of steps.