Click the Advanced Options button.  The Advanced Options Dialog box will appear.
Here, you can set your preferences for deleting items.  Do you want to receive a warning before permanently deleting?  Do you want to empty the Deleted Items folder automatically when you close Outlook?

Tailor your system.....your WAY!