When you delete a folder, it is moved to the Recycle Bin. Items in the Recycle Bin can be restored back to their original location or permanently deleted. See The Recycle Bin. You can delete more than one folder at a time.
Note: Documents attached to business processes cannot be deleted. Therefore, in order to delete a folder that contains a document that cannot be deleted, you must first move that document to a different location.