To delete data sets:
If data exists, you cannot delete the data set.
If no data exists, however, form instances are created, and you cannot delete the data set.