How to delete a primary goal plan?

Remove all assignees for the primary goal plan and make it inactive.

You can also delete the primary goal plan using HCM Data Loader.