I marked an item as critical for all forms, but I want to change it so that it's only critical for a subset of forms. Can I do that?

Yes. When you make the change, the item becomes critical for the subset of forms that you selected, and the study default setting is applied to all other forms.