Can I make secondary quantity adjustments without changing the primary quantity?

No, cycle count adjustments are made in the primary UOM. You must change both the primary and secondary UOM quantities to apply secondary quantity adjustments to cycle counts.