Can I transfer people if I don't have access to all of their assignments?

No. You can transfer people only if you have access to all of their assignments.