Can I modify creation page layouts in Application Composer to let users add attachments?

No. In Application Composer, you can add the attachments functionality to edit page layouts, but not to creation page layouts.

This means that if users wants to add attachments to a new record, then they must create and save the record first. They can then edit the record to add attachments.