Note: If you use Mozilla Firefox and JAWS, you must disable pop-ups before you upload a profile picture. If you don't disable pop-ups, the upload dialog won't appear.
If you want to remove the group's picture and just use the default avatar, click then picture, then select Remove Photo.