You can toggle edit controls off and on by clicking on Toggle Edit Controls from the Welcome Menu.
You can notice that edit controls are on when Toggle Edit Controls is on.
The edit controls for the portlets on your page are off when 'Toggle Edit Controls' is off.