Some system units have the headphone jack wired with its Left and Right channels reversed, so you hear Left output in your right ear and vice versa. The line-out jack at the back of the unit works as expected.
The quality of sound is better when using an external microphone and speakers, not the ones built into the keyboard.