The socket interface routines are in a library that must be linked with the application. The libraries libsocket.so and libsocket.a are contained in /usr/lib with the rest of the system service libraries. The difference is that libsocket.so is used for dynamic linking, whereas libsocket.a is used for static linking.
Static linking is strongly discouraged.