Graphical Way
Open Synaptic application
Click on System -> Administration -> Synaptic Package Manager.
In Settings -> Repositories, make sure you have an universe repository activated.
Search for vlc and install it, as well as vlc-plugin-pulse. You may also want to install mozilla-plugin-vlc.
If you are interested in streaming or transcoding, you should additionnally install libavcodec-extra-52 from a multiverse repository.