It's pretty easy, but not very intuitive.

Open Nautilus and find a file of the type you want (in your case, PDF).
Right click on the file and select 'Properties'. Under the 'Open With'
tab, select the program you want to use and click OK. All files of that
type should now be opened by the chosen program.