You have to hold down the first four fret buttons () while you hit Start. That pops up the pause menu where you can either continue or quit to the song selection screen.
The author said he did this to prevent people from accidently pausing the game.
Edit: By the way, I tried using a PS2 guitar with my PSX->USB adapter (Radio Shack brand). It didn't work.
Bookmarks