You need to use the Nemu64 emulator for it to work.
http://emulator-zone.com/doc.php/n64/nemu64.html

And a plugin called LemD3D8 (in my attachments).

http://emutalk.net/showthread.php?t=21092