Most CODEC's cannot handle resolutions higher than 720x480, or 640x480 (NTSC). If you want to go higher, you probably should be using H.264, X.264, AVC, MPEG2, or Uncompressed.
Uncompressed will usually end up with the best image quality after encoding to the final format. It just takes a ton of disk space.
I'd like to check out this tutorial, but I cannot get to your WEB page.