To properly change a video card in a running system, without re-installing the operating system, you have to remove the old drivers before taking the card out.
Not just run the uninstaller, but remove everything related to the old video card driver. This usually means running a third party program designed to clean out the old drivers.
After you do that, you shut down the computer, swap the video cards, and the system will then boot to the VGA drivers. If you do not get the VGA boot up, then your video card is malfunctioning. Multiple reasons abound. Not enough power, not getting all the power plugs into the card,..and so on.
Personally, I never bother with the CD that comes with the video card. I grab the latest driver from the manufacturer and just run it after the new card is installed.
This all assumes a normal video card swap out. Enough power supply, connectors, and so on.