[mythtv-users] Swapping PCI cards kills X

[mike at grounded.net]

I have another thread going but it's so long that it's confusing. I believe most of the input and points made help to solve the original question. I also believe that once I get back this current problem that I will be able to have a myth box up and running at this point.

Problem is, I had a PVR-500 card installed on the system. 
I also have an nvidia 220GT card in the same system. 
The kernel is PAE and everything is fully updated.

The nvidia driver seemed to load fine as I did see the logo when rebooting and of course X came up. 
I wanted to quickly test to see if a card I thought was bad might be ok so I shut the system down, replaced the PVR-500 with an HVR-1600 and rebooted the system so I could take a look at lspci and dmesg. 

Upon reboot, I noticed the nvidia driver was no longer popping up and worse, X is no longer coming up either. The front end isn't coming up and I'm of course having an x11vnc problem since it cannot find a display. 

Someone suggested needing to put an option in grub.conf but from what I can tell, that's not the problem. What ever the problem is, it's something to do with a driver that's loading and preventing X from loading. 
It seems to me that the system has detected the new card but drivers for the old card are loading which is somehow messing up X.

Any thoughts on this sort of problem?

Thanks.