Even the slower forms of video memory used today are much faster than drawing the same data from main RAM, especially across the PCI bus. Faster memory is better, of course but this doesn't change the needs imposed by the texture budget of a game.
Dafoomie, you got a very strange idea of the function of video card memory.