Wetlog has gone all UseIt citing this very good Nielsen article on usability. I agree that, above all else, sites need to load fast and be useable, but I think Nielsen downplays the importance of visual design. It is possible for sites to look good and load fast, and those are the ones to which people will keep going back. Examples that jump to mind are MetaJohn and Kottke.