There are places, decent, to stay for about $45 a night in a comfortable double. And then, there are hotels on the other, northward side.
It is not exactly a piece of cake to drive from Washington D.C. to Williamsburg, but it is a great trip. It just happened (once) to complete it in a day and I must admit that such an endeavor is a far, very far cry from a pleasurable ride. It is tiring. One should not be further away than an hour from the base camp to alight to Williamsburg. The best thing, of course, is to be lodged right there in the colonial atmosphere. Then you can say that you indeed were in Williamsburg.