<p>It's really quite annoying as they are not part of the project.</p>

The Visual Studio Web Deployment addin lets you exclude folders and more.
VS2005
VS2008
Also a decent writeup on the
Web Deployment addin