For those of you using WordPress for your blog, the exclude filters below will save you a lot of time and prevent the spider from including unnecessary files when making an HTML sitemap.
*/2005/*
*/2006/*
*/2007/*
*/2008/*
*/2009/*
*/trackback/*
*/feed/*
*/comments/*
*/tag/*
*/author/*
*xmlrpc*
*wp-admin*
*.css
*/wp-content/*
*.jpg
*.ico
*.xml
*.gif
*.jpeg
If you are creating a XML sitemap, you’ll probably want these filters:
*/trackback/*
*xmlrpc*
*wp-admin*
*.css
*/wp-content/*
Also, for both HTML or XML Sitemaps, click the exclude images option to prevent images from being included.

Comments