When I scan my site I get these locations in the site map:
mysite.com/about
mysite.com//about
mysite.com///about
If I let it go, it just keeps adding in slashes and it will do this for every file in the site.
Not sure what is going on here, but here is my exculde filter list:
*.JPG
*.jpg
*.gif
*.GIF
*.inc
*.INC
*/application.cfm
*.css
*.CSS
*.js
*.JS
*/news/includes/*
*/news/julsep04/*
*/news/english/*
*/news/spanish/*
*/news/test/*
*/images/*
*/Templates/*
*/pubsandorgs.cfm
*/query.cfm
*/XMLFeeds*
*/Graphics2/*
*/activitymessage/*
*/loginrequest/*
*/CSS/*
*/borders/*
*/admin/*
*.cfm?*
Thanks,
-HB
Hey HB,
That comes from an error in one of your hyperlinks. Somewhere, there is a typo and it’s sending the bots off to ever, ever land.
Start generating a sitemap, then go to the sitemap section and watch the urls. When you see the first occurance of // (it will be in red), stop the sitemap generator and then look at the In-l column (in that row) and click on the plus , the url that shows right under it will be the url with the broken hyperlink.
Fix that and you should be all set
Regards,
Jim.