NOt all of the directories at my web site are crawled when I try to create a site map.
The first web site http://www.searchnowfind.com was crawled successfully, all directies were crawled.
I try to crawl http://www.mark9.com and only bout 1/2 the directories are crawled.
What could be the problem?
I’m not excluding any file names.
Thanks
Steve
Hi Steve,
Do you have an example url that should be crawled and is not crawled? I need the ‘url that should be crawled’ and the url containing the ‘url that should be crawled’.
That did make sense, didn’t it