Is there any way to get it to spit out a URL listing or Sitemap that includes the queued as well as the crawled URLs? I have about 70,000 queued URLs that will each take about 6-10 secs to load, and I would prefer not to wait for them to be crawled.
If we can’t do it now, I nominate it for the next version.
I’ll add this to my list, however, it won’t be in the next version as that is completed and will be up in a few days. I’ll be sending out a newsletter to subscribers notifying them of the new tool and location soon.
Thanks for the suggestion!
Jim.
I have a web site with around 70,000 web pages.
I have tried lot more sitemap genration tools,
recently I found auditmypc. But here a;so i got errors on generating sitemap. It is taking all URLs on home remaining it shows failed.
Can you suggest me to get crwaled all my urls withsearch engines.
I’m geting mad with this sitemap. Please give me a solution.
I hope you can solve my problem
Thanks & Regards,
Hema
How about the website address (url) of the site you are trying to generate a sitemap for? Once I have that, I can then look at the errors and tell you more.
Regards,
Jim.