hi,
thx lot for a great tool.
i am trying to use the sitemap tool on africabo.com and for the first 3 run it returned errors , then i increased the memory to 512mb and still going for a bit now but i fear its going to time out soon too as the memory is going up fast.
I just want some hints yu can gimme to lower the sitemaps pages plz as so far i have about 30000 pages queued and still going up.
also the site is multilanguage eng. and fr. so crawling samething in both language seem a bit lot and some pages aswell don’t have any data yet.
so plz can u gimme any good advise/tip on how to effectively use filters in my case plz to make it easier for bot ?
thx in advance
Comments