Sitemap terminates

Comments

1. AMPC says:
   January 30, 2007 at 1:24 am

   The fix is easy, I just need to know which version of the sitemap generator are you using? If you have increased the memory to 500+, you should be able to crawl a very large site without any problems.

   What OS are you running and what was the exact parameter you used to increase the memory? Also, what verison of the sitemap generator are you currently using?

   If you like, I have a new web master tool that builds XML sitemaps and will soon replace our current sitemap generator. I’ll PM you the link if you’re interested.

   Regards,

   Jim.
2. dutchblues says:
   January 30, 2007 at 10:24 am

   as command caused java error messages, so i used

   Update: Tried 756. Did not help. Terminated again. now at 8405 processed and 19784 queued. Did a complete restart before trying.

   Please send me a link to your new release.

   By the way: our site Over Dieren, de informatiebron voor dierenbezitters

   Thx
3. AMPC says:
   January 31, 2007 at 12:24 pm

   The tool you are using is the old – I’ll pm you the new webmaster tool details and you can start from there.

   When you run the new tool, the first thing you should do is visit the system information tab and record the Free, Total and Max Memory. Max memory should be something like 508m if you entered -Xmx512m.

   If you don’t see that, then try -Xmx256m. If that still isn’t working, try -Xmx768m and try it.

   Each time you make changes, you will have to close your browser and the java icon on your screen should disappear; if it doesn’t, then reboot.

   Each time you make changes, record the memory settings.

   Let me know the results and we’ll go from there.

   Regards,

   Jim.
4. dutchblues says:
   February 1, 2007 at 12:24 pm

   That solved my problems too!
5. dutchblues says:
   February 2, 2007 at 1:24 am

   Here is a update:

   Java problems were solved with -Xmx256M.

   But …. The crawler still didn’t make it till the end. After 34421 processed locations of 41321 queued locations it terminates due to shortage of memory.

   I know, our website is very large, it is about pets and we have lots of photo albums, articles, a forum and lots of oher info.

   I tried -Xmx512M, -Xmx768M and -Xmx1024M but java wouldn’t work with these settings. I tried them on 4 different pc’s. All with XP sp2. My PC has 2 gb ram. Any suggestions?
6. AMPC says:
   February 2, 2007 at 4:24 am

   A few questions:

   What is your browser and version.

   What version of Sun’s Java are you using?

   What are the first three memory settings in the system window of my webmaster tool? Free, Total and Max.

   I’ll run your site on my end and see if anything is strange.

   Regards,

   Jim.
7. AMPC says:
   February 2, 2007 at 12:24 pm

   Oh, forget to mention that IE is picky and sometimes flakes out with the memory settings on Java. If you want more memory (254 should be fine), then install firefox and run the tool through that browser.

   Let me know the results, I want to see a successful solution for your site.

   Regards,

   Jim.
8. dutchblues says:
   February 3, 2007 at 12:04 am

   Dear Jim, thank you for looking at my problem so seriously . I have forwarded your post to my ISP. I use a small but very good ISP run by a single person in the Netherlands. He allows all the features , is cheap and has excellent support . He wrote me an email yesterday about your serverload. I have asked him for the best solution for the problem we faced. I don’t want to experiment and cause problems on his server again.

   Will let you know the outcome!
9. AMPC says:
   February 3, 2007 at 12:24 am

   Sounds like he is just being careful!

   The webmaster tool operates in the same manner as the Googlebot, so if running the tool is causing a server load, then you’ll want to address that.

   You want the Googlebot and other search engines robots to come to your site and grab as much as they need!

   Don’t forget, you can always tweak the rate at which my webmaster tool operates (slow it down).

   Another suggestion would be to work with your friend and have him give you a time that is best to generate the sitemap.

   Glad I could be of help!

   Regards,

   Jim.
10. dutchblues says:
    February 2, 2008 at 8:24 am

    What is your browser and version. IE 6.

    What version of Sun’s Java are you using? 1.5.0

    What are the first three memory settings in the system window of my webmaster tool? Free, Total and Max.
    Memory*usage
    Free*memory
    10,9*M
    Total*memory
    27,2*M
    Max*memory
    254*M

    I’ll run your site on my end and see if anything is strange.
    My profider is complaining about a very high server load.

    Regards,
11. AMPC says:
    February 2, 2008 at 10:24 am

    I ran the webmaster tool on your site and finally figured out the problem! It was staring me right in the face and just didn

Speak Your Mind Cancel reply