Pause Every Few URLs

I’m receiving frequent pauses making the generator unusable. It processes maybe 1-5 URLs before hanging precisely 1 minute then repeats the same behavior. The crawler shows a status of streaming with a rate of 0 B/s during the pauses.

The first 8,000 URLs did fine a few days ago. Any ideas?

Filed Under: Webmaster Tool - Sitemap Generator

Comments

  1. AMPC says:
    May 17, 2008 at 1:31 am

    I’m not sure – I’m guessing this is a memory issue. When you start to run out of memory, this is the behavior.

    Have you tried to increase memory?

    Best regards,

    Jim.

  2. Terry5048 says:
    May 17, 2008 at 2:31 am

    640 MB memory had been allocated. I tried another site and all was fine. I’m thinking maybe it’s a problem with the hosting company.

    Thanks,

    Terry.

Speak Your Mind