View Single Post
  #6 (permalink)  
Old 02-02-2007,
dutchblues dutchblues is offline
Junior Member
 
Join Date: Jan 2007
Posts: 6
Default

Here is a update:

Java problems were solved with -Xmx256M.

But .... The crawler still didn't make it till the end. After 34421 processed locations of 41321 queued locations it terminates due to shortage of memory.

I know, our website is very large, it is about pets and we have lots of photo albums, articles, a forum and lots of oher info.

I tried -Xmx512M, -Xmx768M and -Xmx1024M but java wouldn't work with these settings. I tried them on 4 different pc's. All with XP sp2. My PC has 2 gb ram. Any suggestions?