firewall Spyware removal internet speed test web security service free software and tips


Go Back   Web Security > Our Free Tools > Webmaster Tool - Sitemap Generator
FAQ Members List Search Today's Posts Mark Forums Read

Webmaster Tool - Sitemap Generator Questions about building a sitemap, including the XML Sitemap, HTML sitemap, Google and Yahoo! Sitemaps.

Advertisements

Increasing Java Memory - Terminating Early

Reply
 
LinkBack Thread Tools Display Modes
  #1 (permalink)  
Old 02-06-2007,
Junior Member
 
Join Date: Feb 2007
Posts: 12
Default Terminating Early

Hi

I am having termination problems also. I am trying to use the XML Sitemap gernerator on quite a large website. Its terminating about 160 URLS as it just gets to the end and gives up.

I would like to try upping the Memoery Settings discussed in these posts. But where do i find it please?

My PC is Win XP, 1gb RAM.

Any guidence would be greatly welcome.

PS. thanks ever so much for creating these very user frienld tools.

Thanks

Slic

Quote:
Originally Posted by AMPC View Post
The fix is easy, I just need to know which version of the sitemap generator are you using? If you have increased the memory to 500+, you should be able to crawl a very large site without any problems.

What OS are you running and what was the exact parameter you used to increase the memory? Also, what verison of the sitemap generator are you currently using?

If you like, I have a new web master tool that builds XML sitemaps and will soon replace our current sitemap generator. I'll PM you the link if you're interested.

Regards,

Jim.
Reply With Quote
  #2 (permalink)  
Old 02-06-2007,
AMPC's Avatar
Administrator
 
Join Date: Jan 2007
Posts: 1,415
Default Allocate more memory to Java

Hey Slick, welcome to the Forum!

To increase the memory Java uses and the Webmaster Tool, simply navigate to the control panel and click on the Java Icon. Then, inside the Java Control Panel, click on the Java Tab, Java Applet Runtime Settings, View and then in the Java Runtime Parameters cell, enter '-Xmx256m' for each product listed.

You can take it a step further when building a sitemap (if you're still having problems) and enter '-Xmx512m' or down one to '-Xmx128m'

With 250, your should be able to spider 100,000 pages without any problems.

Let me know if that works for you! If you continue to have problems, send me your URL and I'll take a look.

Regards,

Jim.
Reply With Quote
  #3 (permalink)  
Old 02-06-2007,
Junior Member
 
Join Date: Feb 2007
Posts: 12
Default

Hi Jim

Thanks for the info. I currently have the my website being crawled as it has about 3000 links on it.

My website is myfancydress.com

Thanks for your propmt reply also...

Regards

Slick

Quote:
Originally Posted by AMPC View Post
Hey Slick, welcome to the Forum!

To increase the memory Java uses and the Webmaster Tool, simply navigate to the control panel and click on the Java Icon. Then, inside the Java Control Panel, click on the Java Tab, Java Applet Runtime Settings, View and then in the Java Runtime Parameters cell, enter '-Xmx256m' for each product listed.

You can take it a step further when building a sitemap (if you're still having problems) and enter '-Xmx512m' or down one to '-Xmx128m'

With 250, your should be able to spider 100,000 pages without any problems.

Let me know if that works for you! If you continue to have problems, send me your URL and I'll take a look.

Regards,

Jim.
Reply With Quote
  #4 (permalink)  
Old 02-06-2007,
AMPC's Avatar
Administrator
 
Join Date: Jan 2007
Posts: 1,415
Default Memory in Java

Sounds like you are running it now, so I'll not do anything and wait for your results.

Let me know how it went. If it didn't finish, let me know what your three memory settings are under the System tab inside the webmaster tool (Free, Total and Max).

If it does not complete, do me a favor and try to browse your website right after it stops and let me know the results as well.

Thanks Slick,

Jim.
Reply With Quote
  #5 (permalink)  
Old 02-07-2007,
Junior Member
 
Join Date: Feb 2007
Posts: 12
Default 256 Done the trick!

Jim

I tweaked it a couple of times and had to let it run whilst testing. hence my delay in repling. But 256 has worked a treat. It also seem to crawl quit a bit faster.

Thanks Again.

Slick

Quote:
Originally Posted by AMPC View Post
Sounds like you are running it now, so I'll not do anything and wait for your results.

Let me know how it went. If it didn't finish, let me know what your three memory settings are under the System tab inside the webmaster tool (Free, Total and Max).

If it does not complete, do me a favor and try to browse your website right after it stops and let me know the results as well.

Thanks Slick,

Jim.
Reply With Quote
  #6 (permalink)  
Old 02-07-2007,
AMPC's Avatar
Administrator
 
Join Date: Jan 2007
Posts: 1,415
Default -Xmx268m Java Applet Memory

We aim to please
Reply With Quote
  #7 (permalink)  
Old 05-12-2008,
Junior Member
 
Join Date: Feb 2007
Posts: 12
Default New PC

Hi Jim

Sorry to re-awaken an old post but I have recently had a new PC. I have been trying to modify the amount of memory allocated to java as per your instructions below that you gave me that got the sitemapper working. When i had my previous PC your tweak worked fine. The new PC however is not quite working. I set the memory as per your post below to " -Xmx512m ".

When i return to load the sitemapper i am getting an error saying:

"The Java Runtime Envionment cannont be loaded"

and also i have seen the message:

"Several Java Virtual macheines running the same process caused an error"

Do you have any idea what the problem could be please? This new PC has 2gb of ram... not sure if you need to know that.

Thanks

Simon
Reply With Quote
  #8 (permalink)  
Old 05-17-2008,
AMPC's Avatar
Administrator
 
Join Date: Jan 2007
Posts: 1,415
Default Larger memory on Sitemap

Hello Simon,

Have you tried a larger value? What happens when you don't enter anything at all?

Regards,

Jim.
Reply With Quote
  #9 (permalink)  
Old 06-13-2008,
Junior Member
 
Join Date: Feb 2007
Posts: 12
Default

Hi Jim

I have tried increasing the Java Memory to both -Xmx1024m and -Xmx2048m.

When i load the site map generator i just get an error saying :

"Several Java Virtual macheines running the same process caused an error"
Reply With Quote
  #10 (permalink)  
Old 06-13-2008,
AMPC's Avatar
Administrator
 
Join Date: Jan 2007
Posts: 1,415
Default starting from 512 and moving up from there in 128 increments.

I've had this happen before after changing the memory settings and not a clue what the problem is. I think my fix was to put it back the way it was, (perhaps blank it out). Then I rebooted my computer and entered setting starting from 512 and moving up from there in 128 increments.

Let me know if that helps.

Jim.
Reply With Quote
Reply


Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are Off



All times are GMT -5. The time now is .


Powered by a CPU
vBulletin® v3.8.4, Copyright ©2000-2009, Jelsoft Enterprises Ltd.
LinkBacks Enabled by vBSEO 3.3.2 © 2009, Crawlability, Inc.