firewall Spyware removal internet speed test web security service free software and tips


Go Back   Web Security > Our Free Tools > Webmaster Tool - Sitemap Generator
FAQ Members List Search Today's Posts Mark Forums Read

Webmaster Tool - Sitemap Generator Questions about building a sitemap, including the XML Sitemap, HTML sitemap, Google and Yahoo! Sitemaps.

Advertisements

Need advice to generate Sitemap for my website

Reply
 
LinkBack Thread Tools Display Modes
  #1 (permalink)  
Old 01-13-2009,
Junior Member
 
Join Date: Jan 2009
Posts: 2
Default Need advice to generate Sitemap for my website

Hi there,

I have recently encountered a problem with generating a Sitemap for my
website. I desperately need some help here.

The website which I want to create a Sitemap is gemondo.com. It's
a retail website which sales jewelleries. On the website, it has got
a search bar above product lists.

One of such examples is /index.php?page=cat_view&path=10

Visitors can search necklaces according to different material,
gemstone, style and price etc. by using the search bar.

When I tried to generate a Sitemap for this site ,
it basically crawls all the possible pages that could be generated via
this search bar. Because of this, creating a Sitemap always goes into
a process of an endless loop. The waiting records can
reach as many as 300,000 and still keeps on increasing, but the
website has less than 3,000 products listing on it.

Since the website is a dynamic one, therefore, all the URLs are on the
same level. The only difference is the URL of a subcategory has an
additional code.

For example,
Pendants & Necklets:
index.php?page=cat_view&path=10

Pendants & Necklets > 18ct Yellow Gold:
index.php?page=cat_view&path=10-3

Pendants & Necklets > Aquamarine
index.php?page=cat_view&path=10-21

Pendants & Necklets > Aquamarine > Heart
index.php?page=cat_view&path=10-21-43

In general, I want all the category pages to be included in the
Sitemap. However, it seems impossible in this case. To compromise, I
hope at least the main category pages can be included; therefore, I
tried to filter URLs with “-“. However, nothing has changed.

Any advices, please?
Reply With Quote
  #2 (permalink)  
Old 01-13-2009,
AMPC's Avatar
Administrator
 
Join Date: Jan 2007
Posts: 1,415
Default gemondo.com

Hello Victor,

I see your initial page and many of your category pages on gemondo.com have good recognition by google, but your individual pages do not.

Personally, I would be focusing in on the individual pages more than categories, but to each their own.

Have you tried using just an include filter, rather than exclude.

Something like this for cats:
*page=cat_view*

or for items, try:
*page=item_view*

Or do both.
Reply With Quote
  #3 (permalink)  
Old 01-14-2009,
Junior Member
 
Join Date: Jan 2009
Posts: 2
Default

Hello AMPC,

Many thanks for your help.

On top of your advice, I might need to talk with my web developer to change the URL structure.
Reply With Quote
Reply


Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are Off



All times are GMT -5. The time now is .


Powered by a CPU
vBulletin® v3.8.4, Copyright ©2000-2009, Jelsoft Enterprises Ltd.
LinkBacks Enabled by vBSEO 3.3.2 © 2009, Crawlability, Inc.