View Single Post
  #1 (permalink)  
Old 01-13-2009,
Victor Pang Victor Pang is offline
Junior Member
 
Join Date: Jan 2009
Posts: 2
Default Need advice to generate Sitemap for my website

Hi there,

I have recently encountered a problem with generating a Sitemap for my
website. I desperately need some help here.

The website which I want to create a Sitemap is gemondo.com. It's
a retail website which sales jewelleries. On the website, it has got
a search bar above product lists.

One of such examples is /index.php?page=cat_view&path=10

Visitors can search necklaces according to different material,
gemstone, style and price etc. by using the search bar.

When I tried to generate a Sitemap for this site ,
it basically crawls all the possible pages that could be generated via
this search bar. Because of this, creating a Sitemap always goes into
a process of an endless loop. The waiting records can
reach as many as 300,000 and still keeps on increasing, but the
website has less than 3,000 products listing on it.

Since the website is a dynamic one, therefore, all the URLs are on the
same level. The only difference is the URL of a subcategory has an
additional code.

For example,
Pendants & Necklets:
index.php?page=cat_view&path=10

Pendants & Necklets > 18ct Yellow Gold:
index.php?page=cat_view&path=10-3

Pendants & Necklets > Aquamarine
index.php?page=cat_view&path=10-21

Pendants & Necklets > Aquamarine > Heart
index.php?page=cat_view&path=10-21-43

In general, I want all the category pages to be included in the
Sitemap. However, it seems impossible in this case. To compromise, I
hope at least the main category pages can be included; therefore, I
tried to filter URLs with “-“. However, nothing has changed.

Any advices, please?
Reply With Quote