Hi there,
I have recently encountered a problem with generating a Sitemap for my
website. I desperately need some help here.
The website which I want to create a Sitemap is gemondo.com. It’s
a retail website which sales jewelleries. On the website, it has got
a search bar above product lists.
One of such examples is /index.php?page=cat_view&path=10
Visitors can search necklaces according to different material,
gemstone, style and price etc. by using the search bar.
When I tried to generate a Sitemap for this site ,
it basically crawls all the possible pages that could be generated via
this search bar. Because of this, creating a Sitemap always goes into
a process of an endless loop. The waiting records can
reach as many as 300,000 and still keeps on increasing, but the
website has less than 3,000 products listing on it.
Since the website is a dynamic one, therefore, all the URLs are on the
same level. The only difference is the URL of a subcategory has an
additional code.
For example,
Pendants & Necklets:
index.php?page=cat_view&path=10
Pendants & Necklets > 18ct Yellow Gold:
index.php?page=cat_view&path=10-3
Pendants & Necklets > Aquamarine
index.php?page=cat_view&path=10-21
Pendants & Necklets > Aquamarine > Heart
index.php?page=cat_view&path=10-21-43
In general, I want all the category pages to be included in the
Sitemap. However, it seems impossible in this case. To compromise, I
hope at least the main category pages can be included; therefore, I
tried to filter URLs with “-“. However, nothing has changed.
Any advices, please?
Reply With Quote
Hello Victor,
I see your initial page and many of your category pages on gemondo.com have good recognition by google, but your individual pages do not.
Personally, I would be focusing in on the individual pages more than categories, but to each their own.
Have you tried using just an include filter, rather than exclude.
Something like this for cats:
*page=cat_view*
or for items, try:
*page=item_view*
Or do both.
Hello AMPC,
Many thanks for your help.
On top of your advice, I might need to talk with my web developer to change the URL structure.