links not followed

Hi Jos,

I just ran your site (not full, just enough to monitor the spidering process) and used an exclude of .html and I'm seeing entries like these:

/carnaval/klooneconcours2008/
/carnaval/groteoptochtkerkradecentrum2008/
http://vanderburgt.eu/carnaval/mijncarnavalinkerkradedoordejarenheen/

This is what you want, no?

Perhaps I'm missing something, but the sitemap generator is seeing your carnival directories. Is this not what you want?

Regards,

Jim.

__________________
Firewall Test Internet Speed Test Sitemap Generator

Now I see what my problem is. By using an include filter of *html no link is followed that only has the domain + directory in it, so without the filename.html.

One more question is, that I do still get image links (ending with .jpg) in the results if I tick the box "exclude images".

Thanks for your help.

Jos

Hi Jos,

That question deserves a thread of its own, so follow this link on excluding images from your sitemap.

Regards,

Jim.

__________________
Firewall Test Internet Speed Test Sitemap Generator