firewall Spyware removal internet speed test web security service free software and tips


Go Back   Web Security > Our Free Tools > Webmaster Tool - Sitemap Generator
FAQ Members List Search Today's Posts Mark Forums Read

Webmaster Tool - Sitemap Generator Questions about building a sitemap, including the XML Sitemap, HTML sitemap, Google and Yahoo! Sitemaps.

Advertisements

url without filename ext. not crawled

Reply
 
LinkBack Thread Tools Display Modes
  #1 (permalink)  
Old 08-27-2008,
Junior Member
 
Join Date: Nov 2007
Posts: 13
Default url without filename ext. not crawled

Hello,

I have had a problem with google, who assumes that I have duplicate titles, because google consideres /directory/ and /directory/index.(s)html to be different. So I removed the index.html from all url's implemented a rewrite to redirect every index.html to only the url + dir name.
But now your sitemap generator does not follow the link http://example.com/directory/ What now?

Jos
Reply With Quote
  #2 (permalink)  
Old 09-11-2008,
AMPC's Avatar
Administrator
 
Join Date: Jan 2007
Posts: 1,415
Default Sitemap following urls without extensions.

Hello JoS,

Check it out again and let me know if your are having the same problem with the sitemap generator. I know this works and have my own sitemaps with such urls.

Best regards,

Jim.
Reply With Quote
Reply


Thread Tools
Display Modes

Posting Rules
You may not post new threads
You may not post replies
You may not post attachments
You may not edit your posts

BB code is On
Smilies are On
[IMG] code is On
HTML code is Off
Trackbacks are On
Pingbacks are On
Refbacks are Off



All times are GMT -5. The time now is .


Powered by a CPU
vBulletin® v3.8.4, Copyright ©2000-2009, Jelsoft Enterprises Ltd.
LinkBacks Enabled by vBSEO 3.3.2 © 2009, Crawlability, Inc.