It is not just about Microsoft.com or Msn.com that have an infinite number of URLs, infact a lot of sites are have unlimited URLs. So the question that now arises is how to optimize big sites?
Jeremiah Andrick over at the Live Search Webmaster blog is offering wonderful tips for optimizing your large sites for search!
His first tip: Canonicalization/ Normalization. That means exposing URL per piece of content to the engines.
What's next? Have a look at some of the optimization related problems that can occur due to multiple URLs and the conversions that should be made: :
- Add or remove the trailing /
- http://www.mysite.com/ to http://www.mysite.com
- Remove the index or default
- http://www.mysite.com/default.aspx to http://www.mysite.com
- http://www.mysite.com/en/us/default.aspx to http://www.mysite.com/en/us
- Avoid CamelCase Ă˘â‚¬â€ť convert your text to lower case
- http://www.mysite.com/FooBar/ to http://www.mysite.com/foobar
- Remove query string variables or rewrite to readable URLs
- http://www.mysite.com/downloads/details.aspx?FamilyID=ab99&displaylang=en to http://www.mysite.com/downloads/en/family/ab99
- Remove Port Numbers
- http://www.mysite.com:8080/ to http://www.mysite.com
- Avoid exposing secure HTTPS version
- https://www.mysite.com/en/us/ to http://www.mysite.com/en/us
Read all of Andricks' recommendations, click here.