Pandia Search Engine News Wrap-up Oct 10

Here’s this week’s glance into the world of search and search engines:

Matt Cutts on the robots.txt file and indexing

Some complain that even if they set up a robots.txt file banning Google from indexing a file, Google will still include that file in search results.

Google’s Matt Cutts explains why:

Share and Enjoy:
  • Digg
  • Sphinn
  • del.icio.us
  • Facebook
  • Mixx
  • Google
  • Bumpzee
  • Furl
  • Ma.gnolia
  • MisterWong
  • Propeller
  • Reddit
  • StumbleUpon
  • TwitThis
  • Wikio
  • YahooMyWeb
  • BlinkList
  • NewsVine
  • Netvouz
  • Technorati
  • Yahoo! Buzz