Rupert Murdoch has publicly addressed his desire for Google to not index his content, so he can charge people to access it. As the CEO of News Corp. and, ultimately, the head honcho of Fox News, he can easily do this. As was pointed out previously, all he needed to do was ask.

Now, it’s come to light that FoxNews.com specifically asks Google’s bot to index their site. Here is their robots.txt file that gives the Googlebot instructions:

User-agent: *
Disallow: /printer_friendly_story
Disallow: /projects/livestream
#
User-agent: gsa-crawler
Allow: /printer_friendly_story
Allow: /google_search_index.xml
Allow: /google_news_index.xml
Allow: /*.xml.gz
#
Sitemap: http://www.foxnews.com/google_search_index.xml
Sitemap: http://www.foxnews.com/google_news_index.xml

Good luck with that legal action, Rupert. All Google needs to do is hand over the robots.txt file posted above and say, “See, they wanted us to index their content.” Not to mention the Fair Use doctrine means that Google is well within their rights. Unfortunately Murdoch wants to challenge the Fair Use doctrine and, if he were to win, it could be disastrous for U.S. copyright law and all forms of media.

Original Story

Share this article

  • Google
  • Facebook
  • Twitter
  • LinkedIn
  • MySpace
  • FriendFeed
  • Tumblr
  • Instapaper
  • Blogger
  • Reddit
  • Digg
  • Delicious
  • StumbleUpon
  • Add to favorites
  • Email
  • RSS

No related posts.

468 ad

Leave a Reply

Your email address will not be published. Required fields are marked *

*

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <strike> <strong>

Notify me of followup comments via e-mail. You can also subscribe without commenting.