Google ignores Bings robots.txt ?

{ Posted on Jun 12 2009 by admin }
Tags : , , , , , , , , , ,
Categories : davidnaylor

today while do some keyword research in Google I came across a bing search listing ranking at #11 for a competitive term, which is odd due to the fact that Bing blocks spiders to those pages !!

bing robots

but when I did a site:bing.com/search

bing_pages_indexed

so why is google indexing these pages and should bing just drop the robots.txt file and give google what it wants ?, of course these pages are not truly indexed has a few people on twitter has pointer out to me, but 11,000 + pages from links pointing at those pages that Google is allowed to spider ??

DaveN

Read more here:
Google ignores Bings robots.txt ?

This entry was posted on Friday, June 12th, 2009 at 9:01 am and is filed under davidnaylor. You can follow any responses to this entry through the RSS 2.0 feed. You can leave a response, or trackback from your own site.


8 Responses to “Google ignores Bings robots.txt ?”

  1. By I Make Thousands of Dollars a Month Posting Links on Google from Home on Jun 12, 2009 | Reply

    Hey, nice post, really well written. You should write more about this. I’ll definitely be subscribing.

  2. By I Make Thousands of Dollars a Month Posting Links on Google from Home on Jun 12, 2009 | Reply

    Hey, nice post, very well written. You should write more about this.

  3. By seocloak on Jun 16, 2009 | Reply

    Thanks you :-)

  4. By forced lesbian strapon on Jun 17, 2009 | Reply

    nice! i’m gonna make my own blog

  5. By yuri rape hentai on Jul 1, 2009 | Reply

    I should email you about this.

  6. By latinas follando on Jul 19, 2009 | Reply

    hmm.. really like it

  7. By drunk girls kiss on Jul 20, 2009 | Reply

    hh.. 10x

  8. By chubby cunt squirting on Jul 25, 2009 | Reply

    emm.. informative ))

Post a Comment