DISQUS

Publishing 2.0: Google Orwellian

  • Eric · 3 years ago
    The real offense was censoring the cache: http://paul.kedrosky.com/archives/002480.html
  • Eric · 3 years ago
    Let me quickly retract that: Google seems to have restored their cached version after Paul's post. Here's the page that was allegedly removed: http://72.14.203.104/search?q=cache:Hb5MMW_p96w...

    Please see the above link, and Kedrosky's, for yourself. However, the episode still raises this question: is the power the revise history via the cache more awesome than the ability to limit real-time search results?
  • Michal Migurski · 3 years ago
    What unchecked power?

    Their power is derived from their user base. If they take actions that worsen the search experience enough to leave the door open to a competitor, people will switch just like they switched to Google seven years ago. This is the ultimate low-swithing-cost free market we're talking about here, as far away from Stalinism as can be. Is Publishing 2.0 at risk? Who knows... how much of your traffic comes from Google searches, and how much from links outside of Google's sphere of influence?
  • Brian Clark · 3 years ago
    Come on now... BMW was doing blatant cloaking, an SEO trick that everyone in the SEO community knows will get you banned if detected.

    If BMW didn't know the risk they were taking, their SEO consultants certainly did.

    That said, yes Google is scary. But this is an example that falls way down the list of things to be afraid of. Blogs shouldn't rely on search engine traffic anyway. Until Google can take away your inbound links, you'll be fine.
  • David Utter · 3 years ago
    @Michal: The problem with switching is that, unlike seven years ago when users ditched AltaVista for Google, there is no "Google" today to switch to.

    Yahoo's public message on search is at best mixed. Has Susan Decker made any follow up statements since here Bloomberg interview? And Yahoo is generally considered second to Google in search relevance. What's the next option? MSN? AOL? Ask?

    Not at this point in time.

    And from NitPic2.0 (tm), British historian Lord Acton's commentary on power predated Orwell by a few decades: Power tends to corrupt; absolute power corrupts absolutely.

    (Or the corollary: Power tends to corrupt; absolute power is much more fun!)
  • Michal Migurski · 3 years ago
    @David: I'm not sure I agree that Google lacks serious competition. Yahoo! and MSN have both essentially caught up; I use Google more out of habit than because I believe they're still measurably better. Also, I think that if Google continued to slip a little, a competitor would step up. Right now, no one wants to fund search because there's an impression that competing with Google is a fool's game. A few missteps can change this perception.

    Google got in the door because the switching costs of search engine choice seven years ago were near zero. The move to personalization is an attempt to increase these costs artificially, but it's not Windows-expensive.
  • Michal Migurski · 3 years ago
    Also, just wanted to toss in a link to this excellent and mildy-related Bob Blakley essay, On The Absurdity of "Owning One's Identity". If PageRank is reputation, then it's not BMW's, it's Google's story about BMW.
  • Danny Sullivan · 3 years ago
    Gosh, where to begin.

    1) Google does not have near total power, not even in search. Yep, a huge amount of traffic flows through Google. A huge amount also does NOT. Yahoo, MSN and Ask Jeeves are all independent search voices that have a lot of usage. Google is merely one search "newspaper" among them -- a big one, but not the only one.

    2) Google is not the only search engine that annoits itself judge, jury and executioner. They all have guidelines that they themselves solely create and measure against. Google isn't some unusual exception. That's standard practice in the search engine industry and has been since pretty much day one. Need more? See http://searchenginewatch.com/searchday/article....

    3) Suggesting that lowering the ranking of a site is better than dropping a PageRank score is simply silly. You don't really seem to understand how things actually operate. If a site is banned, it is removed from the index entirely. That is in effect one of those "tweaks" you are talking about. Yeah, the PageRank score drops as well. Who cares? It doesn't matter ultimately what your score is. It matters whether you rank for anything in actual searches. That leads to another possibility -- that you aren't banned but that you are penalized. So big deal -- you might still keep your PR7, PR8 or whatever but you don't rank for any term. That PageRank doesn't help you at all. And by the way, Google's actually won the legal right to do whatever it wants with PageRank scores (see http://www.pandia.com/sw-2003/21-searchking.html, http://searchenginewatch.com/sereport/article.p...)

    4) Orthodoxy? OK, tell you what. How about someone takes a copy of something from your web site, cloaks it so that only Google sees it, then feeds out something different to a users. Would following that orthodoxy bother you? OK, that's not what happened here. What happened here is that BMW was showing pictures of pretty cars but to Google's spider, it was showing nonesensical copy including the repetition of the phrase "used cars" over 40 times. No issue with that? Actually, you might not. Exactly what is deemed to be "manipulating" Google or any search engine is hotly debated by those in the trenches of search engine optimization and has been done for years. But what you'll find many will tell you is that ultimate, the final arbiter on these matters is the search engines themselves. Fly in the face of what they say NOT to do, and you might find yourself banned. Don't like it? Find another search engine to be listed in for free. Search engines are under no obligation to carry anything, any more than a newspaper (or your own web site here) is obligated to carry anything.

    5) Are you in danger of being banned for your "dissent?" Please. Google lists web site that are far more antagonistic that this post even comes close to approaching. Heck, Google-Watch.org has been slamming Google for years and remains listed just fine.

    6) As for Alexander's post, there were no "secret police" that went out and did this. Philipp over Google Blogoscoped reporting on the BMW spam here, http://blog.outer-court.com/archive/2006-02-01-.... That spread out among a variety of search blogs, including my own. That publicity meant Google was going to have to do something, otherwise it would have been accused of allowing BMW to break the rules other sites have to follow. And then no doubt we'd be told that this is because BMW might advertise with Google, so look at how evil they are in playing favorites, etc.

    Overall, I can understand many of the concerns you have, but they a lot of real perspective about how search engines have and currently do interact with web site content.

    A big site like BMW should have known better -- or more likely in this case, probably a firm that was doing the SEO for BMW should have known better. They deserve no tears here. They'll be back in Google in short order. Reserve your concern for the smaller site owners who might accidentally do stupid things. Even there, things have actually gotten positive over the past few months with Google actually doing an outreach program to many of them that might violate guidelines, as covered more here: http://www.mattcutts.com/blog/webmaster-communi...
  • Mathew Ingram · 3 years ago
    Come on, Scott -- talking about Google and Orwell in the same sentence is just a little over the top, isn't it? We're talking about a search engine, not the technology arm of a police state, or a boot stamping on a human face. If George Bush had persuaded Google to remove webpages chronicling his cocaine use during college, then I could see the point. Of course, BMW didn't get to "confront its accuser" as Alex said -- because it wasn't a trial. Google provides searches, and it has terms for inclusion in its index; break the rules and you are out. If you don't like it, get yourself indexed by a different search engine. Are people somehow unable to find BMW's website without the use of Google? No. As Michal points out, there are other engines, even if everyone is currently obsessed with Google's dominance. As for Alex being concerned that Google would "zap" his page-rank for even writing about it, that's so farcical it doesn't even really deserve a response.
  • Scott Karp · 3 years ago
    Mathew, why does an entity have to be government to be Orwellian? Google is a private, company and it can do whatever it wants with its service (within the law), but it does so under the rubric of "righteous" search results -- it's Google's self-righteousness that bothers me more than anything else. The question of switching is completely missing the point -- of course Google's position is neither permanent nor guaranteed. But in the present moment, it is dominant, and when it cracks down on a BMW, it does real damage to their business. From a free market standpoint, there's nothing wrong with that -- but if you pretend to righteous, you will be judged by that standard. And the type of power that Google as a private company now wields over the business dynamics of other companies is, unless I'm missing something, unprecedented. So if we shy away from calling Google Orwellian, we close our eyes -- maybe there's nothing to see, but if we don't look, we'll never know.

    I'm glad you sleep well at night confident that Google would not seek retribution against a website that expresses a dissenting opinion -- why would they do that? -- because they can -- that's how power corrupts. Maybe you're also confident that the government is only wiretapping conversations with terrorists -- it's only by trusting in power that we put ourselves at risk of subjugation. If that's over-the-top, it's only the because the particular circumstances pan out that way, not because the principle behind the inquiry is misguided.
  • Scott Karp · 3 years ago
    Danny, my response to you as the same as to Mathew -- I'm not suggesting there is anything immoral or illegal or unfair about what Google did to BMW -- as long as they comply with the law, they can do whatever they please, and people can switch search engines if they don't like it.

    What raises my red flag is the tone that Google takes in justifying their actions. (Maybe it's the tone that I took that prompted you to write a 6+ point apology for Google -- if I was so off the mark with this post, it would hardly be worth your time -- and it's my blog, so I can say whatever I want, right? At least I don't turn of my comments to block the flood of people telling me I'm wrong.)

    We may both agree that what BMW did was an "unfair" practice, but Google's ability to arbitrate "fair practices" with such impact is a new phenomenon in the history of information flow and marketing activities, and I don't think it can be given too much scrutiny.

    That Yahoo and MSN have competing search engines has no bearing on an assessment of Google's behavior or on the current measure of their power. If I decided to block BMW from AdSense and all Chinese IP addresses from accessing my website, do you think anyone would care? No, and why -- because my site doesn't matter -- it's insignificant in the grand scheme of information flow on the Internet. But the same is not true of Google.

    What Google does matters a lot -- which is not to say we should regulate it or make it illegal -- they may not have crossed that line yet. But if our default posture is to give them a free pass, what's to stop them from crossing that line?

    Orwell's lesson is that you slide down the slope faster than you think.
  • Seth Finkelstein · 3 years ago
    Scott, do you stay awake at night worrying that the US government is going to send you to Guantanamo bay for your website? That's roughly what you're doing here. What Google did was:

    1) A *good* use of power!

    2) More an action to which they were pushed by embarrassment than any kind of Stalinist purge.

    The overheated rhetoric makes talking about Google's power *harder*, because defense against spammers is so important.
  • Ted · 3 years ago
    I hate to say it, but I've lost a certain amount of respect for this blog based on this post.

    It's hard to write about media 2.0, when you don't seem to grasp a basic concept of the internet.

    BMW was essentially using techniques designed to boost rankings which rely on cracks within Google's system. This is commonly called 'spamming' although it has nothing to do with spam-- it has to do with exploiting Google's system to get more hits. Exactly what spammers and splogs do.

    Every day, hundereds if not thousands of sites get blacklisted in exactly this same way. Most of them will never recover, because they never had the content in the first place. BMW will of course be back, but this is a good lesson to all of those SEO idiots who think they won't get caught.

    BMW should have immediately fired their SEO team, apologized to Google, and moved on.

    This is not about Big Brother-- it's about Google, a multi-billion dollar company, protecting what is still essentially their only asset- relevency of search results.

    The China decision and this have zero connection other then Google trying to make money. You can't make money if you allow people to exploit the principal reason for being-- to deliver the best search results.
  • Sundar · 3 years ago
    nn
    I hate to say it, but I’ve lost a certain amount of respect for this blog based on this post.
    nn
    This is precisely why people are concerned about. There's a real danger of people preconcieving that Google's right and then judging the matter.
  • David Utter · 3 years ago
    @Michal: I use search engines a lot, and not just the big players. I'm certainly no Danny Sullivan when it comes to writing about them, but I think I've got a pretty good handle on the relevance issue.

    I agree with you that there is competition in search, but as for MSN and Yahoo having caught up, I'm just not seeing it. My experience has been 1) submit a query to a non-Google search engine, 2) click through two or three pages of results, 3) toss the query at Google just for giggles, 4) see the answer I need appear in Google SERPs on the first page, usually in the first six or seven entries.

    YMMV.
  • Danny Sullivan · 3 years ago
    Scott, sorry you took what I posted at a 6 point apology for Google. It was more an attempt to better educate you about how search engines have and currently do operate. If you want to comment about big brotherish activities in regards to search spam, understanding the history and climate of how search engines have operated would be helpful.

    Of course you can say whatever you like. I didn't suggest otherwise. I'm just providing some additional information that might help influence how you and others think. I assumed you wanted such comments, since you allow them here.

    As for me turning off my comments, that's not true. I'm not sure if you were aiming that at me or not. But if you have any comments about anything I've written, you're more than welcome to post in our forums, http://forums.searchenginewatch.com. Want to comment about what I've written on the BMW issue? Here's the exact discussion on that, http://forums.searchenginewatch.com/showthread..... You're more than welcome. I love comments and discussion. Heck, that's why I'm commenting here.

    Yahoo and MSN are definitely not insignificant. There are plenty of sites that do not rank well in Google but thrive and survive. That's been the case for years. It was the case even before we had Google. It is an important player; the most popular one currently, but building it up as the only one or the only one that matters simply inflates Google's own mistaken opinion of itself and the mistaken opinions others have of it.

    Comparing Google to the other search engines is crucial if you want to determine if its behavior is somehow wrong in this matter. As I've explained, it is simply deciding what it will accept just as all the other major search engines do. If you have a problem with BMW being banned, that's not a problem with Google -- that's a problem with search engines in general.

    That issue -- whether search engines as a whole should be banning for various reasons, either because of technicalities or because of underlying content -- is a long discussed one in the search engine optimization industry, the people who have been fighting this front line battle you've now waded in on. If you explore some of that discussion (and I'll be happy to send you links to good articles if you want), you'll find it is hardly a black and white issue.

    Cloaking content, as BMW was doing, isn't necessarily deemed evil by many if the content is pretty much getting people to a page that it's a about. So what if BMW used "used BMWs" 42 times in copy no one can see. The end result was you got to a page that no one would deny is about used BMWs. But then again, if I cloak content about children's games and deliver you to porn, is that OK? Such things happen. If I steal your content here because you rank well for a term, then cloak it, then manage to rank well for that term myself and point to a page of my own on that topic, is that OK?

    These are some of the many issues involve and which have been debated. We're far a perfect solution, but to suggest that Google or anyone is getting a free pass simply doesn't reflect the people really watching this space, the SEOs. The SEO commentary has been fairly consolidated around the fact that BMW got what they deserved, if only because the content cloaking was so old school that it could only survive on a German language site that Google and gang aren't watching so much.
  • Scott Karp · 3 years ago
    Danny, most important -- I wasn't referring to you turning off comments, I was referring to Matt Cutts on his blog post about BMW.

    As for my suggestion that you were being apologist, it strikes me that all this flap is about tone and appearance -- all of your points were both valid and informative. And I appreciate your "let me try to shed light on the issue" response vs. Jeremy Zawodny "You're stupid, shut up" response.

    I understand the problem of bait and switch that Google is battling, but to compare what BMW did to purveyors of child pornography is stretching it a bit.

    I would love to learn more about the history of this debate -- you're right that I'm obligated to do so, having waded in.

    If raising hackles leads more people like you to shed light, I can't see how that's not a good thing.
  • Karl · 3 years ago
    Philly Future was previously banned from Google. I had let the domain drop for a year, after the death of my nephew. A porn spammer took it - and abused it - leading Google to ban it.

    After restarting the service and getting the domain back - it led to a long discovery process to figure out what was wrong and how to get listed again. I kept submitting the site to be indexed to no avail. During this time we lost considerable mindshare among folks watching our space - it was almost as if we didn't exist.

    One of the hardest problems was determining if we had done something wrong in the first place. The general consensus was we must have. We were assumed guilty by many folks who I discussed this with.

    I sent a few emails that got no reply. Posted to Ask Metafilter - got the advice to give up and get a new domain name. Posted to a Google newsgroup. And then went looking for Google employee bloggers and found one who gave me the info I needed to get unblacklisted. I followed his instructions - which at the time was sending an email with a particular subject line and details in its message. I got an automated response that was maddening and led me to believe it wouldn't work.

    A week or so later Dan Gillmor raised the issue on his older blog: http://dangillmor.typepad.com/dan_gillmor_on_gr...

    Matt Cutts of Google commented that I had followed the correct procedure and staff looking to approve Philly Future for reindexing.

    Getting unbanned is doable and can be done quickly (as that thread attests a couple weeks). It took me many months due to lack of knowledge. It would have been great if Google provided a service to determine if a domain was blacklisted and to look at websites and review them for appropriate search engine optimization techniques and flag those deemed abuse. I could at least have known then that the trouble wasn't me. But I didn't even know I was blacklisted except for the symptoms - not showing up in Google with numerous bloggers pointing to us - and a zero PageRank.

    Matt Cutts has posted about the reinclusion proceedure here: http://www.mattcutts.com/blog/reinclusion-reque....

    It sounds like BMW may have brought this on themselves, at a site that large, with their resources, it's almost inexcusable. Google's guidelines are pretty clear and simple. However, I would like to see Google have better support for webmasters like those I just suggested. It looks like they are experimenting with some ideas already, see: http://www.mattcutts.com/blog/webmaster-communi... .

    My experience tells me that if you aren't in Google - you don't exist. As soon as we got in Google things immediately changed for Philly Future in terms of influence and attention from others who run similar sites.
  • Danny Sullivan · 3 years ago
    Thanks for the clarification on the comments issue, Scott. The issue of tone and appearance is also well taken. I'll give you the reading list in a moment, but that is one of the main issues in this long standing debate. Does it really matter how a searcher got to a page about used BMWs, as long as it is a relevant page. "White hat" SEOers say yes -- there are rules, and people should play by them. "Black hat" SEOers would say no -- if you aren't misleading someone about what they'll ultimately see, it's not like there's really a level playing field at all. The key issue in this case probably is that BMW is a big huge brand. Doing something that's so clearly against the stated search rules isn't wise from a PR perspective. They could take the black hat stance and say, "So what, we aren't misleading anyone." In fact, perhaps they or some other big company will do that. But they really are probably the biggest company to be so publicly slapped like this, while other small companies and individual have endured more. Anyway, http://blog.searchenginewatch.com/blog/060207-0... that I've just posted summarize a ton of stuff on the issue at the end. Hope you find it useful.
  • Jim Hedger · 3 years ago
    Learn how the search enignes work before comparing a mathematical algorithm to Orwellian distopic fantasy. Here is a better way to describe what happened to BMW.

    Google said, "Don't run red lights when trying to race to the top of the index."

    BMW failed to stop for the red lights and was penalized for it.
  • gerber · 3 years ago
    You guys are insane, i'm going to "execute" publishing 2.0 from my online sphere.
  • aaron wall · 3 years ago
    Is Google using BMW as a marketing ploy? Absolutely.

    If you were them would you do the same? Probably.
  • Mark · 3 years ago
    This is an excellent example of Google simply over-reacting, and I personally believe that this will backfire sometime in the future. While the technique of BMW is questionable, it could be seen as trying to fight the spammy webmasters. IF Google were really good, then why had BMW to use cloaking in the first place?
    Also, I would like to see BMW suing Google over Copyright infringement. Huh? Yes, for example, Matt's blog has a screenshot of the public BMW web site (surely copyright protected!). Or take the images of BMW in the index. All copyright protected.
    Another question is - who needs whom here? If you don't know that the website of BMW is bmw.de or bmw.com, then good night. If BMW were cool, they simply would sue the hell out of Google and don't bother with being included in the index.