Creative destruction … Google slayed by the Notificator?

The web has repeatedly demonstrated its ability to evolve and leave embedded franchises struggling or in the dirt.    Prodigy, AOL were early candidates.   Today Yahoo and Ebay are struggling, and I think Google is tipping down the same path.    This cycle of creative destruction — more recently framed as the innovators dilemma — is both fascinating and hugely dislocating for businesses.    To see this immense franchises melt before your very eyes — is hard to say the least.   I saw it up close at AOL.    I remember back in 2000, just after the new organizational structure for AOL / Time Warner was announced there was a three day HBS training program for 80 or so of us at AOL.   I loath these HR programs — but this one was amazing.   I remember Kotter as great (fascinating set of videos on leadership, wish I had them recorded), Colin Powell was amazing and then on the second morning Clay Christensen spoke to the group.    He is an imposing figure, tall as heck, and a great speaker — he walked through his theory of the innovators dilemma, illustrated it with supporting case studies and then asked us where disruption was going to come from for AOL?    Barry Schuler — who was taking over from Pittman as CEO of AOL jumped to answer.   He explained that AOL was a disruptive company by its nature.    That AOL had disruption in its DNA and so AOL would continue to disrupt other businesses and as the disruptor its fate would be different.     It was an interesting argument — heart felt and in the early days of the Internet cycle it seemed credible.   The Internet leaders would have the creative DNA and organizational fortitude to withstand further cycles of disruption.    Christensen didn’t buy it.     He said time and time again disruptive business confuse adjacent innovation for disruptive innovation.   They think they are still disrupting when they are just innovating on the same theme that they began with.   As a consequence they miss the grass roots challenger — the real disruptor to their business.   The company who is disrupting their business doesn’t look relevant to the billion dollar franchise, its often scrappy and unpolished, it looks like a sideline business, and often its business model is TBD.    With the AOL story now unraveled — I now see search as fragmenting and Twitter search doing to Google what broadband did to AOL.

a5e3161c892c7aa3e54bd1d53a03a803

Video First

Search is fragmenting into verticals.     In the past year two meaningful verticals have emerged — one is video — the other is real time search.   Let me play out what happened in video since its indicative of what is happening in the now web.     YouTube.com is now the second largest search site online — YouTube generates domestically close to 3BN searches per month — it’s a bigger search destination than Yahoo.     The Google team nailed this one.    Lucky or smart — they got it dead right.    When they bought YouTube the conventional thinking was they are moving into media –  in hindsight — its media but more importantly to Google — YouTube is search.     They figured out that video search was both hard and different and that owning the asset would give them both a media destination (browse, watch, share) and a search destination (find, watch, share).  Video search is different because it alters the line or distinction between search, browse and navigation.       I remember when Jon Miller and I were in the meetings with Brin and Page back in November of 2006 — I tried to convince them that video was primarily a browse experience and that a partnership with AOL should include a video JV around YouTube.     Today this blurring of the line between searching, browsing and navigation is becoming more complex as distribution and access of YouTube grows outside of YouTube.com.    44% of YouTube views happen in the embedded YouTube player (ie off YouTube.com) and late last year they added search into the embedded experience.    YouTube is clearly a very different search experience to Google.com.       A last point here before I move to real time search.    Look at the speed at which YouTube picked up market share.  YouTube searches grew 114% year over year from Nov 2007 to Nov 2008!?!     This is amazing — for years the web search shares numbers have inched up in Google favor — as AOL, Yahoo and others inch down, one percentage point here or there.    But this YouTube share shift blows away the more gradual shifts taking place in the established search market.     Video search now represents 26% of Google’s total search volume.

summize_fallschurch

The rise of the Notificator

I started thinking about search on the now web in earnest last spring.    betaworks had invested in Summize and the first version of the product (a blog sentiment engine) was not taking off with users.   The team had created a tool to mine sentiments in real-time from the Twitter stream of data.    It was very interesting — a little grid that populated real time sentiments.   We worked with Jay, Abdur, Greg and Gerry Campbell to make the decision to shift the product focus to Twitter search.   The Summize Twitter search product was launched in mid April.   I remember the evening of the launch — the trending topic was IMAP — I thought “that cant be right, why would IMAP be trending”, I dug into the Tweets and saw that Gmail IMAP was having issues.    I sat there looking at the screen — thinking here was an issue (Gmail IMAP is broken) that had emerged out of the collective Twitter stream — Something that an algorithmically based search engine, based on the relationships between links, where the provider is applying math to context less pages could never identify in real time.

A few weeks later I was on a call with Dave Winer and the Switchabit team — one member of the team (Jay) all of a sudden said there was an explosion outside.   He jumped off the conference call to figure out what had happened.    Dave asked the rest of us where Jay lived — within seconds he had Tweeted out “Explosion in Falls Church, VA?”  Over the nxt hour and a half the Tweets flowed in and around the issue (for details see & click on the picture above).    What emerged was a minor earthquake had taken place in Falls Church, Virginia.    All of this came out of a blend of Dave’s tweet and a real time search platform.  The conversations took a while to zero in on the facts — it was messy and rough on the edges but it all happened hours before main stream news, the USGS or any “official” body picked it up the story.  Something new was emerging — was it search, news — or a blend of the two.   By the time Twitter acquired Summize in July of ’08 it was clear that Now Web Search was an important new development.

Fast forward to today and take a simple example of how Twitter Search changes everything.    Imagine you are in line waiting for coffee and you hear people chattering about a plane landing on the Hudson.   You go back to your desk and search Google for plane on the Hudson — today — weeks after the event, Google is replete with results — but the DAY of the incident there was nothing on the topic to be found on Google.  Yet at http://search.twitter.com the conversations are right there in front of you.    The same holds for any topical issues — lipstick on pig? — for real time questions, real time branding analysis, tracking a new product launch — on pretty much any subject if you want to know whats happening now, search.twitter.com will come up with a superior result set.

How is real time search different?     History isnt that relevant — relevancy is driven mostly by time.    One of the Twitter search engineers said to me a few months ago that his CS professor wouldn’t technically regard Twitter Search as search.   The primary axis for relevancy is time — this is very different to traditional search.   Next, similar to video search — real time search melds search, navigation and browsing.       Way back in early Twitter land there was a feature called Track.  It let you monitor or track — the use of a word on Twitter.    As Twitter scaled up Track didn’t and the feature was shut off.   Then came Summize with the capability to refresh results — to essentially watch the evolution of a search query.      Today I use a product called Tweetdeck (note disclosure below) — it offers a simple UX where you can monitor multiple searches — real time — in unison.    This reformulation of search as navigation is, I think, a step into a very new and different future.   Google.com has suddenly become the source for pages — not conversations, not the real time web.   What comes next?   I think context is the next hurdle.    Social context and page based context.    Gerry Campbell talks about the importance of what happens before the query in a far more articulate way than I can and in general Abdur, Greg, EJ, Gerry, Jeff Jonas and others have thought a lot more about this than I have.    But the question of how much you can squeeze out of a context less pixel and how context can to be wrapped around data seems to be the beginning of the next chapter.    People have been talking about this for years– its not that this is new — its just that the implementation of Twitter and the timing seems to be right — context in Twitter search is social.   74 years later the Notificator is finally reaching scale.

A side bar thought: I do wonder whether Twitter’s success is partially base on Google teaching us how to compose search strings?    Google has trained us how to search against its index by composing  concise, intent driven statements.   Twitter with its 140 character limit picked right up from the Google search string.    The question is different (what are you doing? vs. what are you looking for?)  but  the compression of meaning required by Twitter is I think a behavior that Google helped engender.     Maybe, Google taught us how to Twitter.

On the subject of inheritance.  I also believe Facebook had to come before Twitter.    Facebook is the first US based social network — to achieve scale, that is based on real identity.  Geocities, Tripod, Myspace — you have to dig back into history to bbs’s to find social platforms where people used their real names, but none of these got to scale.    The Twitter experience is grounded in identity – you knowing who it was who posted what.    Facebook laid the ground work for that.

What would Google do?

I love the fact that Twitter is letting its business plan emerge in a crowd sourced manner.   Search is clearly a very big piece of the puzzle — but what about the incumbents?   What would Google do, to quote Jarvis?   Let me play out some possible moves on the chess board.   As I see it Google faces a handful of challenges to launching a now web search offering.    First up — where do they launch it,  Google.com or now.Google.com?    Given that now web navigational experience is different to Google.com the answer would seem to be now.google.com.   Ok — so move number one — they need to launch a new search offering lets call it now.google.com.    Where does the data come from for now.google.com?    The majority of the public real time data stream exists within Twitter so any http://now.google.com/ like product will affirm Twitter’s dominance in this category and the importance of the Twitter data stream.    Back when this started Summize was branded “Conversational Search” not Twitter Search.     Yet we did some analysis early on and concluded that the key stream of real time data was within Twitter.    Ten months later Twitter is still the dominant, open, now web data stream.   See the Google trend data below – Twitter is lapping its competition, even the sub category “Twitter Search” is trending way beyond the other services.   (Note: I am using Google trends here because I think they provide the best proxy for inbound attention to the real time microbloggging networks.   Its a measure of who is looking for these services.    It would be preferable to measure actual traffic measured but Comscore, Hitwise, Compete, Alexa etc. all fail to account for API traffic — let alone the cross posting of data (a significant portion of traffic to one service is actually cross postings from Twitter).   The data is messy here, and prone to misinterpretation, so much so that the images may seem blurry).   Also note the caveat re; open.   Since most of the other scaled now web streams of data are closed / and or not searchable (Facebook, email etc.).

screenshot
gTrends data on twitter

Google is left with a set of conflicting choices.     And there is a huge business model question.     Does Ad Sense work well in the conversational sphere?   My experience turning Fotolog into a business suggests that it would work but not as well as it does on Google.com.    The intent is different when someone posts on Twitter vs. searching on Google.   Yet, Twitter as a venture backed company has the resources to figure out exactly how to tune AdSense or any other advertising or payments platform to its stream of data.    Lastly, I would say that there is a human obstacle here.     As always the creative destruction is coming from the bottom up — its scrappy and and prone to been written off as NIH.     Twitter search today is crude — but so was Google.com once upon a not so long time ago.     Its hard to keep this perspective, especially given the pace that these platforms reach scale.     It would be fun to play out the chess moves in detail but I will leave that to another post.   I’m running out of steam here.

AOL has taken a long time to die.    I thought the membership (paid subscribers) and audience would fall off faster than it has.    These shifts happen really fast but business models and organizations are slow to adapt.  Maybe its time for the Notificator to go public and let people vote with their dollars.   Google has built an incredible franchise — and a business model with phenomenal scale and operating leverage.   Yet once again the internet is proving that cycles turn — the platform is ripe for innovation and just when you think you know what is going on you get blindsided by the Notificator.

Note:    Gerry Campbell wrote a piece yesterday about the evolution of search and ways to thread social inference into  search.    Very much worth a read — the chart below, from Gerry’s piece, is useful as a construct to outline the opportunity.

gerry-campbell-emerging-search-landscape1

Disclosure.   I am CEO of betaworks.    betaworks is a Twitter shareholder.  We are also a Tweetdeck shareholder.  betaworks companies are listed on our web site.

  • http://purelyfitness.com/acai-berry-how-losing-30-pounds-in-30-days-is-possible-with-acai Acai Berry

    I was surfing net and fortunately came across this site and found very interesting stuff here. Its really fun to read. I enjoyed a lot. Thanks for sharing this wonderful information.
    Fat Burning Furnace

  • http://ultimategamecard.blogspot.com/ Ultimate Game Card

    This article is very masterfully written. But Google is a monopoly, so the chance of it being destroyed by anything is very unlikely. People thought that Bing would take a chunk out of Google, but look how that ended up.

  • http://www.jointpains.co.uk/ joint pains

    nice posts but i’d like to see more

  • http://twitter.com/pudsey9 paul potts

    One of the best natural Colon Cleanse Product that has received tremendous response from the users is available online. Not only do you get all the benefits of Natural Colon Cleanse but also get a chance to try it Aloe Vera Colon Cleanse Tablets.

  • Anonymous

    This information is some of the best and interesting I have found on this topic for me, I really appreciate this point of view and I’ve found it to be more reliable then some, I will be recommending it to others.
    Seo Link Vine

  • http://profiles.yahoo.com/u/EJKS2MCBR4NUAU6Z6CSP5JQS3E Sheila

    Google is a monopoly, though, who knows as everyone says “the world is round”
    Pure Acai Berry Supplements

  • http://www.medyumburak.com medyum

    I think Twitter search today = WebCrawler of old… WebCrawler is the first search engine I ever remember using, and according to Wikipedia it's the first full-text search engine on the web. WebCrawler was very dumb. If you searched for meatloaf, it gave you the page with the most references to the word meatloaf… there was no recentness priority, there was no pagerank, there was no weighting on page titles or H1 tags. WebCrawler ended up getting VERY spammy as porn sites figured out they just needed to add giant blocks of popular keyword to their pages in order to game the system. It showed people that search could in theory be a great way to find what you want, but it was crippled as the popularity of the web increased.

  • http://profiles.yahoo.com/u/J53GICBTEWEHZWPM76AHZ3JEPA Alexis Gardner

    Google is the biggest baddest bully on the block. I just don't see anyone or anything taking them out.

    Free High School Diploma

  • http://profiles.yahoo.com/u/X7DIDSKWF5UB6KBD67Y5CCGQSY TrungVan

    Love the term deep now web — thank you, may use it and attribute

  • http://www.cellulitetalk.org cellulite treatment

    Love the term deep now web — thank you, may use it and attribute

  • worldvitaminsonline

    Good information. Thanks for posting.

  • acaicolon

    The web is a collective mind that we as a human race are designing, but we still don't have much of a main goal or global desire for our expanding global brain.
    Just think if we we could shift our taxes as a nation, if we used an online community to bring order to our society. Would it be enough to make america more of a prepared nation, rather then reactionary?
    Extenze p90x

  • medyumhakan

    Thanks for admin wonderfull web site for information

  • http://www.louisvuittonhouse.com/ louis vuitton handbags

    Abdur's team may very well figure out how to scale, and extrapolate epic meaning instantly. That's certainly epic responsibility on one small team of engineers. It's also putting epic trust in the infrastructure of the cloud. Time will tell as Twitter may very well be 100MM+ users soon-er. Reminder: within the user base, realtime Epic Events may be a higher number than any of us can imagine.

  • http://twitter.com/acouponaday Patricia Hayes

    Insightful thoughts on relevancy

  • http://twitter.com/acouponaday Patricia Hayes

    Interesting thoughts on relevancy

  • http://acnefreein3days.cz.cc Acne Free In 3 Days

    Thanks for information, I’ll always keep updated here!

  • http://pulse.yahoo.com/_5FWTOUBXAILJKP7U7MBQ2IO4PU Henrike Vötig

    Excellent! Thanks for sharing!

    from Twin Ait Mattress

  • http://www.RafaelNadalParera.com Rafael Nadal

    Google is not going anywhere. They are dominate and will stay that way for years to come.

  • http://www.RafaelNadalParera.com Rafael Nadal

    askdjvnc

  • http://twitter.com/SeoBukan Bukan Das

    Informative one, I went through your post and feel to share this topic with my colleagues, your thought is really very interesting.

  • Anonymous

    That one is really old. But I am interested about how it woks. A robot at that time? Fantastic!

    satellite tv for pc
    live streaming tv

  • Anonymous

    Google certainly is fascinating!

  • Anonymous

    Google is second to none. It simply a wonder.

  • Anonymous

    Google is second to none. Google is best!
    Virility EX?

  • http://www.trainsoscaleus.com trains o scale

    Google are so good its scary, fall out with them and your screwd.

  • http://www.bestspringshomes.com chris bond

    This is a good post. I just want to say one thing about google and that is Google is the best.

  • http://skintagremovaltips.net/ skin tag removal

    It is more complex and its complexity does get a new way to get themselves the advantage. It is really understandable to have some constant changes on this issue here. Where they gain they thrive.

  • http://skintagremovaltips.net/ skin tag removal

    I am glad to hear this news. There some websites that elaborate some data that are similar to this post. But you made it well, especially on how you manage your data to come up with a relevant post.

  • http://wartsguide.com/ wart removal

    Robot messenger? I was trying to figure this out. I think the said automation of the era started as popular election scheme but then it is widely accepted. Information age does dominate the lives of the people these days.

  • http://ezinearticles.com/?Unpublished-Phone-Number-Lookup---Find-Out-the-Identity-of-Your-Wifes-Lover&id=4664636 phone number lookup

    Google has become the biggest bully on the block and unfortunately they’ve almost become a monopoly until facebook came along.

  • http://ezinearticles.com/?Unpublished-Phone-Number-Lookup---Find-Out-the-Identity-of-Your-Wifes-Lover&id=4664636 phone number lookup

    Google has become the biggest bully on the block and unfortunately they’ve almost become a monopoly until facebook came along.

  • http://wowquesthelper.net/ wow quest helper

    They say that today, everything is Googlelable… I think I would agree on this. Almost everything google provides excellent pages on search engine’s capabilities.

  • http://www.extenzereview.net/ Extenze

    Google is so huge with diverse investments that it will be hard to put it down. It already had embedded itself on its core business. Even Microsoft is far from competing effectively with Google on search engine and online ads.

  • http://www.medyumburak.com medyumlar

    I think Twitter search today = WebCrawler of old… WebCrawler is the first search engine I ever remember using, and according to Wikipedia it’s the first full-text search engine on the web. WebCrawler was very dumb. If you searched for meatloaf, it gave you the page with the most references to the word meatloaf… there was no recentness priority, there was no pagerank, there was no weighting on page titles or H1 tags. WebCrawler ended up getting VERY spammy as porn sites figured out they just needed to add giant blocks of popular keyword to their pages in order to game the system. It showed people that search could in theory be a great way to find what you want, but it was crippled as the popularity of the web increased.

  • http://www.cheap-ralphlaurenpoloshirts.com big pony polo

    I thought the membership and audience would fall off faster than it has

  • http://www.cheapguccishoeshop.com cheap gucci shoes

    This is a very appealing post. I haven’t heard of this in the past but it surely sound like a great idea to do business. Many thanks for such a useful post because it really helps the way to improve our lives and reach another level of perfection that we will anticipate in our lives. Guess I need to get my hands on the magazine.when we talk about compensation agents and brokers both behaves same manner it is so cool.

  • http://yeastinfectiontreatmentz.com Yeast Infection Treatment

    The technology develops very quickly. Do you know that 60 years ago Vannevar Bush predicted that humanity will create smart machines with keyboard and mouse? However concerning google’s issues i consider it quite normal behavior. Regards

  • http://www.bingobabe.co.uk Bingo Babe

    Nice post, thanks.

  • Chris Bond

    Only one thing I want to say about this is that “Google is Great.”

    Banners

  • Anonymous

    American baby names such as Jedediah and Jacob are making a comeback with a modern twist as Jed or Jake. American baby names have seen a recent trend also in place names such as Dallas and Ridge. Flower names such as Violet and Rose have always been around but a modern twist has brought Holly, Ivy, and Willow into the limelight. 

  • http://pulse.yahoo.com/_T5GFHQF7KP5SEJ3RHZYNLKUYNI Anonymous

    I really like your approach for seeing things in how Google works. It is really been “public” secret that the big G will rank your site within their system. Anyway, this is a good input for us to learn. Thanks.

  • http://twitter.com/AdvanceTo Paul Graham

    I think Twitter blew it big time by not agreeing on the terms of their deal with Google for real time search. Google will simply go and do it themselves now, leaving Twitter to die a slow death….