Creative destruction … Google slayed by the Notificator?

The web has repeatedly demonstrated its ability to evolve and leave embedded franchises struggling or in the dirt.    Prodigy, AOL were early candidates.   Today Yahoo and Ebay are struggling, and I think Google is tipping down the same path.    This cycle of creative destruction — more recently framed as the innovators dilemma — is both fascinating and hugely dislocating for businesses.    To see this immense franchises melt before your very eyes — is hard to say the least.   I saw it up close at AOL.    I remember back in 2000, just after the new organizational structure for AOL / Time Warner was announced there was a three day HBS training program for 80 or so of us at AOL.   I loath these HR programs — but this one was amazing.   I remember Kotter as great (fascinating set of videos on leadership, wish I had them recorded), Colin Powell was amazing and then on the second morning Clay Christensen spoke to the group.    He is an imposing figure, tall as heck, and a great speaker — he walked through his theory of the innovators dilemma, illustrated it with supporting case studies and then asked us where disruption was going to come from for AOL?    Barry Schuler — who was taking over from Pittman as CEO of AOL jumped to answer.   He explained that AOL was a disruptive company by its nature.    That AOL had disruption in its DNA and so AOL would continue to disrupt other businesses and as the disruptor its fate would be different.     It was an interesting argument — heart felt and in the early days of the Internet cycle it seemed credible.   The Internet leaders would have the creative DNA and organizational fortitude to withstand further cycles of disruption.    Christensen didn’t buy it.     He said time and time again disruptive business confuse adjacent innovation for disruptive innovation.   They think they are still disrupting when they are just innovating on the same theme that they began with.   As a consequence they miss the grass roots challenger — the real disruptor to their business.   The company who is disrupting their business doesn’t look relevant to the billion dollar franchise, its often scrappy and unpolished, it looks like a sideline business, and often its business model is TBD.    With the AOL story now unraveled — I now see search as fragmenting and Twitter search doing to Google what broadband did to AOL.

a5e3161c892c7aa3e54bd1d53a03a803

Video First

Search is fragmenting into verticals.     In the past year two meaningful verticals have emerged — one is video — the other is real time search.   Let me play out what happened in video since its indicative of what is happening in the now web.     YouTube.com is now the second largest search site online — YouTube generates domestically close to 3BN searches per month — it’s a bigger search destination than Yahoo.     The Google team nailed this one.    Lucky or smart — they got it dead right.    When they bought YouTube the conventional thinking was they are moving into media —  in hindsight — its media but more importantly to Google — YouTube is search.     They figured out that video search was both hard and different and that owning the asset would give them both a media destination (browse, watch, share) and a search destination (find, watch, share).  Video search is different because it alters the line or distinction between search, browse and navigation.       I remember when Jon Miller and I were in the meetings with Brin and Page back in November of 2006 — I tried to convince them that video was primarily a browse experience and that a partnership with AOL should include a video JV around YouTube.     Today this blurring of the line between searching, browsing and navigation is becoming more complex as distribution and access of YouTube grows outside of YouTube.com.    44% of YouTube views happen in the embedded YouTube player (ie off YouTube.com) and late last year they added search into the embedded experience.    YouTube is clearly a very different search experience to Google.com.       A last point here before I move to real time search.    Look at the speed at which YouTube picked up market share.  YouTube searches grew 114% year over year from Nov 2007 to Nov 2008!?!     This is amazing — for years the web search shares numbers have inched up in Google favor — as AOL, Yahoo and others inch down, one percentage point here or there.    But this YouTube share shift blows away the more gradual shifts taking place in the established search market.     Video search now represents 26% of Google’s total search volume.

summize_fallschurch

The rise of the Notificator

I started thinking about search on the now web in earnest last spring.    betaworks had invested in Summize and the first version of the product (a blog sentiment engine) was not taking off with users.   The team had created a tool to mine sentiments in real-time from the Twitter stream of data.    It was very interesting — a little grid that populated real time sentiments.   We worked with Jay, Abdur, Greg and Gerry Campbell to make the decision to shift the product focus to Twitter search.   The Summize Twitter search product was launched in mid April.   I remember the evening of the launch — the trending topic was IMAP — I thought “that cant be right, why would IMAP be trending”, I dug into the Tweets and saw that Gmail IMAP was having issues.    I sat there looking at the screen — thinking here was an issue (Gmail IMAP is broken) that had emerged out of the collective Twitter stream — Something that an algorithmically based search engine, based on the relationships between links, where the provider is applying math to context less pages could never identify in real time.

A few weeks later I was on a call with Dave Winer and the Switchabit team — one member of the team (Jay) all of a sudden said there was an explosion outside.   He jumped off the conference call to figure out what had happened.    Dave asked the rest of us where Jay lived — within seconds he had Tweeted out “Explosion in Falls Church, VA?”  Over the nxt hour and a half the Tweets flowed in and around the issue (for details see & click on the picture above).    What emerged was a minor earthquake had taken place in Falls Church, Virginia.    All of this came out of a blend of Dave’s tweet and a real time search platform.  The conversations took a while to zero in on the facts — it was messy and rough on the edges but it all happened hours before main stream news, the USGS or any “official” body picked it up the story.  Something new was emerging — was it search, news — or a blend of the two.   By the time Twitter acquired Summize in July of ’08 it was clear that Now Web Search was an important new development.

Fast forward to today and take a simple example of how Twitter Search changes everything.    Imagine you are in line waiting for coffee and you hear people chattering about a plane landing on the Hudson.   You go back to your desk and search Google for plane on the Hudson — today — weeks after the event, Google is replete with results — but the DAY of the incident there was nothing on the topic to be found on Google.  Yet at http://search.twitter.com the conversations are right there in front of you.    The same holds for any topical issues — lipstick on pig? — for real time questions, real time branding analysis, tracking a new product launch — on pretty much any subject if you want to know whats happening now, search.twitter.com will come up with a superior result set.

How is real time search different?     History isnt that relevant — relevancy is driven mostly by time.    One of the Twitter search engineers said to me a few months ago that his CS professor wouldn’t technically regard Twitter Search as search.   The primary axis for relevancy is time — this is very different to traditional search.   Next, similar to video search — real time search melds search, navigation and browsing.       Way back in early Twitter land there was a feature called Track.  It let you monitor or track — the use of a word on Twitter.    As Twitter scaled up Track didn’t and the feature was shut off.   Then came Summize with the capability to refresh results — to essentially watch the evolution of a search query.      Today I use a product called Tweetdeck (note disclosure below) — it offers a simple UX where you can monitor multiple searches — real time — in unison.    This reformulation of search as navigation is, I think, a step into a very new and different future.   Google.com has suddenly become the source for pages — not conversations, not the real time web.   What comes next?   I think context is the next hurdle.    Social context and page based context.    Gerry Campbell talks about the importance of what happens before the query in a far more articulate way than I can and in general Abdur, Greg, EJ, Gerry, Jeff Jonas and others have thought a lot more about this than I have.    But the question of how much you can squeeze out of a context less pixel and how context can to be wrapped around data seems to be the beginning of the next chapter.    People have been talking about this for years– its not that this is new — its just that the implementation of Twitter and the timing seems to be right — context in Twitter search is social.   74 years later the Notificator is finally reaching scale.

A side bar thought: I do wonder whether Twitter’s success is partially base on Google teaching us how to compose search strings?    Google has trained us how to search against its index by composing  concise, intent driven statements.   Twitter with its 140 character limit picked right up from the Google search string.    The question is different (what are you doing? vs. what are you looking for?)  but  the compression of meaning required by Twitter is I think a behavior that Google helped engender.     Maybe, Google taught us how to Twitter.

On the subject of inheritance.  I also believe Facebook had to come before Twitter.    Facebook is the first US based social network — to achieve scale, that is based on real identity.  Geocities, Tripod, Myspace — you have to dig back into history to bbs’s to find social platforms where people used their real names, but none of these got to scale.    The Twitter experience is grounded in identity – you knowing who it was who posted what.    Facebook laid the ground work for that.

What would Google do?

I love the fact that Twitter is letting its business plan emerge in a crowd sourced manner.   Search is clearly a very big piece of the puzzle — but what about the incumbents?   What would Google do, to quote Jarvis?   Let me play out some possible moves on the chess board.   As I see it Google faces a handful of challenges to launching a now web search offering.    First up — where do they launch it,  Google.com or now.Google.com?    Given that now web navigational experience is different to Google.com the answer would seem to be now.google.com.   Ok — so move number one — they need to launch a new search offering lets call it now.google.com.    Where does the data come from for now.google.com?    The majority of the public real time data stream exists within Twitter so any http://now.google.com/ like product will affirm Twitter’s dominance in this category and the importance of the Twitter data stream.    Back when this started Summize was branded “Conversational Search” not Twitter Search.     Yet we did some analysis early on and concluded that the key stream of real time data was within Twitter.    Ten months later Twitter is still the dominant, open, now web data stream.   See the Google trend data below – Twitter is lapping its competition, even the sub category “Twitter Search” is trending way beyond the other services.   (Note: I am using Google trends here because I think they provide the best proxy for inbound attention to the real time microbloggging networks.   Its a measure of who is looking for these services.    It would be preferable to measure actual traffic measured but Comscore, Hitwise, Compete, Alexa etc. all fail to account for API traffic — let alone the cross posting of data (a significant portion of traffic to one service is actually cross postings from Twitter).   The data is messy here, and prone to misinterpretation, so much so that the images may seem blurry).   Also note the caveat re; open.   Since most of the other scaled now web streams of data are closed / and or not searchable (Facebook, email etc.).

screenshot
gTrends data on twitter

Google is left with a set of conflicting choices.     And there is a huge business model question.     Does Ad Sense work well in the conversational sphere?   My experience turning Fotolog into a business suggests that it would work but not as well as it does on Google.com.    The intent is different when someone posts on Twitter vs. searching on Google.   Yet, Twitter as a venture backed company has the resources to figure out exactly how to tune AdSense or any other advertising or payments platform to its stream of data.    Lastly, I would say that there is a human obstacle here.     As always the creative destruction is coming from the bottom up — its scrappy and and prone to been written off as NIH.     Twitter search today is crude — but so was Google.com once upon a not so long time ago.     Its hard to keep this perspective, especially given the pace that these platforms reach scale.     It would be fun to play out the chess moves in detail but I will leave that to another post.   I’m running out of steam here.

AOL has taken a long time to die.    I thought the membership (paid subscribers) and audience would fall off faster than it has.    These shifts happen really fast but business models and organizations are slow to adapt.  Maybe its time for the Notificator to go public and let people vote with their dollars.   Google has built an incredible franchise — and a business model with phenomenal scale and operating leverage.   Yet once again the internet is proving that cycles turn — the platform is ripe for innovation and just when you think you know what is going on you get blindsided by the Notificator.

Note:    Gerry Campbell wrote a piece yesterday about the evolution of search and ways to thread social inference into  search.    Very much worth a read — the chart below, from Gerry’s piece, is useful as a construct to outline the opportunity.

gerry-campbell-emerging-search-landscape1

Disclosure.   I am CEO of betaworks.    betaworks is a Twitter shareholder.  We are also a Tweetdeck shareholder.  betaworks companies are listed on our web site.

  • Rajug

    I don't agree with you. Its not the way it is said here.

  • Arps

    How come this is possible. I am little confused.

  • Sya

    Google is such a social & useful site that its minor mistakes can be ignored.

    • http://unilinkinc.com/craden.php Craden

      It will definitely be a long long time before someone can take down google as the no 1 search engine..

  • http://www.cosmeticdentistryguide.co.uk/dentists/surrey-cosmetic-dentist.html cosmetic dentists surrey

    First up — where do they launch it, Google.com or now.Google.com? Given that now web navigational experience is different to Google.com the answer would seem to be now.google.com. Ok — so move number one — they need to launch a new search offering lets call it now.google.com. Where does the data come from for now.google.com?

    Thanks and Regards

  • http://www.reviewhostgator.org gator hosting

    Today I use a product called Tweetdeck (note disclosure below) — it offers a simple UX where you can monitor multiple searches — real time — in unison. This reformulation of search as navigation is, I think, a step into a very new and different future. Google.com has suddenly become the source for pages — not conversations, not the real time web. What comes next?

  • dentalimplants

    great post , really good perspective on the subject and very well written, this certainly has put a spin on my day, many thanks from the UK and keep up the good work

  • http://www.freehotpennystocks.com Penny Stocks

    Ten months later Twitter is still the dominant, open, now web data stream. See the Google trend data below – Twitter is lapping its competition, even the sub category “Twitter Search” is trending way beyond the other services. (Note: I am using Google trends here because I think they provide the best proxy for inbound attention to the real time microbloggging networks.

  • http://www.acnetreatmentsite.com goldsmith011

    What I know is just……Google is the best search Engine. I use Google only, if I have to search for something.

    Acne/Teeth Whitening/
    Teeth Whitening

  • goergepennystockinvestor

    “Hello,
    The Picks that you have provided is really good I shall keep a track of them. Thanks for the article. Visit: http://www.hypergrowthstock.com

    Cheers
    Goerge”

  • annarose27

    Well seriously speaking of a best search engine then there is no comparison of google…it rocks as always…and whenever I have to search anything I don't think of anything else rather than Google…Its the best search engine avalable…my views.Stretch Marks
    Teeth Whitening
    Acai Berry
    Acne
    Stretch Marks
    Acne
    Teeth Whitening
    Teeth Cleaning

  • Kesia757

    Till know whenever I think for searching something I always prefer to search in google.Because it always provide us relevant information.
    Cellulite
    Acai berry
    Acai berry

  • stockexplosion

    A good penny stock pick can generate 500% and even more in a very short time frame. It is much easier for penny stocks to appreciate than blue chip stocks. However, picking such penny stock should not be without due understanding of their fundamental technical strength.

    LET
    Penny Stocks

  • therock23

    Ya its true that most search engines are loosing their popularity gradually. Any ways very nice post. Thanks……..
    Cellulite|Cellulite | Cellulite Treatment|Acai Berry| Acai Berry

  • walkerregis

    I always prefer to search in google.Because it always provide us relevant information.
    Resveratrol | Teeth whitening | Colon Cleanse | Acai | Acai Berries | Acai Berry | Acai Berry

  • freemmorpgs2

    Yeah but nah man.

  • Anonymous

    Whatever happen, Google will never face this condition. Because for Google, there is no comparison!
    Colon Cleanse
    Colon Cleanse
    Colon Cleanser

  • http://www.acerlaptops.info Acer Vijay

    In web new technologies erase the older technologies and its cyclical
    Acer laptops
    Iphone

  • Anonymous

    I love Google… I search each & every thing on it. It gives wonderful results. I guess its the best search engine.
    Extenze | Resveratrol | Teeth whitening | Colon Cleanse | Acai Berries | Acai | Acai Berry Diet | Colon Cleanse | | Extenze

  • Pingback: Microsoft, Google, and Twitter… Oh My! « Tourism Today()

  • http://www.kids-water-shoes-online.com kids water shoes

    John…I absolutely love reading your articles! Keep up the good work and look forward to more.

    Kim 🙂

  • robertsteve12

    Google won't be affected in any of the cases..So it should not worry..
    Stretch Marks Removal|Stretch Marks|Acai Berry
    colon cleanse reviews

  • goldberg23

    Ya I admit that today most popular search engines are loosing their popularity because of coming in to existence of new search engines like Aol , Bing etc. So What is the right solution to gaining back the same popularity as before.

    Cellulite|Cellulite |Cellulite

  • http://ezinearticles.com/?expert_bio=Des_Drec DesiD

    You make some interesting points here. AOL was dead in the water when they tried to take over everyone’s computer by planting stupid software on there that just p*ss*d everybody off!

    http://ezinearticles.com/?expert_bio=Des_Drec

  • Pingback: Hopping on the Big Data bandwagon « Pakman’s Blog: Disruption()

  • yoruba

    well it seems google is intent on killing of all its competitors anyone remember Lycos 🙂

  • nirvana14888

    According to me google trends is the best free tool to check the traffic of the market. I just love these tools by google. They are really very helpful.

  • understood123

    I have a lot of faith in Abdur. I think he's one of the smartest people I know, and he'll find a way to make Twitter search more useful. I hope it is his priority right now.i use it casually to follow topics and events. i think the search feeds are infinitely more useful than than just dropping in to search google style, and the more i use twitter the less useful i find google.

  • acaiberrytime

    It will be interesting to see how things like this affect Google in the future of search engines.

    • coolsmith

      Google is still the first choice of common men to search anything.

      • provillus_reviews

        I don't personally think Twitter is any good for much, I think the drop in numbers of people using it are a sign that it is not what people really want. Google is still the leader and will be hard to topple

  • Pingback: THINK / Musings» Blog Archive » charting the real time web OR the curious tale of how TechCrunch traffic inexplicably fell off a cliff in December()

  • Pingback: THINK / Musings» Blog Archive » Ongoing tracking of the real time web …()

  • janisa121

    The intent is different when someone posts on Twitter vs. searching on Google.

  • laurarobert23

    Ya its right that AOL was a disruptive company by its nature.

    • Anonymous

      I think google is simply the GOOGLE. It is the big.

  • Pingback: Why is Google Afraid of Facebook?Because Social Networking Could Soon Pass Search - 25 Popular Blogs - Popular Bloggers.com()

  • Cadrian757

    Great post.keep posting us this type of wonderful information.We always look forward towards your post.

  • http://www.itampon.org/ Apple iPad Forum

    wait, theres an actual robot that can do this? Thats pretty crazy. The webcrawlers are getting crazier as time goes by.

  • messigreat29

    I don’t know much about this. I am new in this field. You have done a great job.Thanks

  • andriana125

    after reading this post i came to know better that how google works and i found my interest in such articles .. keep updating to know more about the same.

  • http://www.titidirectonline.co.uk/ski-snowboard-goggles skiing goggles

    great stuff

  • http://www.freemicrosoftpointsnow.com/ Free Microsoft Points

    I am not intelligent or eloquent enough to comment on the Twitter/Google aspect, but the macro issue of creative destruction is absolutely on point. In fact, it will accelerate at a much more rapid pace, especially in the next 18-24 months. Too many talented people will be forced/unleashed to make careers in smaller/start-up entities. And working with a slew of Fortune 500 companies, it is painfully apparent that innovation nimbleness more resembles Gheroghe Muresan than Kobe Bryant. Companies across a span of sectors will suffer, especially those who lag operational speed (biggest obstacle to many now web solutions, imo)

  • http://www.titidirectonline.co.uk/mobile-phones dual sim phone

    great post

  • http://www.titidirectonline.co.uk/mobile-phone-watches watch mobile

    nice post

    • Anonymous

      I really like it

  • http://www.mimogames.com/ Mimo

    Things like Twitter and URl shorteners are weakening the web. Where is the direct, real sustainable content?

  • janntuchol

    Thanks a lot for the valuable information provided. We will look forward in more content like this.

  • totalhealth

    Creative destruction … Google slayed by the Notificator?
    Great! Really very informative article.

    But i am thinking about “Vark”. What is this?

  • totalhealth

    “Creative destruction” Very interesting title and very informative article.
    But i am thinking about “Vark”
    Whats that?

  • http://www.clubpenguingang.com Club Penguin Cheats

    i use it professionally to monitor my brand, my field, and the cloud's thoughts on subjects relevant to my expertise. i use it casually to follow topics and events. i think the search feeds are infinitely more useful than than just dropping in to search google style, and the more i use twitter the less useful i find google.

  • lizymag2365

    I don’t know much about this. I am new in this field. But according to me you have done a great job. Thanks

  • http://purelyfitness.com/colon-cleanse-how-colon-cleansing-helped-me-lose-weight-and-gain-confidence janyrobert

    Google has its own place.How can it happen with google?

  • http://purelyfitness.com/acai-berry-how-losing-30-pounds-in-30-days-is-possible-with-acai Acai Berry

    I was surfing net and fortunately came across this site and found very interesting stuff here. Its really fun to read. I enjoyed a lot. Thanks for sharing this wonderful information.

  • http://purelyfitness.com/acai-berry-how-losing-30-pounds-in-30-days-is-possible-with-acai Acai Berry

    I was surfing net and fortunately came across this site and found very interesting stuff here. Its really fun to read. I enjoyed a lot. Thanks for sharing this wonderful information.Acai Berry
    Acai Berry