Distribution … now

In February 1948, Communist leader Klement Gottwald stepped out on the balcony of a Baroque palace in Prague to address hundreds of thousands of his fellow citizens packed into Old Town Square. It was a crucial moment in Czech history – a fateful moment of the kind that occurs once or twice in a millennium.

Gottwald was flanked by his comrades, with Clementis standing next to him. There were snow flurries, it was cold, and Gottwald was bareheaded. The solicitous Clementis took off his own fur cap and set it on Gottwald’s head.

The Party propaganda section put out hundreds of thousands of copies of a photograph of that balcony with Gottwald, a fur cap on his head and comrades at his side, speaking to the nation. On that balcony the history of Communist Czechoslovakia was born. Every child knew the photograph from posters, schoolbooks, and museums.

Four years later Clementis was charged with treason and hanged. The propaganda section immediately airbrushed him out of history, and obviously, out of all the photographs as well. Ever since, Gottwald has stood on that balcony alone. Where Clementis once stood, there is only bare palace wall. All that remains of Clementis is the cap on Gottwald’s head.

Book of Laughter and Forgetting, Milan Kundera

The rise of social distribution networks

Over the past year there has been a rapid shift in social distribution online.    I believe this evolution represents an important change in how people find and use things online. At betaworks I am seeing some of our companies get 15-20% of daily traffic via social distribution — and the percentage is growing.    This post outlines some of the aspects of this shift that I think are most interesting.   The post itself is somewhat of a collage of media and thinking.

Distribution is one of the oldest parts of the media business.    Content is assumed to be king so long as you control the distribution flow to that content. From newspapers to NewsCorp companies have understand this model well.   Yet this model has never suited the Internet very well.     From the closed network ISP’s to Netcenter.   Pathfinder to Active desktop, Excite Lycos, Pointcast to the Network computer.   From attempts to differentially price bits to preset bookmarks on your browser — these are all attempts at gate keeping attention and navigation online.    Yet the relative flatness of the internet and its hyperlinked structure has offered people the ability to route around these toll gates.   Rather than client software or access the nexus of distribution became search.    Today there seems to be a new distribution model that is emerging.   One that is based on people’s ability to publically syndicate and distribute messages — aka content — in an open manner.    This has been a part of the internet since day one — yet now its emerging in a different form — its not pages, its streams, its social and so its syndication.    The tools serve to produce, consume, amplify and filter the stream.     In the spirit of this new wave of Now Media here is a collage of data about this shift.

Dimensions of the now web and how is it different?

Start with this constant, real time, flowing stream of data getting published, republished, annotated and co-opt’d across a myriad of sites and tools.    The social component is complex — consider where its happening.    The facile view is to say its Twitter, Facebook, Tumblr or FriendFeed — pick your favorite service.    But its much more than that because all these sites are, to varying degrees, becoming open and distributed. Its blogs, media storage sites (ie: twitpic) comment boards or moderation tools (ie: disqus) — a whole site can emerge around an issue — become relevant for week and then resubmerge into the morass of the data stream, even publishers are jumping in, only this week the Times pushed out the Times Wire.    The now web — or real time web — is still very much under construction but we are back in the dark room trying to understand the dimensions and contours of something new, or even to how to map and outline its borders. Its exciting stuff.

Think streams …

First and foremost what emerges out of this is a new metaphor — think streams vs. pages.     This seems like an abstract difference but I think its very important.    Metaphors help us shape and structure our perspective, they serve as a foundation for how we map and what patterns we observe in the world.     In the initial design of the web reading and writing (editing) were given equal consideration – yet for fifteen years the primary metaphor of the web has been pages and reading.     The metaphors we used to circumscribe this possibility set were mostly drawn from books and architecture (pages, browser, sites etc.).    Most of these metaphors were static and one way.     The steam metaphor is fundamentally different.  Its dynamic, it doesnt live very well within a page and still very much evolving.    Figuring out where the stream metaphor came from is hard — my sense is that it emerged out of RSS.    RSS introduced us to the concept of the web data as a stream — RSS itself became part of the delivery infrastructure but the metaphor it introduced us to is becoming an important part of our eveyday day lives.

A stream.   A real time, flowing, dynamic stream of  information — that we as users and participants can dip in and out of and whether we participate in them or simply observe we are are a part of this flow.     Stowe Boyd talks about this as the web as flow: “the first glimmers of a web that isnt about pages and browsers” (see this video interview,  view section 6 –> 7.50 mins in).       This world of flow, of streams, contains a very different possibility set to the world of pages.   Among other things it changes how we perceive needs.  Overload isnt a problem anymore since we have no choice but to acknowledge that we cant wade through all this information.   This isnt an inbox we have to empty,  or a page we have to get to the bottom of — its a flow of data that we can dip into at will but we cant attempt to gain an all encompassing view of it.     Dave Winer put it this way in a conversation over lunch about a year ago.    He said “think about Twitter as a rope of information — at the outset you assume you can hold on to the rope.  That you can read all the posts, handle all the replies and use Twitter as a communications tool, similar to IM — then at some point, as the number of people you follow and follow you rises — your hands begin to burn. You realize you cant hold the rope you need to just let go and observe the rope”.      Over at Facebook Zuckerberg started by framing the flow of user data as a news feed — a direct reference to RSS — but more recently he shifted to talk about it as a stream: “… a continuous stream of information that delivers a deeper understanding for everyone participating in it. As this happens, people will no longer come to Facebook to consume a particular piece or type of content, but to consume and participate in the stream itself.”    I have to finish up this section on the stream metaphor with a quote from Steve Gillmor.    He is talking about a new version of Friendfeed, but more generally he is talking about real time streams.     The content and the language — this stuff is stirring souls.

We’re seeing a new Beatles emerging in this new morning of creativity, a series of devices and software constructs that empower us with both the personal meaning of our lives and the intuitive combinations of serendipity and found material and the sturdiness that only rigorous practice brings. The ideas and sculpture, the rendering of this supple brine, we’ll stand in awe of it as it is polished to a sparkling sheen. (full article here)

Now, Now, Now

The real time aspect of these streams is essential.  At betaworks we are big believers in real time as a disruptive force — it’s an important aspect of many of our companies — it’s why we invested a lot of money into making bit.ly real time.  I remember when Jack Dorsey first saw bit.ly’s  plus or info page (the page you get to by putting a “+” at the end of any bit.ly URL) —  he said this is “great but it updates on 30 min cycles, you need to make it real time”.   This was August of ’08 — I registered the thought, but also thought he was nuts.    Here we sit in the spring of ’09 and we invested months in making bit.ly real time —  it works, and it matters.   Jack was right — its what people want to see the effects on how a meme is are spreading — real time.   It makes sense — watching a 30 min delay on a stream — is somewhere between weird and useless.   You can see an example of the real time bit.ly traffic flow to an URL  here. Another betaworks company, Someecards, is getting 20% of daily traffic from Twitter.   One of the founders Brook Lundy said the following “real time is now vital to what do.    Take the swine flu — within minutes of the news that a pandemic level 5 had been declared — we had an ecard out on Twitter”.    Sardonic, ironic, edgy ecards — who would have thought they would go real time.    Instead of me waxing on about real time let me pass the baton over to Om — he summarizes the shift as well as one could:

  1. “The web is transitioning from mere interactivity to a more dynamic, real-time web where read-write functions are heading towards balanced synchronicity. The real-time web, as I have argued in the past, is the next logical step in the Internet’s evolution. (read)
  2. The complete disaggregation of the web in parallel with the slow decline of the destination web. (read)
  3. More and more people are publishing more and more “social objects” and sharing them online. That data deluge is creating a new kind of search opportunity. (read)”

Only connect …

The social aspects of this real time stream are clearly a core and emerging property.   Real time gives this ambient stream a degree of connectedness that other online media types haven’t.  Presence, chat, IRC and instant messaging all gave us glimmers of what was to come but the “one to one” nature of IM meant that we could never truly experience its social value.    It was thrilling to know someone else was on the network at the same time as you — and very useful to be able to message them but it was one to one.    Similarly IRC and chats rooms were open to one to many and many to many communications but they usually weren’t public.   And in instances that they were public the tools to moderate and manage the network of interactions were missing or crude.   In contrast the connectedness or density of real time social interactions emerging today is astounding — as the examples in the collage above illustrate.    Yet its early days.    There are a host of interesting questions on the social front.    One of the most interesting is, I think, how willthe different activity streams intersect and combine / recombine or will they simple compete with one another?      The two dominant, semi-public, activity streams today are Facebook and Twitter.    It is easy to think about them as similar and bound for head on competition — yet the structure of these two networks is fairly different.    Whether its possible or desirable to combine these streams is an emerging question — I suspect the answer is that over time they will merge but its worth thinking about the differences when thinking about ways to bring them together.      The key difference I observe between them are:

#1. Friending on Facebook is symmetrical — on Twitter it’s asymmetrical.    On Facebook if I follow you, you need to follow me, not so on Twitter, on Twitter I can follow you and you can never notice or care.   Similarly, I can unfollow you and again you may never notice or care.   This is an important difference.   When I ran Fotolog I observed the dynamics associated with an asymmetrical friend network — it is, I think, a closer approximation of the way human beings manage social relationships.    And I wonder the extent to which the Facebook sysmetrical friend network was / is product of the audience for which Facebook was intially created (students).   When I was a student I was happy to have a symmetrical social network, today not so much.

#2. The data on Facebook is assumed to be mostly private, or shared within private groups, Facebook itself has been mostly closed to the open web — and Facebook asserts a level of ownership over the data that passes through its network.   In contrast the data on Twitter is assumed to be public and Twitter asserts very few rights over the underlying data.    These are broad statements — worth unpacking a bit.    Facebook has been called a walled garden — there are real advantages to a walled garden — AOL certainly benefited from been closed to the web for a long long time.   Yet the by product of a closed system is that (a) data is not accessible or searchable by the web in general –ie: you need to be inside the garden to navigate it  (b) it assumes that the pace innovation inside the garden will match or exceed the rate of innovation outside of the garden and (c) the assertion of rights over the content within the garden means you have to mediate access and rights if and when those assets flow out of the garden.   Twitter takes a different approach.     The core of Twitter is a simple transport for the flow of data — the media associated with the post is not placed inline — so Twitter doesnt need to assert rights over it.    Example — if I post a picture within Facebook, Facebook asserts ownership rights over that picture, they can reuse that picture as they see fit.    If i leave Facebook they still have rights to use the image I posted.    In contrast if I post a picture within Twitter the picture is hosted on which ever service I decided to use.   What appears in Twitter is a simple link to that image.   I as the creator of that image can decide whether I want those rights to be broad or narrow.

#3. Defined use case vs. open use case.    Facebook is a fantastically well designed set of work-flows or use cases.   I arrive on the site and it present me with a myriad of possible paths I can follow to find people, share and post items and receive /measure associated feedback. Yet the paths are defined for the users.   If Facebook  is the well organized, pre planned town Twitter is more like new urban-ism — its organic and the paths are formed by the users.    Twitter is dead simple and the associated work-flows aren’t defined, I can devise them for myself (@replies, RT, hashtags all arose out of user behavior rather than a predefined UI.   At Fotolog we had a similar set of emergent, user driven features.  ie:  groups formed organically and then over time the company integrated the now defined work-flow into the system).    There are people who will swear Twitter is a communications platform, like email or IM — other say its micro-blogging — others say its broadcast — and the answer is that its all of the above and more.   Its work flows are open available to be defined by users and developers alike.   Form and content are separated in way that makes work-flows, or use cases open to interpretation and needs.

As I write this post Facebook is rapidly re-inventing itself on all three of the dimensions above.    It is changing at a pace that is remarkable for a company with its size membership.     I think its changing because Facebook have understood that they cant attempt to control the stream — they need to turn themselves inside out and become part of the web stream.   The next couple of years are going to be pretty interesting.       Maybe E.M. Forrester had it nailed in Howard’s End:  Only connect! That was the whole of her sermon  … Live in fragments no longer.

The streams are open and distributed and context is vital

The streams of data that constitute this now web are open, distributed, often appropriated, sometimes filtered, sometimes curated but often raw.     The streams make up a composite view of communications and media — one that is almost collage like (see composite media and wholes vs. centers).     To varying degrees the streams are open to search / navigation tools and its very often long, long tail stuff.  Let me run out some data as an example.     I pulled a day of bit.ly data — all the bit.ly links that were clicked on May 6th.      The 50 most popular links  generated only 4.4% (647,538) of the total number of clicks.    The top 10 URL’s were responsible for half (2%) of those 647,538 clicks.  50% of the total clicks (14m) went to links that received  48 clicks or less.   A full 37% of the links that day received only 1 click.   This is a very very long and flat tail — its more like a pancake.   I see this as a very healthy data set that is emerging.

Weeding out context out of this stream of data is vital.     Today context is provided mostly via social interactions and gestures.    People send out a message — with some context in the message itself and then the network picks up from there.   The message is often re-tweeted, favorite’d,  liked or re-blogged, its appropriated usually with attribution to creator or the source message — sometimes its categorized with a tag of some form and then curation occurs around that tag — and all this time, around it spins picking up velocity and more context as it swirls.    Over time  tools will emerge to provide real context to these pile up’s.   Semantic extraction services like Calais, Freebase, Zemanta, Glue, kynetx and Twine will offer a windows of context into the stream — as will better trending and search tools.      I believe search gets redefined in this world, as it collides with navigation– I blogged at length on the subject last winter.   And filtering  becomes a critical part of this puzzle.   Friendfeed is doing fascinating things with filters — allowing you to navigate and search in ways that a year ago could never have been imagined.

Think chunk
Traffic isnt distributed evenly in this new world.      All of a sudden crowds can show up on your site.     This breaks with the stream metaphor a little — its easy to think of flows in the stream as steady — but you have to think in bursts — this is where words like swarms become appropriate.    Some data to illustrate this shift.   The charts below are tracking the number of users simultaneously on a site.    The site is a political blog.    You can see on the left that the daily traffic flows are fairly predictable — peaking around 40-60 users on the site on an average day, peaks are around mid day.    Weekends are slow  — the chart is tracking Monday to Monday, from them wednesday seems to be the strongest day of the week — at least it was last week.   But then take a look at the chart on the right — tracking the same data for the last 30 days.   You can see that on four occasions over the last 30 days all of a sudden the traffic was more than 10x the norm.   Digging into these spikes — they were either driven by a pile up on Twitter, Facebook, Digg or a feature on one of the blog aggregation sites.    What do you do when out of no where 1000 people show up on your site?

CB traffic minnesotaindependent.com

The other week I was sitting in NY on 14th street and 9th Avenue with a colleague talking about this stuff.   We were accross the street from the Apple store and it struck me that there was a perfect example of a service that was setup to respond to chunky traffic.     If 5,000 people show up at an Apple store in the next 10 minutes — they know what to do.   It may not be perfect but they manage the flow of people in and out of the store, start a line outside, bring people standing outside water as they wait. maybe take names so people can leave and come back.   I’ve experienced all of the above while waiting in line at that store.   Apple has figured out how to manage swarms like a museum or public event would.    Most businesses and web sites have no idea how to do this.    Traffic in the other iterations of the web was more or less smooth but the future isnt smooth — its chunky.    So what to do when a burst takes place?   I have no real idea whats going to emerge here but cursory thoughts include making sure the author is present to manage comments etc., build in a dynamic mechanism to alert the crowd to other related items?    Beyond that its not clear to me but I think its a question that will be answered — since users are asking it.    Where we are starting at betaworks is making sure the tools are in place to at least find out if a swarm has shown up on your site.    The example above was tracked using Chartbeat — a service we developed.    We dont know what to do yet — but we do know that the first step is making sure you actually know that the tree fell — real time.

Where is Clementis’s hat? Where is the history?

I love that quote from Kundera.    The activity streams that are emerging online are all these shards — these ambient shards of people’s lives.    How do we map these shards to form and retain a sense of history?     Like the hat objects exist and ebb and flow with or without context.    The burden to construct and make sense of all of this information flow is placed, today, mostly on people.    In contrast to an authoritarian state eliminating history — today history is disappearing given a deluge of flow, a lack of tools to navigate and provide context about the past.    The cacophony of the crowd erases the past and affirms the present.   It started with search and now its accelerated with the now web.    I dont know where it leads but I almost want a remember button — like the like or favorite.   Something that registers  something as a memory — as an salient fact that I for one can draw out of the stream at a later time.   Its strangely compforting to know everything is out there but with little sense of priority of ability to find it it becomes like a mythical library — its there but we cant access it.


This media is unfinished, it evolves, it doesnt get finished or completed.    Take the two quotes below — both from Brian Eno, but fifteen years apart — they outline some of the boundaries of this aspect of the stream.

In a blinding flash of inspiration, the other day I realized that “interactive” anything is the wrong word. Interactive makes you imagine people sitting with their hands on controls, some kind of gamelike thing. The right word is “unfinished.” Think of cultural products, or art works, or the people who use them even, as being unfinished. Permanently unfinished. We come from a cultural heritage that says things have a “nature,” and that this nature is fixed and describable. We find more and more that this idea is insupportable – the “nature” of something is not by any means singular, and depends on where and when you find it, and what you want it for. The functional identity of things is a product of our interaction with them. And our own identities are products of our interaction with everything else. Now a lot of cultures far more “primitive” than ours take this entirely for granted – surely it is the whole basis of animism that the universe is a living, changing, changeable place. Does this make clearer why I welcome that African thing? It’s not nostalgia or admiration of the exotic – it’s saying, Here is a bundle of ideas that we would do well to learn from.  (Eno, Wired interview, 1995)

In an age of digital perfectability, it takes quite a lot of courage to say, “Leave it alone” and, if you do decide to make changes, [it takes] quite a lot of judgment to know at which point you stop. A lot of technology offers you the chance to make everything completely, wonderfully perfect, and thus to take out whatever residue of human life there was in the work to start with. It would be as though someone approached Cezanne and said, “You know, if you used Photoshop you could get rid of all those annoying brush marks and just have really nice, flat color surfaces.” It’s a misunderstanding to think that the traces of human activity — brushstrokes, tuning drift, arrhythmia — are not part of the work. They are the fundamental texture of the work, the fine grain of it. (Eno, Wired interview, 2008)

The media, these messages, stream — is clearly unfinished and constantly evolving as this post will likely also evolve as we learn more about the now web and the emerging social distribution networks.

Gottwald minus Clementis

Addendum, some new links

First — thank you to Alley Insider for re-posting the essay, and to TechCrunch and GigaOm for extending the discussion.    This piece at its heart is all about re-syndication and appropriation – as Om said “its all very meta to see this happen to the essay itself”.     There is also an article that I read after posting from Nova Spivack that I should have read in advance — he digs deep into the metaphor of the web as a stream.    And Fred Wilson and I did a session at the social media bootcamp last week where he talked about shifts in distribution dynamics — he outlines his thoughts about the emerging social stack here.   I do wish there was an easy way to thread all the comments from these different sites into the discussion here — the fragmentation is frustrating, the tools need to get smarter and make it easier to collate comments.

  • http://lmframework.com David Semeria

    Yup. I think streams will become de-localized and a lot more structured, with embedded metadata, permissions and (optional) usage tolls: http://lmframework.com/page.php?id=vision

  • http://avc.blogs.com fredwilson

    oh man, you've written way more than a blog post here John

    this is a treatise and an investment strategy and a mantra all in one

    the question you ask near the end “waht do you do when people swarm” is the same question i asked you when you showed me chartbeat, “this is awesome, but what do i do with this information”

    i invested in disqus for a bunch of reasons, but the main one was the email me the comments to my blackberry feature. when the swarm hits, you want to engage with it and the tethered to the computer model just doesn't work for that

    the one thing that you really didn't weave into this is the role of mobile.

    twitter's shortcode is the most used shortcode in the US. that's a telling piece of data.

    this real time stream is with us all the time, and it would not happen without mobility

    • http://blog.daryn.net daryn

      “twitter's shortcode is the most used shortcode in the US. that's a telling piece of data.” — Wow, this is a very surprising (and interesting) fact. Is shortcode traffic data publicly available? I'm curious what that tail looks like.

      John – really excellent post. I need to read it a few more times and digest. Thanks!

      • http://avc.blogs.com fredwilson

        i heard it second or third hand daryn. i'd love to see the data confirming or not confirming it.

      • http://www.concave.com markslater

        this is good.

        Shortcodes are mobile command line interfaces to the next wave of RT social apps.

        opentable for instance should shortcode. Restaurants, viewing their bookings can present '2 hour specials' that get agregated and bullhorned. i can type 'on' top SC XXXXX at 6pm and receive a list of my 6 favorites offering immediate incentives…. I can complete my rezzi and have it dynamically shares across my other activity streams and so on…..

        the one piece missing is auditable geolocation.

        there are way to many use cases with SCs and RT – many of them will become very large businesses.

    • Johnborthwick

      Thank you Fred. We are gradually working to figure out the pieces here — mobile is a key piece to the puzzle. Devices shouldnt be considered as separate or distinct from sites — its all data and its becomes more tightly woven, in more interesting ways. Didnt know data on Twitter's short code — Fascinating times.

      I also realized that the prezi thing got disabled this am, its back now — adds a little more data to the post. As an aside — I’m loving prezi — I think the zoom metaphor it uses (think Google earth for data) is a part of this puzzle, I want to be able to zoom in and out of these data streams. See what we did on betaworks.com 🙂

      • http://www.floridaventureblog.com/ danrua

        nice prezi. most of those datapoints involved the shift from google search traffic to facebook/twitter discovery traffic. have you seen similar data on discovery vs. search, but at a higher level — comparing goog search referrals to social media discovery referrals (including blogs, microblogs, social networks, RSS)? I've got to believe the shift to discovery stream referrals is even larger than represented by tw/fb alone.

      • http://avc.blogs.com fredwilson

        the prezi thing was not working this morning. i just looked at it. such a cool way to present things. i wish i could have used that yesterday in my talk at google.

        but how do you cut and paste stuff out of prezi? i wanted to share one of those on tumblr?

  • http://www.floridaventureblog.com/ danrua

    Great post John.

    Chartbeat reminds me of another, possibly larger flow in streams I've been investigating: implicit data/feeds. Most streams today are explicitly created by users, either by creating content, making a friend, saving a favorite etc. For every explicit action of a user, there are probably 100+ implicit datapoints from usage; whether that is a page visit, a scroll, a video/shopping abandon etc. I also believe such implicit data is less skewed by the digerati that creates a significant chunk of today's explicit dataset — providing a more accurate view of online likes/dislikes/activities.

    Therefore, I applaud your work on Chartbeat and encourage you to turn that data inside out by connecting with cross-site implicit datapoints. That becomes less about site/page-specific webmaster analytics, and more about surfer/user (anonymous or not, depending upon user choice) implicit activity feeds flowing into a larger stream…keep me posted if u go that route.

    • Johnborthwick

      The implicit data point is a really good one. The bit.ly team are storing all this data on each link that is sent through the system — click data (on the + page), entity data (from calais and other semantic extraction tools), location data etc. etc. I just asked Nate and the hash specific data is approx 20 gig and then there is approx 200 gig of metrics data (real time and roll up's). There is a lot of implicit value here.

  • http://www.coovents.com theschnaz

    Interesting post. Traffic as “chunks” was most illuminating for me.

    @fredwilson, I think your comment is spot-on for the author of a blog. When the swarm hits, the author can respond.

    What about the readers or the people leaving the comments? I found this post from a passed link, so there has to be other people reading as I'm typing. It took me a few mins to read the entire post. From the time I arrived to the time I made it to the comments section, did someone else comment? Can I chat with people who are on this page too? Can real-time conversations spontaneously breakout in a post's comment section?

    This is just the beginning, it's very exciting.

    (I refreshed the page to check, 3 new comments.)

    • Johnborthwick

      Agree — there are people here right now and figuring out how to interact with them in a meaningful way, other than comment boards, is a good question. It's also recursively fun — given that the post is partially about this very question. An illustration of this — real time — see the alert below I just got from Chartbeat that brought me back to the post.

      We did try live chat — bubble chat on the page (firef.ly) — but the interactions were thin and fleeting, it was more game like than a forum for conversation — and many people dont actually want to chat.

      ——– what i just got in email ———-

      A chartbeat alert has been triggered. The alert is:

      total visitors on any goes above monthly max.

      The domains that were triggered are:

      borthwick.com — total visitors: 157

      • http://www.coovents.com theschnaz

        I see what you mean. I want to chat with others while they're on the page, but in a structured non-chatroom way. Without going overboard, the easiest way to describe this is real time disqus. If I'm on a page I can see new comments as they appear in real time. If I respond, others see my comments too. This side steps the chat room issue.

  • Pingback: Borthwick – Distribution Now « The Web Is Alive()

  • dpakman

    As always, really enjoyed your thoughts and exploration, John.

    A few thoughts come to mind:
    – We should tip our hats to Amazon Web Services (and burstable cloud infrastructure) which is what allows sites built for 40 visitors to suddenly accommodate a swarm. The architecture underneath our communities has quietly evolved to allow exactly this phenomena even before social media created the digital social pathways to create the swarms themselves.
    – I agree that a “bookmark” or “remember” button for the RT web is needed. Right now we have a binary digital history: the present and the saved (i.e., the way back machine). But just saving the nugget won't be enough to re-create the stream at that moment! Won't what came before it, what inspired it, who commented on it, your responses to them, and what came after it — isn't that really what you want to remember? Can we ever “bookmark” the stream? I don't think we will be able. We'll pull nuggets out, but the totality of the moment will have moved on.

    I am inspired by how much is unclear about the RT future.

    • Johnborthwick

      DP — Agree on AWS — the platfrom has help drive much of the stream related innovation. On bookmarks not sure if you want to bookmark a stream, rather flag items within a stream

  • http://www.dogster.com Ted Rheingold

    Wow. Bravo.

    Couple thoughts:

    * I think posts (the element behind RSS) would be the first stream. Even on webpage you'd read them as separate but consecutive. But that would be preceded by forums, chat rooms, IRC and mail lists, so maybe I'll leave that up to those that take these things to the mat to decide 😉

    * I think we're seeing 2 distinct types of stream users. Those that want to hold the rope and those that watch it go by when they look at it. For lots of people twitter or facebook or flickr doesn't provide enough meaning if they follow too much. FriendFeed seems to be very binary, people love it or don't use, but rarely use just now and then.

    * Asynchronous connections are much more (adult) human like. Thanks for that insight.

    * You just made me think handheld computers have really blow the doors off the page-based paradigm and
    that we're a lot closer to an always-on Internet experience then is generally believed 😉

    Thanks for the deep thoughts.

  • http://www.dogster.com Ted Rheingold

    Wow. Bravo.

    Couple thoughts:

    * I think posts (the element behind RSS) would be the first stream. Even on webpage you'd read them as separate but consecutive. But that would be preceded by forums, chat rooms, IRC and mail lists, so maybe I'll leave that up to those that take these things to the mat to decide 😉

    * I think we're seeing 2 distinct types of stream users. Those that want to hold the rope and those that watch it go by when they look at it. For lots of people twitter or facebook or flickr doesn't provide enough meaning if they follow too much. FriendFeed seems to be very binary, people love it or don't use, but rarely use just now and then.

    * Asynchronous connections are much more (adult) human like. Thanks for that insight.

    * You just made me think handheld computers have really blow the doors off the page-based paradigm and
    that we're a lot closer to an always-on Internet experience then is generally believed 😉

    Thanks for the deep thoughts.

    • Johnborthwick

      Its interesting that the primary attribute of broadband was not speed (as expected) but always on.

  • http://feeds.fluidinfo.com/fluidinfo terrycojones

    When we get our Alpha out (coming soon, I promise), I will give you a remember button. A useful one.

    Thanks for writing all those thoughts up. I have too many comments to comment, but you know I agree with much/all of this, and……. well, you know.

  • http://www.eqentia.com William Mougayar

    Brilliant articulation of where this is going: the web and our web-lives are being re-configured. What gets passed is more important than what gets printed. But we’ll need to occasionally freeze-frame the stream within a given context to allow us to process and digest.

    I think an exciting part will be the merging of the social+now+context/structured web (using your terms) together via a “personal API” or semantic lens of sorts, and allowing us to manipulate that knowledge to gain greater insights.

  • Pingback: so there’s a stream, and good quotes, but what to fish for | Pitch Capital()

  • Pingback: Jump Into The Stream()

  • Pingback: Mash123 » Jump Into The Stream()

  • Pingback: Jump Into The Stream | The Good NET Guide()

  • Pingback: Jump Into The Stream | Viningmedia Nieuws()

  • Pingback: Real Time Streams - Opinionated()

  • rdlove

    Thanks for the insightful thoughts; it's encouraging to find someone who thinks like me (occasional summaries on important subjects that run consistently through our daily life). I'm excited to see how society adjusts to these changes as well as to find out what “infrastructure” will be made to help the human mind process them!

  • http://www.marketdrums.com Rutger

    I agree filtering is and will be key. Not only do I want to be able to filter on importance but also on the channel I receive the information in.

  • Pingback: Jump Into The Stream | UpOff.com()

  • Pingback: Techhours » Jump Into The Stream()

  • Pingback: Social Distribution « Raja Jasti’s Blog - Renaissance Thinking()

  • Pingback: Tech Whiz Underground » Jump Into The Stream()

  • http://www.giannii.com Giannii

    test #giannii

  • Pingback: The Far Edge » Blog Archive » Jump Into The Stream()

  • Pingback: Thoughts Before The Real-time Web — rikin on the web()

  • Pingback: La vie en Stream()

  • Pingback: Webは「静的ページ」から「リアルタイムストリーム」に変貌, 飛び込んで流れを加速せよ()

  • Pingback: Quickthink » Blog Archive » One Paradigm Shift Please()

  • Pingback: Jump Into The Stream | netdesk()

  • ericrumsey

    >> Figuring out where the stream metaphor came from is hard<<

    Salman Rushdie saw it coming, in 1990 — The Stream of Stories that he envisions is : “made up of a thousand thousand thousand and one different currents, each one a different color, weaving in and out of one another like a liquid tapestry of breathtaking complexity.” Sounds like he's talking about the story we'll all living every day on the Web (Stream?).

    • Johnborthwick

      Interesting. Others have suggested Gelernter and Freeman ie: Lifestreams — or @ericrumsey (below) suggested Rushdie (http://bit.ly/l2RMp).

  • Pingback: All this has happened before…()

  • Pingback: All Streams Flow | Zenbe Blog()

  • http://www.davidsanger.com David Sanger

    >>Figuring out where the stream metaphor came from is hard <<

    The image that always comes to mind for me is the Dow Jones Stock Ticker

    People used to watch it like hawks, looking for the next uptick or downtick, the pulse of the financial nation.

    And in the back room traders were feeding it their messages.

    • Johnborthwick

      Interesting. Others have suggested Gelernter and Freeman ie: Lifestreams — or @ericrumsey (below) suggested Rushdie (http://bit.ly/l2RMp).

    • http://www.lacostepoloshirts.co lacoste polo

      It’s important to have these facts clear in order to realize what can be done and where can we go.

  • http://www.davidsanger.com David Sanger

    John – I'd like to see better integration of the OS and the “stuff” I remember. Real time of course. and accessible on my different devices.

    • folders on my desktop for people, websites, posts, comments, photos and feeds I like? realtime, clickable not static.

    • drag and drop so I can use all these in messaging, posting, commenting and tagging?

    • why should I ever have to type <a href= or use the link-chain-thingy? again drag/grab and drop from desktop to WP, email?

    • real time means these are always current, synched (like Plaxo) and the real data is stored who knows where.

  • Pingback: Michael Romanowicz: Digital Creativity & Experience Design()

  • http://www.sexywidget.com lawrence

    Hi John, as I read through this for the fourth time, I think this is the post of the year. There have been so many hints of what you describe over the past few years, and so many factors working in support – mobile computing, cross domain login, embed code, non programmers doing programmer things, facebook / twitter / friendfeed, the newsfeed / river format, real identity associated with UGC, API culture – but like you, for the first time, I'm starting to feel it come together on a web wide basis. Exciting!

    • billV23

      I agree that is very exciting to think about, even if it is a little bit hard to grasp. Being able to wrap your mind around it with the whole picture remaining clear is the trick. I'm going to have to read through it a few more times myself. free money for bills?

  • marianasoffer

    I loved the second quote of Eno, I think I can also relate it to the idea that the media shapes the message (or becomes) which McLuhlan started talking about.

    A Kundera quote, dealing with time acceleration:
    -Why has the pleasure of slowness disappeared? Ah, where have they gone, the amblers of yesteryear? Where have they gone, those loafing heroes of folk song, those vagabonds who roam from one mill to another and bed down under the stars? Have they vanished along with footpaths, with grasslands and clearings, with nature? There is a Czech proverb that describes their easy indolence by a metaphor: 'they are gazing at God's windows.' A person gazing at God's windows is not bored; he is happy. In our world, indolence has turned into having nothing to do, which is a completely different thing: a person with nothing to do is frustrated, bored, is constantly searching for an activity he lacks.(kundera)

    Interesting comparison about both kind of streams. It's important to have these facts clear in order to realize what can be done and where can we go.

    About Swarms:
    Traffic is not smooth is has spikes, like swarms, they move in spikes when something happens given the high speed at which the information
    is transmitted between its members, spikes are produced by a relevant fact or a mere fake rumor which spreads through the communication channels reaching individuals at an exponential rate of Grouth.
    check out my post about streams: singyourownlullaby.blogspot.com

  • Pingback: Streams: Layers and Data | Leveraging Ideas()

  • Pingback: Paid Content : The Inside Word: On the Web, 'Streams' Are Replacing 'Pages'—Why We Should Care()

  • Pingback: The Spring Partners » Make your content and advertising usable to join the conversation()

  • Pingback: Mauro Lupi's blog()

  • Pingback: El Oso » Archive » Cloud Intelligence()

  • Pingback: Streams, the Now Web and ContextVoice « ContextVoice : Social comments API()

  • Pingback: From New York to Nicosia » Blog Archive » Real-time()

  • Pingback: Lehrblogger :: Filtration as a Tonic for Internet Vertigo()

  • Pingback: What’s Interesting about the “Now Web”()

  • Pingback: Lehrblogger :: The Stream-Packet Duality of Content()

  • Pingback: Gabriel Rossi - Branding (Portuguese)» Blog Archive » Fashion Branding na Internet (Brasil)()

  • http://www.bradfordsbakers.com Hampers

    An insight worthy to be read not only once but more than twice. Indeed this hitech “distribution” scheme is going to the point of no longer bothering if the following is true or just a passing note. The absence of “truthful feelings” sometimes can no longer be felt. As what the twittering is all about…we are not 100% sure if our “friends” or followers really are following us…who cares? Hmmm…I'll just do what I think is better for me and for the others – no matter what the circumstances are.

  • http://modestadventurer.com Traveller_Adventure

    What I can say is very nice and helpful as well as informative post…really help me very much more!! Thanks..
    Buat Duit Dengan Blog