Max's Output

Towards Stream Personalization Powered by Twitter

with 22 comments

Now streams have become the main source of information for many of us. Streams are central concepts in most momentous applications such as Twitter, FriendFeed, Facebook. News and blogs are also consumed as streams. Streams become so important that they even replaces search engines as a starting point of Web browsing – now a typical Web session consists in reading Twitter and Google Reader streams and following links found in these streams instead of starting with Web search. Streams are amazing because they make us involved and connected but they quickly cause information overload. You know that there should be something interesting but you cannot read it all to find that. In this post I consider how modern personalization systems address information overload problem and how it can be done in a new more social way by harnessing public micro-blogging streams such as Twitter, FriendFeed, etc.

Current practice of dealing with streams is common for all applications. The user subscribes to sources (such as news or blog feeds) or followees (e.g. in Twitter, FriendFeed) and read the stream made up of posts from the sources/followees. The problem with this approach is that there is always a compromise with the number of sources/followees that the user would like to read and the amount of information he/she is able to consume. I am sure that many of you know this problem. Even if you subscribe to, say, 30 blogs you cannot even look though all of the posts especially if there are some “top” blogs that usually issue up to 20 posts in a day. As the result you get hundreds of unread posts in just one week.

The solution to this problem is a personalized stream that contains only a moderate number of posts that are potentially interesting for the user. It sounds good but stream personalization systems do not reach wide adoption. I think that the problem of the systems is not poor algorithms they utilize but wrong assumptions they are based on. Modern personalization systems assume that the user has already formed his interests. So the system tries to identify user’s interests and then use this information to bring relevant posts via content match or collaborative filtering. The idea of building a system around user’s interests seems wrong. First of all I am sure that majority of people don’t have any formed interests. People read streams to know significant news, to identify new trends or just want to have fun. It explains why voting/commenting social news sites (e.g. Digg, Reddit) which rank news by absolute popularity without any personalization are quite popular. Even if the user has some concrete interests, posts about these interests usually make up small fraction of the user’s whole media consumption. For example, I am currently interested in semantic search because we are working on such system. But news on semantic search are quite rare and anyway I would not like to read only about semantic search stuff every day. So focusing on user’s interests is very limiting. Systems which utilize collaborative filtering try to go beyond immediate user’s interests and recommend posts that are read by other people who has similar interests. But it is not useful also as it often recommends very diverse topics and it is more about research of what people interested in particular topic also read then about what might be interesting for me. Besides being limited modern personalization systems fail to explain why they recommend this or that post to the user. It is because content match and collaborative filtering are based on statistical aggregation the result of which is hard to explain. The user have to do non-trivial interpretation and maybe even additional research to understand what recommended posts are about while the system does not provide any evidence why the user should do the effort.

So user’s interests are fluid, diverse and hard to grasp. Trying to build something around user’s interests in automatic way is in vain. To become successful personalization systems should rethink their fundamental assumption. I think that personalization system should stop trying to capture user’s interests and focus on what inspires them. The causes of user’s interests are easy to list. People usually find something interesting and worth reading in two main cases. First, it is something that is very popular, widely discussed and lead to universal resonance – trending topics. Note that it might be absolutely unrelated to the user’s interests. For example, swine flu does not touch me at all but I might be interested to know that it happens not to look like a fool among my friends who are well-informed about current global issues. Second, it is something that is inspired by people that the user knows and respects – what is hot in the user’s community. It is more likely to match immediate user’s interests but not necessarily because the user would usually like to know about all important events in his/her community. This new approach to personalization is more social than that based on user’s interests and social approaches prove to be effective for many tasks. Another advantage of the approach is that it allows explaining to the user why we recommend this post and the user should spend his/her time reading it. We need just say that too many people have posted links to it (in case of global trending topic) or that one or more influential people from the user’s community have posted/liked it.

Several years ago we cannot build a personalized user stream based on these considerations. Now, thinks to recent development and high popularity of public micro-blogging systems, we can collect enough information to identify global and in-community trending topics. Public micro-blogging systems can be used as a ranking system to identify significant posts for personalized streams. Global trending topics are already identified by a number of services (e.g. which analyze Twitter, etc. Let me describe how I see it could work for in-community trending topics. The user’s community is defined by a list of favorite sources that the user is subscribed to or regularly visits (e.g. user’s favorite blogs, news sites and his/her friend’s feeds) and a list of followees on services like Twitter or FriendFeed. As I already mentioned above many of us cannot even look through all the posts from these sources and followees but would like not to miss important news, ideas, etc. The user’s personalized stream should include significant posts from the favorite sources and the most posted/retweeted/favorite’ed/liked links to articles/pages/posts among the user’s followees. The significant posts from the favorite sources can be identified as follows. Select those post from a source which global popularity (i.e. among all users of Twitter/FriendFeed, not only user’s followees) are greater than the average for all posts of this source. It means to select all posts from a source which causes some resonance and skip the others. As concerns the most posted/etc links among followees, they represent significant in-community trending topics. They can include links to posts from the favorite sources (for such links followees contribute to their global popularity, maybe with greater weight) or links to other sources that help to introduce the user to something new. You can find some technical details on how we identify significant posts in Twitter here.

Written by maxgrinev

May 17, 2009 at 9:26 am

Posted in Uncategorized

22 Responses

Subscribe to comments with RSS.

  1. I always use microblogs nowadays because it is so cool. ,

    My favorite blog page

    Santo Crissler

    November 6, 2012 at 7:25 pm

  2. Thank you a lot for providing individuals with a very wonderful opportunity to discover
    important secrets from here. It’s always very cool plus packed with a lot of fun for me personally and my office colleagues to visit your web site no less than thrice per week to see the new tips you will have. Not to mention, we are actually astounded with all the extraordinary ideas you give. Selected 2 facts in this posting are ultimately the finest I’ve ever had.

    Ohne vertrag

    June 14, 2013 at 12:16 pm

  3. Magnificent goods from you, man. I’ve understand your stuff
    previous to and you’re just extremely magnificent. I actually like what you have acquired
    here, certainly like what you are stating and the way in
    which you say it. You make it enjoyable and you still take care of to keep it sensible.
    I can’t wait to read far more from you. This is really a terrific site.

    carros usados

    April 9, 2014 at 3:23 am

  4. I truly love your website.. Very nice colors & theme. Did you make this amazing site yourself?
    Please reply back as I’m planning to create my own website
    and would love to find out where you got this
    from or what the theme is called. Thanks!

  5. My partner and I absolutely love your blog and find almost
    all of your post’s to be just what I’m looking for. Would you offer guest writers to write content available for you?

    I wouldn’t mind publishing a post or elaborating on a few of the subjects you write related to here.
    Again, awesome blog!

  6. I’m impressed, I have to admit. Seldom do I encounter a blog
    that’s equally educative and interesting, and without a doubt,
    you’ve hit the nail on the head. The issue is something
    not enough people are speaking intelligently about. Now i’m very
    happy that I came across this in my search for something relating to this.

  7. My enjoyment boosts in my holiday seasons due to the fact I know that I will appreciate with my curiosity.
    When a movie recreation takes around, for the unconscious section of the thoughts it is as actual as real can be.
    You can engage in with good friends or with entire strangers.

    Addicting Games

    June 21, 2014 at 12:20 pm

  8. Because the admin of this website is working, no question very quickly it
    will be renowned, due to its feature contents.

    ask fm Hack

    August 8, 2014 at 7:07 am

  9. This is really attention-grabbing, You’re an overly professional blogger.
    I’ve joined your feed and look forward to seeking more of your magnificent post.

    Also, I have shared your web site in my social networks

    Car Town Hack

    August 15, 2014 at 11:48 pm

  10. Hey there outstanding blog! Does running a blog like this require a great deal of work?

    I’ve absolutely no understanding of coding but I was hoping to start my own blog in the near future.
    Anyways, if you have any ideas or techniques for new blog owners please share.
    I know this is off topic but I simply had to ask. Appreciate it!

    UberStrike Hack

    August 20, 2014 at 4:17 am

  11. Wonderful items from you, man. I have understand
    your stuff previous to and you’re just too fantastic.

    I actually like what you’ve got here, really
    like what you’re saying and the best way wherein you
    are saying it. You are making it entertaining and you continue to take care of to keep it sensible.
    I cant wait to learn far more from you. This is really a terrific
    web site.

    quotes about depression

    August 29, 2014 at 1:49 pm

  12. wonderful put up, very informative. I’m wondering why the other specialists of this sector don’t notice this.

    You must continue your writing. I am sure, you have a huge readers’ base already!

  13. Thanks for any other informative blog. The place else may just I am
    getting that kind of information written in such an ideal means?
    I’ve a mission that I’m just now operating on, and I’ve been at the look out for such info.

    Drag Racing Hack

    August 31, 2014 at 6:54 am

  14. Nice post. I was checking constantly this blog and I am impressed!
    Extremely useful information particularly the last part :
    ) I care for such info a lot. I was seeking this certain information for a very long time.

    Thank you and best of luck.

    baju batik modern

    September 6, 2014 at 10:21 pm

  15. If some one wjshes to be updated with most up-to-date technologies
    after that he must be visit this web site and be
    up to date daily.

    centennial college

    September 13, 2014 at 1:32 pm

  16. What i don’t understood is actually how you’re now not really much more well-liked than you might
    be now. You’re so intelligent. You already know therefore significantly with regards
    to this subject, produced me in my view believe it from a lot of various angles.
    Its like women and men don’t seem to be involved unless it’s one thing to do
    with Woman gaga! Your own stuffs great. At all times deal with it up!

    valen damper

    September 20, 2014 at 2:20 pm

  17. I am genuinely delighted to glance at this blog posts which contains plenty of useful facts, thanks for providing such information.


    September 21, 2014 at 8:04 am

  18. It’s truly very difficult in this active life to listen news on TV,
    so I simply use internet for that reason, and get
    the most up-to-date information.

    October 3, 2014 at 9:39 am

  19. I get pleasure from, lead to I discovered just what I was having a look for.
    You have ended my four day lengthy hunt! God Bless you man. Have
    a nice day. Bye

  20. Given the lack of easily available and perhaps suitably not disgusting human hair,
    the wigs were often made of horse or goat hair, and they were hot.

    party wigs sheffield

    January 1, 2015 at 9:12 am

  21. Environmental consulting and environmental services:
    . IT consultancy is a service provided by IT providers that offer help and advice on what type of program and IT support an enterprise or
    corporation might need. A: I think PR is already more than press relations.

  22. Appreciate this blog poost


    September 26, 2022 at 2:20 pm

Leave a Reply to Cancel reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: