The thoughts of a web 2.0 research fellow on all things in the technological sphere that capture his interest.

Sunday, 31 August 2008

Twittering with Python ...on the web

Programming is really addictive, especially when you are bad at it. Whilst the proficient programmer can deal with their problems in a matter of minutes, bad programmers can spend hours on the simplest of problems. Today I decided to start messing about with some server-side programming for the first time; now I find myself wondering what happened to my Sunday.

This particular form allows anyone to post to your Twitter account (and then displays the comments that have already been posted):

Enter Comment:

Now all I need to do is think of a use for anonymous twittering....

The code:
>import cgi
>import urllib
>print "Content-type: text/html\n\n"
>data = urllib.urlencode({"status" : form["status"].value})
>res = urllib.urlopen(""
, data)
>lines = urllib.urlopen('')
>for line in lines:
>>>if line.find('title') <>-1:
>>>>>>print line

Labels: , ,

posted by David at | 1 Comments

Saturday, 30 August 2008

Remembering the Olympics: BBC thrashed NBC!

Whilst the Olympics seems AGES ago now, I've only just come across some of streaming figures for the BBC and NBC:
NBC - 75.5 million streams
BBC - 40 million streams
Obviously comparisons are never simple, with different time zones likely to effect the choice of the Internet over the TV, but as the USA has five times the population of the UK 75.5 million streams doesn't look very impressive.

It seems likely that London 2012 will make these figures seem ridiculously small. Hopefully the BBC will be offering more than just the 6 streams (it's amazing that there was still so much that I wanted to see and couldn't), and live mobile streams will be readily available.

UPDATE (11/09/08): Whilst I thought the BBC's 40 million streams thrashed NBC, as the BBC is actually claiming 50 million streams, I guess the BBC thrashed NBC then delicately placed a cherry on top.

Labels: , ,

posted by David at | 2 Comments

Friday, 29 August 2008

Maplin's Minibook

I remember a time when being seen in public with my Eee PC 701 would always get people asking questions, these days they are seemingly everywhere. A stroll into Dixons (or whatever my local branch is called these days) at lunchtime found four different mini-notebooks available. The one that really caught my eye, however, was the one in Maplin's:

Whilst it isn't the most powerful of the mini-notebooks, or the most aesthetically pleasing, with a 7inch screen you can't argue with the weight: 0.65kg!! That makes the 0.922kg of the Eee PC 701 look decidedly over-weight, whilst the Eee 901 will barely be able to hold its head up in public at 1.14kg.

Maybe I need Maplin's minibook for those days when I am feeling too lazy to carry my 701...or should I just hold out for the one that comes with a helium filled balloon?

I am also slightly surprised at the claim on the 'minibook' trademark, after all, wasn't the Eee PC 701 first launched in the UK as the RM minibook?

Labels: , ,

posted by David at | 2 Comments

Thursday, 28 August 2008

Internet Explorer 8 - Beta 2

Almost 6 months after the first beta was launched, today saw the launch of Internet Explorer 8 - beta 2. With a new privacy mode - widely labelled 'porn mode' by the newspapers - it has managed to get more irrational responses than you would expect from the launch of a new browser:

Sick just another way to allow married men to access porn without the wife finding out, bet this and other sites are the reason courts have seen previously very secure 15 year plus marriages hit the rocks when wives dont live up to a sexed-up husband's hard core porn expectations.
- Dee, Hampshire, England, 28/8/2008 18:39

I can see this "improvement" being very popular with paedophiles. Transfer all their pics to private online photo browsers, and no need for them to be worried about having their computers seized by the police when this is released.
Mike, London, England

Who knows why people get over-excited at 'publishing' their angry/ignorant comments on the big public sites, but it reminds me that there was a great post in the Guardian a couple of weeks ago about it: What about are rights?


posted by David at | 0 Comments

Blogroll is dead; long live customizable Reddit

Back in November I complained about the static nature of most blogrolls. I then changed my own blogroll, and to my knowledge never changed it again (despite the best of intentions). As such the Read Write Web's post on the customizable nature of Reddit has spurred me into action, and I have now created a Webometrics Reddit for those stories/pages I find interesting.

Whilst I have called it 'Webometrics', in the same way that my blog covers whatever I fancy writing about on a particular day, it will highlight anything I find of interest, with the 'hottest' five stories shown in the sidebar of my blog. The reddit has been left open, so if you want to submit a link feel fact I would encourage it.


posted by David at | 0 Comments

Email is dead; long live ....

I have always enjoyed checking to see if I have any post. Whilst it is usually a bill, the offer of a credit card, or the promotion of Sky TV, there is always the chance that it could be something far more interesting and exotic (such as the free book of stamps I received last week). When the Royal Mail's did away with the second-post, I overcame the loss by checking my emails more often. Now, however, I find that my email is increasingly unreliable.

My email problems started back in March when Hotmail started only selectively sending my emails. Whilst this was seemingly a glitch with Hotmail, as a opposed to a problem with email as a communication medium, the seeds of doubt were sown. Since then my university has installed an email filtering system to deal with spam. Not a selective filtering system that is applied to those people who have a problem with spam, but across the board!

I now find that unless I spend twice as long constructing an email, e.g., filling it with excess text and making sure there are no mentions of banks or money (as a general rule my emails rarely mention viagra anyway), only half of my Hotmail emails reach their university destination without being quarantined for a few hours first. In addition a number of emails sent from university addresses to me are mysteriously disappearing. Yes, I could do away with my Hotmail account and use my university account, but that does not seem to be a practical solution. Most people (especially students) have one account that they already check regularly when they arrive at a university, forcing them to check another email address will merely mean communications sent to that email address are left for days or weeks on end before being retrieved.

Whilst I'm sure that some IT departments are more selective when they roll out spam guards, unless you are aware of the exact filtering systems in place at the email's destination, you can never be sure whether your email has reached it's destination or not. As such email, in its current state, is as good as dead. Unfortunately there doesn't seem to be anything capable of replacing it, but if someone does come up with a solution there will be a lot of money to be made.

Labels: ,

posted by David at | 0 Comments

Thursday, 21 August 2008

Iterasi: Create your own archive!

The UK's web archive is pretty rubbish, therefore Iterasi (highlighted by TechCrunch) is a great addition to the web.

Rather than merely bookmarking a URL, you can archive the actual page, and can continue archiving the page on a regular basis if you so wish. The only downsides to the site are that it only allows you to archive on a daily basis (for the front pages of news sites you may want to archive more regularly), and it only archives when your computer, with its list of scheduled saves, is turned on.

The potential for webometric studies is obvious, it would seem as though even the most technologically incompetent of us can now simply collect longitudinal data. For example, Google searches may be collected on a daily basis to see how the results or the number of hits changes...and once you have archived a page, it's very simple to then embed the page:

It also has potential for bloggers; when they discuss a page or story bloggers can now be sure that their readers will have access to the page that they saw rather than an updated version. How content providers will react to the archiving of their content is yet to be seen.

Labels: , , ,

posted by David at | 0 Comments

Tuesday, 19 August 2008

A week of Asking not Googling

In response to Google's continued growth in the search engine market, last week I decided to attempt to give up Google Search. For the last week my search engine of choice has been Ask:

Whilst I have regularly used different search engines over the years, a fundamental shift came in my searching behaviour in about 2000. Pre-2000 there was no single search engine that dominated my search activities, I went all over the place: HotBot, Yahoo, Lycos, AltaVista. I even Asked Jeeves on occasion. Since 2000, however, Google has dominated my life, with only occasional visits to those few search engines that continue have their own index. Trying to break eight years of Google dominated search has a number of difficulties.
Habit - You don't have to think about typing in Google, you fingers seemingly hit the keys before you have even decided what you want to search for; this is not an easy habit to break. I quickly remember, however, as soon as I have typed GOOGLE, or after I have typed in my search terms, that I am trying to give up Google Search, and force myself to go to Ask and type in the queries again (however tempting the Google results may look). I think Google is a habit that can be broken, but it isn't easy.
Trust - After using Google for eight years, I find that I trust them to do their job as a search engine. Whilst I understand the limitations of any single search engine (i.e., that Google's search engine is not exhaustive, and that other search engines will have different pages indexed), tens of thousands of queries have taught me what to expect from the Google index. When I don't get the results I need from Google I make a judgement as to whether I need to try somewhere else or adjust my search terms; if I don't find what I want on Ask my first reaction is to question the quality of the search engine. Trust is something that can only come with time.
The Google Package - Google now offers more than just web search: blogs, emails, news, image search, blog search, scholar. No other search engine provides such a variety of products that are of the same quality (the UK version of Ask News is currently rubbish); you can't help but return to a certain extent. Vigilance is constantly necessary if we are to stop falling back into our old Google habits.
The Gold Standard - Despite trying to break away from Google search, I still care how it ranks my pages. Most people use Google. Most of my traffic comes from Google. It means more to have a high Google rank than a high Ask rank, and you can't help but check.

Whilst it was always going to be difficult to move away from Google, Ask's search compares favourably, you just have to make an effort to break the Google habit, and give Ask enough time to build up a level of trust. For all Google's growth, there are two things I prefer about Ask: The Skins (the polka dot background always cheers me up); and the URL is 3 keystrokes shorter. How many man hours would have been saved if Google had called themselves Goo?

Labels: , ,

posted by David at | 1 Comments

Friday, 15 August 2008

OfCom: The Communication Market 2008

You can't help but love the annual Communications Market Report from the Office of Coomunications; it provides massive amounts of detail and information on the UK's communication market. As with last year's document, it is a rather large document (365 pages), so not for the faint hearted. Luckily, however, the BBC have published a nice summary with the most interesting graphs.

My favourite graph is the "Time Spent Using Communications Services", it's interesting to see how your own usage compares to others:

Personally I was shocked at how low internet usage the moment, due to the Olympic coverage, I tend to be online for a couple of hours before I even get out of bed! Closer inspection of the OfCom document finds that the 24 mins does not include time spent watching streaming media, which partially explains the low number of internet minutes. My personal graph would look some thing like this (for personal/non-work use):

Whilst it seems as though there are not enough hours in the day, the portability of laptops like the Eee PC means that we can always be online. It is a rare occasion when I am watching the TV without the internet, whilst I only really listen to the radio when cooking the dinner. My fixed phone usage is zero due to the phone line still not being connected by Virgin!

I thought that the most surprising finding was the continued rise of SMS use (up 28% on last year). Personally I think it must be close to a peak now; with an increasing number of mobile internet applications becoming available, such as Nokia Chat and other instant messaging services.

Labels: , ,

posted by David at | 0 Comments

Thursday, 14 August 2008

Happy Blog-iversary!!

Today is the one year anniversary of my Webometric Thoughts blog! Unfortunately, despite having a Google anniversary logo commissioned especially for the event (way back in January), Google have decided to give preference to another Olympic logo today instead.

Over the last year I have managed to blog fairly regularly (this is my 286th post), and this has been reflected in a steady increase in traffic. Since I started using Google Analytics in October I have had 15,484 absolute unique visitors:

Most importantly, the number of unique visitors can be seen to be increasing month on month. This increase can also be seen in my Alexa ranking:

When checking my Alexa ranking back in September my ranking was 8,926,204, whilst in January it was 3,816,072. Whilst Alexa changed its ranking algorithm in April, today's results show an improvement on the 1,607,649 I got then. Even Technorati shows an improvement, as I am now in the top half a million blogs!

So, what are the aims of Webometric Thoughts over the next year:
-Break into the top 100,000 web sites (according to Alexa)
-Break into the top 100,000 blogs (according to Technorati)
-Make the blog self-financing (since starting to use Google Ads in March I have earned $14.05...I need to earn approximately $50 a year).
-And, obviously, write higher quality posts.

Labels: , , , , ,

posted by David at | 0 Comments

Tuesday, 12 August 2008

London 2012 v. Olympics 2012

Another story from Hitwise that got me thinking was their post on search terms to do with the Olympics. However, being British, I am more interested in how the Beijing Olympics are effecting interest in the London Olympics (i.e., the important Olympics). Therefore I had a look at what Google's Insights for Search could show (nb. Google's Insights for Search does not contravene my current Google Search cold turkey).

red line - olympics 2012
blue line - london 2012

Whilst there has been an understandable rise in interest in the 2012 Olympics, it would seem as though the world isn't associating it with London as much. Whilst 'london' was popular when the city was first awarded the Olympics ('F' on the graph), and when they launched their unpopular logo ('C' on the graph), it has seemingly failed in catching the current wave of Olympic fever. In 2008, only the UK and Ireland are searching for 'london 2012' more than 'olympics 2012'. Time for a brand push Mr Coe?

Labels: ,

posted by David at | 0 Comments

Giving up Google

Whilst the Olympics has been drawing my attention away from the world of technology, one Hitwise finding did catch my attention: Google's share of US search hits 70%.

Whilst I have often lamented at the state of the search engine market, specifically the Google monopoly, like most other users I have made no effort to change my behaviour. However, as the Google machine marches forward, and another landmark is passed, we realise that unless we do start changing our behaviour we could end up in a world where Google is the only search engine. Or even the only powerful online presence.

Google has spread throughout my online activities, far beyond the initial search:
-I blog with Blogger.
-I track my web site's use with Google Analytics.
-My blog contains AdSense Ads.
-I keep notes in Google Docs.
-I find articles with Google Scholar.

As there is only so long I can comfort myself with the fact I managed to resist using Google's RSS reader (nb. Newsgator is brilliant), I have decided to stop using the Google Search Engine. Giving up Google Search requires the least initial effort, although will probably require greater effort in total; I often find myself typing '' without even thinking. The only way will be to give up Google Search 'cold turkey'.

Most of us use Google Search out of habit these days, rather than there being any real difference in the quality of the results; the competitive advantage of PageRank has long since been caught up. Hopefully new search engines will give me a whole new perspective on the web.


posted by David at | 2 Comments

Thursday, 7 August 2008

YooWalk: Another Virtual World

Mashable have posted about another virtual world this morning, YooWalk, a browser-based virtual world for browsing the web.

It is more appropriate to compare YooWalk with Google's Lively than Second Life. Both have limited freedom in terms of what can be created, although the embeddding and linking to content makes YooWalk much more than another Lively chatroom.

Important key differences between YooWalk and Lively are:
-YooWalk users can embed their own pictures and videos.
-YooWalk does not require a plugin (it works on my Linux Eee 701 as well as my Windows desktop).

At the moment the site is still very much in Beta mode. Designing your room is a bit clunky, and when my activation email went MIA there seemed to be no recourse other than using a different email account. Nonetheless, a welcome addition to the burgeoning web based virtual worlds.

Labels: ,

posted by David at | 0 Comments

Wednesday, 6 August 2008

Google Insights for Search: What next?

In addition to Google Trends, Google are now offering Google Insights for Search ( TechCrunch). Not only can you filter the terms by category, for example helping to distinguish between Apple (Computers & Electronics) and apple (Food & Drink), but it will also give a nice visual representation of the geographic data.

We can now quickly see that the Iran is the country most interested in webometrics:

The maps also offer a whole new type of vanity searching. The "David Stuart" brand has yet to make major inroads in Africa, Asia or South America. I was grateful, however, to find that my own vanity searches had not overly effected the results (at a city level London is the hub rather than Wolverhampton).

Some bloke called Barack Obama, on the other hand, seems to have made inroads all over, with the exception of the Middle East.

The obvious question, based on the directory structure of the Insights for Search URL (, is what other insight services are Google going to offer? Insights for Maps? Insights for Shopping? Insights for News?

Labels: , , ,

posted by David at | 0 Comments

Webometricians are NOT Web Celebrities!!

When it comes to being a web celebrity, it is not surprising to find that webometricians are near the bottom of the pile; a fact I blame on our spending too much time counting other people's links rather than creating content worth linking to. Anyway, Wired have created a nifty little application (highlighted by Media Futurist) that can help you determine your 'web celebrity' score by using data from Google's Social Graph.

At the moment it only bases your score on MySpace, Twitter, and your blog/web site, so your score depends a lot on how much you use these sites; my thousands of Facebook friends and hundreds of delcious bookmark followers mean nothing. Nonetheless, true to Webometric Thoughts fashion, a comparison of the three main webometrics blogs/bloggers(only using their twitter and blog addresses):

Holmberg's Oh what a tangled web we weave... :
2 (twitter) + 4 (blog) = 6
Thelwall's Webometrics Blog :
10 (twitter) + 15 (blog) = 25
My Webometric Thoughts:
6 (twitter) + 7 (blog) = 13

To give these numbers a bit of perspective, Barack Obama's current ranking is 9,069 (4,509 without MySpace). Thelwall may have won this battle, but we are all losing the war. It would be interesting to see, however, how the Celebrity Meter compares with a qualitative evaluation of web celebrity, such asForbes' list of the top 25 web celebrities.

Whilst 'web celebrity' is just a bit of fun, it does show the potential of the Google Social Graph data, and as far as I am aware no webometrician has used it to any practical purpose yet.

Labels: , ,

posted by David at | 2 Comments

Monday, 4 August 2008

Six Degrees of Seperation: Prince William to Osama Bin Laden

As all the news sources are reporting Microsoft's exploration of Milgram's theory that we are on average only 6 degrees away from anyone else in the world (BBC, Guardian), it seems a good time to share my personal favourite six degrees of seperation (which is far better than the Daily Mail's examples): Prince William to Osama Bin Laden going through my own student house in Loughborough.

Whilst from the outside it may have looked like just another student terrace house, visitors included a classmate of Prince William's at St. Andrews University and a Finnish girl (or was she Swedish??) who was the nanny to one of Osama Bin Laden's brothers.

Microsoft found that 78% of messenger users could be connected in seven links or fewer. To me this suggests that six degrees is on the high side; most people have many more acquaintances than they message.

Labels: ,

posted by David at | 0 Comments