The thoughts of a web 2.0 research fellow on all things in the technological sphere that capture his interest.

Wednesday 22 April 2009

I Hate My Job: The Web is Just a Jumbled Mess!

At the moment I am investigating the linking between 1337 environmental technology web sites. Of the 1337 sites, 751 nodes create one large network:

You spend days sorting a list of URLs, collecting data, finding errors, starting again...and at the end you just have a big ball of string.

A webometrician's job is to draw conclusions from such a jumbled mess: I hate my job.

Labels: ,

posted by David at

7 Comments:

Anonymous Anonymous said...

Hi,

Are you able to let us know how you do this? Looks very interesting. Is the source code available?

Thanks! Dave.

22 April 2009 at 10:55

 
Blogger David said...

This diagram is based on data available through the Yahoo API using combinations of link, linkdomain, and site commands. I'm currently using the LexiURL software (http://lexiurl.wlv.ac.uk/), but it is not particularly difficult to write yourself.

Due to the large number of sites included in this particular study a new feature had to be added to LexiURL which isn't included in the released version yet. The released version allows network diagrams to be created by searching for links between each pair of sites in a URL list (which for 1,000 sites would be almost a million queries), the new version just collects the inlinks for a set of URLs then works out if the inlinking sites were the URLs you were interested in.

I'm not the author of the LexiURL software, that's the head of the group he adds the features I need. Unfortunately the source code is not available (probably because of his shameful programming abilities).

22 April 2009 at 11:24

 
Anonymous ugg for cheap said...

The natural properties of wool will wick moisture away to ensure dry and cozy feet. Wool fleece helps maintain body temperature, making UGG? Australia footwear appropriate for all climates. In fact, the wool will keep your feet warm down to -30°F and cool up to 80°F.
Click to see our sizing chart.

23 June 2010 at 04:15

 
Anonymous ugg shoes sale said...

Manolo Blahnik, Betsey Johnson, Reem Acra, Giuseppe Zanotti, Rebecca Minkoff, LaROK, Pamella Roland, Stuart Weitzman, and many other top designers and luxury fashion brands came together and put their artistic skills to work for UGG? Australia's seventh annual Art & Sole Auction. Designers used their creativity to make one-of-a-kind UGG Boots. The uniquely decorated boots were auctioned off on www.uggaustralia.com December 1st - 14th with 100% of the proceeds benefiting St. Jude Children's Research Hospital?, one of the world's premier centers for the research and treatment of pediatric cancer and other catastrophic childhood diseases. This year's dedicated fans help support a great cause by bidding as high as $2,750 for Rafe New York, totaling $26,500 for the 14 day auction. UGG? Australia is matching what was raised in the auction and adding in all proceeds from the brand's sample sale. The total donation is $73,000 for the children of St. Jude.
Details

23 June 2010 at 04:27

 
Anonymous paul smth shirt said...

paul smith goods sale on line

23 June 2010 at 04:55

 
Anonymous uggs outlet said...

Ugg boots outlet
Uggs outlet
Ugg outlet

17 August 2010 at 04:54

 
Anonymous luggages handbag said...

Thanks for the valuable information. This backpack can be used for school, travel or play. A backpack that is great for.
luggages

5 January 2011 at 11:46

 

Post a Comment

Subscribe to Post Comments [Atom]

<< Home