New System for Analyzing Information on WikiLeaks, Social Media

Posted: January 7, 2011 in Uncategorized


This is a hugely significant development that probably not one person in a thousand who reads this article on Science Daily really appreciates.

In the hands of investigative journalists, this could be truly revolutionary, because it could enable them to do in minutes what heretofore it has taken them months and years.  Indeed, it could vastly reduce the costs of investigative journalism and take it out of the province of deep-pocketed corporate journalism quietly pursuing corporate agendas, and place it in the hands of truth and sunshine-obsessed bloggers. It could greatly leverage the information-transparency afforded us by the Internet. Hooray for that!

Turned into an application running on a home PC or in the network cloud but accessible to a PC via the Internet, this could make large-scale data-mining, previously the province of the National Security Agency, a simple, easy task anyone could do.  And in the process, combined with a more honest WikiLeaks and other, similar leak sites, it could be hugely important for forcing openness and accountability in government.  The George Bushes and Dick Cheneys of the world would have nowhere to hide.



New System for Analyzing Information on WikiLeaks, Social Media

ScienceDaily (Jan. 3, 2011) — The Data Management Group of the Universitat Politècnica de Catalunya (DAMA-UPC) has designed a system for exploring information on networks or graphs that can complement internet search engines and is of particular interest in areas related to social media, the internet, biomedicine, fraud detection, education and advanced bibliographic searches.

According to Josep Lluís Larriba, director of DAMA-UPC, the technology can be used to extract information from WikiLeaks from two perspectives: one, to obtain generic indicators that provide information on whether the data network has the features of a social network and whether communities of data are created that can provide relevant information; and two, to use the documents hosted on the website to analyze how a topic evolves over time, how a person or a group relates to different topics and how the documents themselves interrelate.

High-speed complex queries

The new DEX technology patented by the UPC can be used to explore large volumes of networked data. The system offers high-speed processing, configurable data entry from multiple sources, and the management of networks with billions of nodes and connections from a desktop PC.

Users can quickly and easily identify interrelated records by formulating queries based on simple values such as names and keywords. Until now, this was possible to a certain extent using database technology, but DEX extracts new information from interrelated data and improves the speed and the capacity to perform complex queries in large data networks.


Leave a Reply

Please log in using one of these methods to post your comment: Logo

You are commenting using your account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s