This page is no longer maintained — Please continue to the home page at

Graham Tackley, The Guardian

Graham Tackley, the Web Platform Development Team Lead for, explained, slides here, at Eurocon 2010 how they represent their complex 350 table relational database model in Solr for the media storage and used Scala to meet the demanding real-time content searching, indexing or updating. Using actors for example, he explains how they were able to reduce the search index build time from 20 hours to just one. Request patterns, he says, are hard to predict so the ability to easily scale the services was essential. His presentation slides contain more detail on the system architecture and you can find Grahams impressions of Scala on his blog.

The developers can create client facing "MicroApps" using Google App Engine. This give the developers a way to create new, highly scalable applications that interface via the Open Platform API to the Guardian repository.

More information on Open Platform can be found on the Guardian Open Platform blog and a slide presentation here.

Copyright © 2012 École Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland