Distributed Thinking

I started a new job at the beginning of the month. I'm no longer working at the National e-Science Centre and that means that I won't be involved with Grid Computing Now! . I was granted a day from my new job to host the webinar on cloud computing with Ross Cooney, but that was my last commitment for GCN!. It's been almost 6 years since I joined NeSC and it was about this time 4 years ago that we were writing the proposal for the Knowledge Transfer Network that became GCN!. Looking back, I the experience has taught me a lot as we evolved the KTN to be most effective. It took a lot of effort to get ourselves recognised - to "build the brand" in marketing speak - and I think the work paid off. Now I have the chance to actually practice some of what I preached. My new position is Head of Development Services in the Information Systems Group of the University of Edinburgh, and one of our goals for the next year or so is to roll out a service-oriented architecture...

The Grid Computing Now! webinar on Cloud computing is now available on the GCN web site . We had to make some last-minute changes because Alan Williamson was unable to join us; so after Ross Cooney finished his presentation, he and I had an extended discussion, including several questions sent in be the audience. It went very well; a couple of times I wondered whether I should bring the broadcast to an early close, only to receive new questions from the audience that kept the debate going. We covered many issues, but perhaps the key issue was when to use cloud and when to keep provision in-house. This depends on measurement and requirements (doesn't everything?). In the case of EMailCloud, Ross estimates that if a server will be kept well utilised for more than 8 hours a day, it is cheaper to run that machine in-house, while using the cloud for peak loads, disaster recovery, and so forth. We went into more detail than that - if you're interested, watch the webinar! We also...

Advocates of web 2.0 suggest that we can access nearly all of the services we need from web suppliers. We can edit our documents, store our photos or company data, and run our applications. It sounds great - but what happens when the web is unavailable? Over the last few years I have travelled quite a bit and I've often found myself in places with no wifi connectivity - or at least none at a price I'm willing to pay. So I value having a copy of my data on my laptop, so that I can carry on working. I've put forward this argument at a couple of events recently. At an excellent session on Web 2.0 and science at the UK e-Science All Hands Meeting , the response was that 3G coverage will soon be sufficient to give us access almost everywhere. The next generation will take it for granted, the way they take GSM talk coverage for granted already. I have to admit that this scenario seems quite likely, although of course there are still places that don't even have talk co...

I’ve just attended a panel session on Cloud Computing in Newcastle, which gave several points of view on the uptake and applicability of Cloud. The discussion covered Sofware as a Service (e.g; SalesForce, EMailCloud), Platform as a Service (e.g. Google App Engine, Arjuna) and Infrastructure as a Service (e.g. Flexiscale, Amazon EC2). The optimistic view, taken by the majority of the panel, was that we are on a journey towards cloud computing becoming the norm for business computing. Duncan Mactear of 4Projects sounded a more cautious note; his company provides SaaS for the construction industry but does not use cloud; instead their servers are hosted in a third-party data centre. To which Tony Lucas of Flexiscale pointed out that 10 years ago, similar companies weren’t even using hosting services. Sarat Pedirela of Hedgehog Lab, an ISV, pointed out that the appropriate infrastructure will depend on the type of application. Currently, Hedgehog use cloud for non-critical application...

On October 14th, I will be hosting a Grid Computing Now! web seminar on the topic of Cloud Computing. We have lined up two very interesting speakers who are using Cloud now to make businesses work. Ross Cooney had a good technological solution to sell but couldn't make it economic until Cloud Computing allowed him to pay for his computation only when he needed it. He will discuss the instant benefits and long term impact of cloud computing to the development, competitiveness and scalability of your application. Alan Williamson created the BlueDragon Java CFML runtime engine that powers MySpace.com. He advises several businesses and will give an overview of the different types of services available and how to avoid being locked-in to a single supplier. You can register for this event here .

I've been asked to publicise the following event. The Technology Strategy Board has arranged an Information Day for Wednesday 22nd October to outline the various R & D Competitions being planned over the next 9 months. This Information Day will provide delegates with an opportunity to find out about the activities of the Technology Strategy Board and gain an understanding of the application process for Collaborative R&D Competitions as well as find out about other Technology Strategy Board activities. The event, being held at the Hyatt Regency Hotel in Central Birmingham, will open at 09:30 for a 10:00 start and will close at approximately 16:30; a full agenda will be available shortly. To register for this event please click on the following link and complete the on-line registration form For more information on the Technology Strategy Board please visit their web site

This is a reminder that Grid Computing Now! is running a competition to find uses of grid technology to reduce human impact on climate change. The competition is open to anyone who is 18 or over and resident in the UK. So get your thinking caps on and submit your best ideas! The topic is deliberately wide, as is the interpretation of "grid", to allow a wide scope for proposals. The deadline for entries has been extended to Friday October 17 . This extension is particularly intended to give more time to university staff and students who wish to enter. The initial proposal just requires 1,000 words describing the proposed solution. See the competition web page for background information and details of how to enter. There are two tracks, one for IT professionals and the other for everyone else (including students).

I was pleased by our workshop on research opportunities this week. Our speakers met several people who were interested in their work and might contribute to taking it further. It's hard to measure the outcomes of these events, because the collaborations that we are aiming to catalyse may take months to firm up and then may take much longer to produce actual results, but the first impressions are positive. Some of the networking happened outside the workshop itself, of course. That is the advantage of face-to-face meetings; sometimes all you need is to bring the right people together for the first few minutes. Also, you can follow serendipitous links, such as when a colleague pointed me at the workshop on declarative data centres that Microsoft Research Cambridge and HP Labs organised earlier this year. I think the UK is building a critical mass in data centre management and I hope this can be encouraged to the point where it becomes a viable industry. Beyond our workshop, ther...

This week will see the annual conference for UK e-Science , which for historical reasons is called the e-Science All-Hands Meeting. I have organised a knowledge transfer workshop for the Tuesday afternoon, with the aims of presenting research opportunities for e-Science in the UK commercial and public sectors. We have four excellent speakers lined up. Mark Ferrar is the Director of Infrastructure Architecture for NHS Connecting for Health in England. Mark is interested in opportunities for using the processing power available to the NHS to improve clinical outcomes, for example by running HPC models and diagnosis applications. Liam Newcombe is tackling the question of "Green IT" in data centres. This is a big topic in the industry, because energy prices are rising and carbon accounting is being deployed. Liam has developed an open-source integrated model of data centres for the BCS and the Carbon Trust. He is looking for collaborators to further improve this model. A...

I attended an interesting workshop this week. It was one of the series that Peter James has put together for his SusteIT project; this one focussed on desktop PCs. The talks and panels looked at measurement procurement of energy use, procurement options, desktop grids, power management and thin clients. In any sizeable organistion, Desktop PCs use a large amount of electricity and there are many options available for reducing this consumption - and saving money too. This is the second time that I've seen a British university do the sums and expect to save £250,000 a year. The panel on power management tools was interesting. These seem to be coming of age at last. Operating systems have had support for managing individual computers but a large organisation needs a system for managing thousands of PCs, with different policies for different groups, and of course the important facility to wake up in time for the distribution of updates. James Osborne gave an interesting analysi...

The Edinburgh Festival Fringe is over for another year. Hundreds of performers have given thousands of shows to a huge number of culture seekers. Meanwhile, the IT industry has notched up another very public failure. The new box office system failed to cope with the demand for tickets on the first day and had to be patched hurriedly. It struggled along after that but was unable to implement the special offer that had been planned for last few days of the festival. It must be a challenge to cope with the huge interest on the first day of ticket sales and then to manage the varying load fot the next three months. For the other nine months of the year, of course, the system isn't needed at all. Does this sound like a candidate for cloud computing? I don't know how the existing system is implemented, but if it doesn't already use cloud to react to large swings in demand, perhaps the service providers should consider this option.

Yesterday saw a workshop on Sustainable IT at the new Queen Margaret University campus in Musselburgh. The workshop was ostensibly about "new ways of working" but another major focus was on how the adoption of thin clients allowed the architects to design an more environmentally friendly campus. Thin clients use less power on the desktop than PCs, which means less heat is generated in the classrooms, labs and open working areas. For QMU, this meant that the building can use natural cooling and ventilation, saving considerably more energy in addition to the saving from the terminals themselves. The switch to thin clients was also used to introduce the use of virtual desktops. These let staff and students access their work from anywhere on the campus and from home. Staff are encouraged to work from home when it suits them. On campus, staff now work in open plan areas rather than offices; overall, the extra freedom seems to outweigh any disadvantage from the change. The ...

We've been running our Green IT theme for several months and I'm pleased with the progress we've made. We've run two webinars and spoken at several events, including the ITU symposium on ICTs and Climate Change and Oxford University's conference on Low Carbon ICT As an example sector, we are working with the JISC-funded project on Sustainable IT in Higher Education- partly because this is a sector in which we can publicise progress without too many strings attached. We helped Peter James organise the first SusteIT workshop, which was held in Cardiff on June 19th. This has already caused quite a stir; Cardiff have done a good job of procuring an energy-efficient machine hall and other education establishments seem to be looking to this as an examplar. Later this year, we will be helping Peter with two more workshops that fall under our remit. Green IT has to consider all aspects of running an IT service. As such, it is a broader topic than we can cover. ...

Grid Computing Now! is running a competition to find uses of grid technology to reduce human impact on climate change. The competition is open to anyone who is 18 or over and resident in the UK. So get your thinking caps on and submit your best ideas! The topic is deliberately wide, as is the interpretation of "grid", to allow a wide scope for proposals. There will be three stages to the competition: an initial proposal of 1,000 words; an apprentice workshop, where finalists can speak to grid architects and academics to develop their ideas; and the final presentation at The British Computer Society on December 1st 2008. The deadline for registering your interest is July 31st, but the initial submission is not required until September 1st. See the competition web page for background information and details of how to enter. There are two tracks, one for IT professionals and the other for everyone else (including students).

A busy schedule and an unusually flakey wi-fi setup have conspired to limit my blogging activity from OGF23 this week. This is just a quick post to note a rather neat idea that was demonstrated by one part of the CoreGrid project. BOINC is the infrastructure used by volunteer computing projects such as SETI@home and ClimatePrediction.net . The system sends out jobs to be run on people's home computers and collects the result. Handling all this network traffic puts quite a load on the central server. What the CoreGrid demo has done is to combine BOINC with the BitTorrent peer-to-peer data distribution system, so that the load is distributed. This may not be news to some of you, as the paper was published last year. I like it; it's a simple idea to solve an immediate problem. I've heard of other projects looking at the potential of BitTorrent as well.

Alex Hardisty, of Cardiff University and the Healthcare@Home project, has noted his observations on HC2008 . In particular, he notes some trends which he plans to address in his research.

At HC2008 I was introduced to the XDS standard for Cross-Enterprise Document Sharing (not to be confused with several other uses of the XDS acronym). XDS is a profile of the ebXML standards for registries and other related standards to specify a system for sharing medical documents. The important point is that XDS is supported by several major vendors and has been deployed in clinical health systems in several countries. As far as I'm aware, it has not made any impact in the grid world. The basic XDS standard can be extended to address particular use cases or to add functionality. One popular extension handles DICOM files (a format widely used in medical imaging). Another ( http://wiki.ihe.net/index.php?title=Cross_Community_Access">XCA ) supports federated registries, removing the single point of failure of the basic model. I think it is worth investigating for other e-Science applications. It may be simpler to leverage this work than to reinvent it. Also, it m...

GridToday reports that the Platform Global Conference will include a panel on whether HPC data centres can "go green". Among the strategies they will discuss include energy-directed scheduling, i.e. dynamically allocating workload to minimise electricity consumption. It so happens that I am organising a workshop at OGF23 on exactly this subject. We will be looking at the details of what is needed to make this a reality and what steps are needed to make this idea a reality.

Ian Foster notes a project at University of Notre Dame near Chicago which is distributing research computing facilities in order to provide heat to campus buildings. This is an interesting trade-off: on the one hand, the distribution of resources means that the waste heat is put to good use; on the other hand, it's possible that each distributed installation is less efficient that a good-quality centralised machine hall. This is another example of where we need good quality models and well-measured example deployments to help us decide which approaches give the best results.

This week, I attended Healthcare Computing 2008 to get an update on the current state of e-health in the UK and to explore how grid technology can contribute. Health Informatics is a broad subject and it isn't possible to engage with the whole field, but I see three main areas of potential engagement. The path is most followed by the academic community to date is that of linking together data used in clinical trials or in health research. This is a natural fit for the e-science community as it extends existing work on secure access to distributed research data. The medical world imposes more security constraints, which adds academic interest, but is otherwise familiar to the e-scientists. It is also of a scale that is manageable in research projects. Successful projects include Psygrid , which is now deployed across the NHS research centres in mental health and in bioinformatics. So this is the first area of engagement. A natural question is whether this experience with rese...