Distributed Thinking

Currently, whenever we deploy a new application on the university's IT infrastructure, we follow a detailed quality assurance process.  This involves several different teams.  The actual deployment is performed by the database/system adminstration team.  If we developed the application ourselves, or if it needed significant integration with other university systems, then the software development or software configuration teams will be involved.  The corresponding support teams will check that they have the documentation and knowledge that they need to start supporting the application once it is "live".  The project mangers co-ordinate everything.  And this is just the teams in Applications Division; our colleagues for whom we are implementing the system will be doing their own checks and making their own arrangements.  So deployment takes quite a bit of effort and time. What we would like to do is to make this process easier, quicker and more reliabl...

At this time of year, the various departments of the university are planning their activities and budgets for next year.  Applications Division provide the IT component of many new projects, so we are asked to estimate how much time and money will be required or a wide range of proposals.  Most of these proposals are at preliminary stages, with only outline ideas of what will be required.  Given this uncertainty, You might ask what is the secret that lets us produce accurate estimates for all these proposals? The truth is: we don't.  Of course, we look at our project record to see how much effort was required for similar projects in the past.  This data gives us a guide to the costs of different types of project, such as software procurements, infrastructure upgrades, and software development.  The data also helps us allocate the expected effort across the different teams that will be involved.  But we often don't know exactly what a project will entai...

A year ago I completed a year-long course run by the Leadership Foundation for Higher Education.  This course brought together 18 IT and library managers from universities across the UK and Ireland, made us look at who we are, what we value and how we work, and then gave us lots of pointers for how to lead our teams and projects more effectively. This week we all gathered for a reunion and for meetings of our "action learning sets".  These sets are groups who help each other with problems we encounter in our jobs.  Sometimes these are practical problems; sometimes they are about relationships with other people; sometimes we just ask the others to help us understand our own thoughts and feelings. I'm blogging about this because everyone in my action learning set has found it hugely valuable to have someone we can talk to who will give us their honest response, in an atmosphere of trust.  The fact that we are all from different institutions mean that our reactions are ...

Martin Hamilton has posted a thoughtful piece about the impact of the current IT trends away from the desktop PC and towards cloud computing.  I've been musing about how these changes might affect us as service providers. The move towards staff and students using their own devices to access our services is well established.  We have a policy of providing services via the web whenever we can, giving people access to our services "anywhere, anytime".  The EASE system provides a single authentication point for common access and is integrated with Shibboleth as well.  There are still university systems that don't fit this model, perhaps because the vendor doesn't provide the option or because a university department has bought their own system without considering the wider picture, but we are moving in the right direction. In some cases, the move towards outsourcing services can make this harder.  The big players all have their own authentication systems and wa...

I've decided to revive this blog, after a three-year hiatus, to post news and thoughts about my current role as Head of Development Services, in the IS Applications Division, at the University of Edinburgh.  My aim is to give some visibility to what goes on "behind the scenes" (or should that be "behind the screens"?) and to reveal the sort of issues that face IT in a Russell Group university. My current job is quite different from my previous role at the National e-Science Centre, which was the topic of the previous incarnation of this blog.  Some issues, such as virtualisation and cloud, are common to all IT jobs these days, but the emphasis of my current job is on support and administration systems rather than research.  One important difference is that I must stress that all the posts here will not represent the official position of the University of Edinburgh in any way. To start off, let me point you at an interesting comparison of the "student ex...

I started a new job at the beginning of the month. I'm no longer working at the National e-Science Centre and that means that I won't be involved with Grid Computing Now! . I was granted a day from my new job to host the webinar on cloud computing with Ross Cooney, but that was my last commitment for GCN!. It's been almost 6 years since I joined NeSC and it was about this time 4 years ago that we were writing the proposal for the Knowledge Transfer Network that became GCN!. Looking back, I the experience has taught me a lot as we evolved the KTN to be most effective. It took a lot of effort to get ourselves recognised - to "build the brand" in marketing speak - and I think the work paid off. Now I have the chance to actually practice some of what I preached. My new position is Head of Development Services in the Information Systems Group of the University of Edinburgh, and one of our goals for the next year or so is to roll out a service-oriented architecture...

The Grid Computing Now! webinar on Cloud computing is now available on the GCN web site . We had to make some last-minute changes because Alan Williamson was unable to join us; so after Ross Cooney finished his presentation, he and I had an extended discussion, including several questions sent in be the audience. It went very well; a couple of times I wondered whether I should bring the broadcast to an early close, only to receive new questions from the audience that kept the debate going. We covered many issues, but perhaps the key issue was when to use cloud and when to keep provision in-house. This depends on measurement and requirements (doesn't everything?). In the case of EMailCloud, Ross estimates that if a server will be kept well utilised for more than 8 hours a day, it is cheaper to run that machine in-house, while using the cloud for peak loads, disaster recovery, and so forth. We went into more detail than that - if you're interested, watch the webinar! We also...

Advocates of web 2.0 suggest that we can access nearly all of the services we need from web suppliers. We can edit our documents, store our photos or company data, and run our applications. It sounds great - but what happens when the web is unavailable? Over the last few years I have travelled quite a bit and I've often found myself in places with no wifi connectivity - or at least none at a price I'm willing to pay. So I value having a copy of my data on my laptop, so that I can carry on working. I've put forward this argument at a couple of events recently. At an excellent session on Web 2.0 and science at the UK e-Science All Hands Meeting , the response was that 3G coverage will soon be sufficient to give us access almost everywhere. The next generation will take it for granted, the way they take GSM talk coverage for granted already. I have to admit that this scenario seems quite likely, although of course there are still places that don't even have talk co...

I’ve just attended a panel session on Cloud Computing in Newcastle, which gave several points of view on the uptake and applicability of Cloud. The discussion covered Sofware as a Service (e.g; SalesForce, EMailCloud), Platform as a Service (e.g. Google App Engine, Arjuna) and Infrastructure as a Service (e.g. Flexiscale, Amazon EC2). The optimistic view, taken by the majority of the panel, was that we are on a journey towards cloud computing becoming the norm for business computing. Duncan Mactear of 4Projects sounded a more cautious note; his company provides SaaS for the construction industry but does not use cloud; instead their servers are hosted in a third-party data centre. To which Tony Lucas of Flexiscale pointed out that 10 years ago, similar companies weren’t even using hosting services. Sarat Pedirela of Hedgehog Lab, an ISV, pointed out that the appropriate infrastructure will depend on the type of application. Currently, Hedgehog use cloud for non-critical application...

On October 14th, I will be hosting a Grid Computing Now! web seminar on the topic of Cloud Computing. We have lined up two very interesting speakers who are using Cloud now to make businesses work. Ross Cooney had a good technological solution to sell but couldn't make it economic until Cloud Computing allowed him to pay for his computation only when he needed it. He will discuss the instant benefits and long term impact of cloud computing to the development, competitiveness and scalability of your application. Alan Williamson created the BlueDragon Java CFML runtime engine that powers MySpace.com. He advises several businesses and will give an overview of the different types of services available and how to avoid being locked-in to a single supplier. You can register for this event here .

I've been asked to publicise the following event. The Technology Strategy Board has arranged an Information Day for Wednesday 22nd October to outline the various R & D Competitions being planned over the next 9 months. This Information Day will provide delegates with an opportunity to find out about the activities of the Technology Strategy Board and gain an understanding of the application process for Collaborative R&D Competitions as well as find out about other Technology Strategy Board activities. The event, being held at the Hyatt Regency Hotel in Central Birmingham, will open at 09:30 for a 10:00 start and will close at approximately 16:30; a full agenda will be available shortly. To register for this event please click on the following link and complete the on-line registration form For more information on the Technology Strategy Board please visit their web site

This is a reminder that Grid Computing Now! is running a competition to find uses of grid technology to reduce human impact on climate change. The competition is open to anyone who is 18 or over and resident in the UK. So get your thinking caps on and submit your best ideas! The topic is deliberately wide, as is the interpretation of "grid", to allow a wide scope for proposals. The deadline for entries has been extended to Friday October 17 . This extension is particularly intended to give more time to university staff and students who wish to enter. The initial proposal just requires 1,000 words describing the proposed solution. See the competition web page for background information and details of how to enter. There are two tracks, one for IT professionals and the other for everyone else (including students).

I was pleased by our workshop on research opportunities this week. Our speakers met several people who were interested in their work and might contribute to taking it further. It's hard to measure the outcomes of these events, because the collaborations that we are aiming to catalyse may take months to firm up and then may take much longer to produce actual results, but the first impressions are positive. Some of the networking happened outside the workshop itself, of course. That is the advantage of face-to-face meetings; sometimes all you need is to bring the right people together for the first few minutes. Also, you can follow serendipitous links, such as when a colleague pointed me at the workshop on declarative data centres that Microsoft Research Cambridge and HP Labs organised earlier this year. I think the UK is building a critical mass in data centre management and I hope this can be encouraged to the point where it becomes a viable industry. Beyond our workshop, ther...

This week will see the annual conference for UK e-Science , which for historical reasons is called the e-Science All-Hands Meeting. I have organised a knowledge transfer workshop for the Tuesday afternoon, with the aims of presenting research opportunities for e-Science in the UK commercial and public sectors. We have four excellent speakers lined up. Mark Ferrar is the Director of Infrastructure Architecture for NHS Connecting for Health in England. Mark is interested in opportunities for using the processing power available to the NHS to improve clinical outcomes, for example by running HPC models and diagnosis applications. Liam Newcombe is tackling the question of "Green IT" in data centres. This is a big topic in the industry, because energy prices are rising and carbon accounting is being deployed. Liam has developed an open-source integrated model of data centres for the BCS and the Carbon Trust. He is looking for collaborators to further improve this model. A...

I attended an interesting workshop this week. It was one of the series that Peter James has put together for his SusteIT project; this one focussed on desktop PCs. The talks and panels looked at measurement procurement of energy use, procurement options, desktop grids, power management and thin clients. In any sizeable organistion, Desktop PCs use a large amount of electricity and there are many options available for reducing this consumption - and saving money too. This is the second time that I've seen a British university do the sums and expect to save £250,000 a year. The panel on power management tools was interesting. These seem to be coming of age at last. Operating systems have had support for managing individual computers but a large organisation needs a system for managing thousands of PCs, with different policies for different groups, and of course the important facility to wake up in time for the distribution of updates. James Osborne gave an interesting analysi...

The Edinburgh Festival Fringe is over for another year. Hundreds of performers have given thousands of shows to a huge number of culture seekers. Meanwhile, the IT industry has notched up another very public failure. The new box office system failed to cope with the demand for tickets on the first day and had to be patched hurriedly. It struggled along after that but was unable to implement the special offer that had been planned for last few days of the festival. It must be a challenge to cope with the huge interest on the first day of ticket sales and then to manage the varying load fot the next three months. For the other nine months of the year, of course, the system isn't needed at all. Does this sound like a candidate for cloud computing? I don't know how the existing system is implemented, but if it doesn't already use cloud to react to large swings in demand, perhaps the service providers should consider this option.

Yesterday saw a workshop on Sustainable IT at the new Queen Margaret University campus in Musselburgh. The workshop was ostensibly about "new ways of working" but another major focus was on how the adoption of thin clients allowed the architects to design an more environmentally friendly campus. Thin clients use less power on the desktop than PCs, which means less heat is generated in the classrooms, labs and open working areas. For QMU, this meant that the building can use natural cooling and ventilation, saving considerably more energy in addition to the saving from the terminals themselves. The switch to thin clients was also used to introduce the use of virtual desktops. These let staff and students access their work from anywhere on the campus and from home. Staff are encouraged to work from home when it suits them. On campus, staff now work in open plan areas rather than offices; overall, the extra freedom seems to outweigh any disadvantage from the change. The ...

We've been running our Green IT theme for several months and I'm pleased with the progress we've made. We've run two webinars and spoken at several events, including the ITU symposium on ICTs and Climate Change and Oxford University's conference on Low Carbon ICT As an example sector, we are working with the JISC-funded project on Sustainable IT in Higher Education- partly because this is a sector in which we can publicise progress without too many strings attached. We helped Peter James organise the first SusteIT workshop, which was held in Cardiff on June 19th. This has already caused quite a stir; Cardiff have done a good job of procuring an energy-efficient machine hall and other education establishments seem to be looking to this as an examplar. Later this year, we will be helping Peter with two more workshops that fall under our remit. Green IT has to consider all aspects of running an IT service. As such, it is a broader topic than we can cover. ...

Grid Computing Now! is running a competition to find uses of grid technology to reduce human impact on climate change. The competition is open to anyone who is 18 or over and resident in the UK. So get your thinking caps on and submit your best ideas! The topic is deliberately wide, as is the interpretation of "grid", to allow a wide scope for proposals. There will be three stages to the competition: an initial proposal of 1,000 words; an apprentice workshop, where finalists can speak to grid architects and academics to develop their ideas; and the final presentation at The British Computer Society on December 1st 2008. The deadline for registering your interest is July 31st, but the initial submission is not required until September 1st. See the competition web page for background information and details of how to enter. There are two tracks, one for IT professionals and the other for everyone else (including students).

A busy schedule and an unusually flakey wi-fi setup have conspired to limit my blogging activity from OGF23 this week. This is just a quick post to note a rather neat idea that was demonstrated by one part of the CoreGrid project. BOINC is the infrastructure used by volunteer computing projects such as SETI@home and ClimatePrediction.net . The system sends out jobs to be run on people's home computers and collects the result. Handling all this network traffic puts quite a load on the central server. What the CoreGrid demo has done is to combine BOINC with the BitTorrent peer-to-peer data distribution system, so that the load is distributed. This may not be news to some of you, as the paper was published last year. I like it; it's a simple idea to solve an immediate problem. I've heard of other projects looking at the potential of BitTorrent as well.