Today HP announced Project Moonshot  - a programme to accelerate the use of low power processors in the data centre.

The three elements of the announcement are the launch of Redstone – a development platform that harnesses low-power processors (both ARM & x86),  the opening of the HP Discovery lab in Houston and the Pathfinder partnership programme.

Canonical is delighted to be involved in all three elements of HP’s Moonshot programme to reduce both power and complexity in data centres.

The HP Redstone platform unveiled in Palo Alto showcases HP’s thinking around highly federated environments and Calxeda’s EnergyCore ARM processors. The Calxeda system on chip (SoC) design is powered by Calxeda’s own ARM based processor and combines mobile phone like power consumption with the attributes required to run a tangible proportion of hyperscale data centre workloads.

The promise of server grade SoC’s running at less than 5W and achieving per rack density of 2800+ nodes is impressive, but what about the software stacks that are used to run the web and analyse big data – when will they be ready for this new architecture?

Ubuntu Server is increasingly the operating system of choice for web, big data and cloud infrastructure workloads. Films like Avatar are rendered on Ubuntu, Hadoop is run on it and companies like Rackspace and HP are using Ubuntu Server as the foundation of their public cloud offerings.

The good news is that Canonical has been working with ARM and Calexda for several years now and we released the first version of Ubuntu Server ported for ARM Cortex A9 class  processors last month.

The Ubuntu 11.10 release (download) is an functioning port and over the next six months and we will be working hard to benchmark and optimize Ubuntu Server and the workloads that our users prioritize on ARM.  This work, by us and by upstream open source projects is going to be accelerated by today’s announcement and access to hardware in the HP Discovery lab.

As HP stated today, this is beginning of a journey to re-inventing a power efficient and less complex data center. We look forward to working with HP and Calxeda on that journey.

November 16th – 2pm UK time

After years of development and fine tuning, the cloud vision of true computing elasticity is finally a reality. The question now is how organisations can best take advantage of the latest cloud technologies to optimise their IT, scale infrastructure and services in near-real time, and make the most of new market opportunities.

In our webinar, Ubuntu’s Founder Mark Shuttleworth and Redmonk’s Stephen O’Grady share their ideas on the cloud and the benefits it offers businesses today. They discuss how open-source technologies in general, and Ubuntu Cloud in particular, can help companies avoid frustrating vendor lock-in and stay in control of their own cloud destinies. They also explore Ubuntu’s unique attributes, looking at how it minimises hardware and software costs, accelerates cloud deployment, and supports dynamic service provisioning and scaling.

Register now: http://www.brighttalk.com/channel/6793

Great news that Ubuntu 11.10 will include Cloud Foundry, an open source Platform as a Service (PaaS) that enables developers to build, deploy and run Cloud applications. Other PaaS offerings have typically locked you into using specific frameworks and services defined by the PaaS vendor as well as proprietary host platforms. This has made migrating applications between different providers as well as moving applications back into your own data center difficult if not impossible.

Cloud Foundry is the world’s first Open PaaS with your choice of frameworks, application services and Cloud deployment platforms. Cloud Foundry is made to be extensible so that while Spring, Rails, Sinatra and Node.js apps are supported today more frameworks can be added in the future as they gain in popularity. Even more exciting is that you will be able to run your PaaS in any cloud or behind your own firewall if you choose. No lock-in to a single development framework or Cloud vendor!

In Ubuntu 11.10 we’ve added client and server deployment tools using Ensemble that allow you to easily deploy a single node server in minutes as well as a distributed, multi node environment quickly and easily to create a production quality PaaS. You can deploy applications in AWS, Openstack or on your own internal servers.

Stay tuned as we’ll be doing more exciting work with Cloud Foundry. We encourage you to check out Cloud Foundry in Ubuntu 11.10 and learn more about the project at www.cloudfoundry.org

Fitting more computing capacity into a limited power envelope is one of the key challenges facing data centre designers today. It impacts companies whether they are building a £500 million data centre or simply working how much compute that can fit into a couple of racks at a shared facility.

One of the emerging approaches to solving this problem is to look at the technologies in low power-consumption appliances like phones and applying them to dense clusters in server-like configurations. Whether it is in smartphones, tablets or other embedded systems, the processor at the heart of these low power devices is generally ARM-based.

With Ubuntu Server becoming the de-facto standard for cloud infrastructure and big data solutions, we recognise that power consumption is key to efficient scaling. Building on four years of working with ARM, we are now taking the step of supporting Ubuntu Server on ARM.  We expect these processors to be used in a variety of use cases including microservers.

This is a first step and there will be many revisions of processors, hardware designs and of software as the performance and supported server workloads optimised for ARM grow over the next four years. It is, however, a first crucial step towards a new technology and one where yet again open-source innovation leads.

The new addition to the Ubuntu family | First release in October 2011

In October, the Ubuntu Server 11.10 release will be simultaneously available for x86, x86-64 and ARM-based architectures. The base image of the releases will be the same across architectures with a common kernel baseline. The ARM architecture will also be part of the long-term support (LTS) version of Ubuntu Server in 12.04 and other future releases.

Initial development focus and optimisation will be around the most popular Ubuntu workloads of web/network infrastructure and distributed data processing via NoSQL or big data applications where workloads typically use hundreds or thousands of systems.

Get involved

The Ubuntu Server on ARM initiative is a multi-year initiative gathering broad participation. More project information can be found on the Ubuntu wiki

Hardware partners, ISVs and open-source application developers keen to join existing partners around Ubuntu Server on ARM should contact us via our partner enquiry form.

Last week saw the culmination of one of the UK’s most popular TV shows – Britain’s Got Talent. The way in which this show over five series has captured the attention of the British public is quite incredible, with the majority of popular media outlets dedicating significant space to the contestants, the judges, rumours about the format and speculation about who would win.

Such coverage and excitement means that Britain’s Got Talent drives audience and voter engagement to levels that politicians must dream about. Of course there are many ways that the show makes sure it gets our attention, not least of which is having hours of live coverage on prime time television, but, the talented team behind the show are also using many techniques to encourage deeper engagement for a modern audience.

Take for example the Buzz Off game. This is a game with which viewers can play along while watching the show to ‘buzz’ the acts that they don’t like using a mobile or web-based application. The buzzes are stored with a running total kept and shown per act on the website, so that the audience goes from being an passive viewer to an active participant in the show. The Buzz Off game is developed by Livetalkback for the Britain’s Got Talent Team and recently Malcolm Box, CTO of Livetalkback explained to a group of London big data enthusiasts some of the challenges in building and designing an application that is required to scale to almost Facebook like proportions for a short period of time. The full presentation is below, but for convenience some of the key points are:

• The volume of traffic being handled by the Buzz application during a two hour live show is equivalent to 130 billion requests per month – excluding Google, this would put the application as approximately the 2nd largest website in the world behind Facebook.
• To manage this scale, the application is based on Ubuntu Server, MySQL and Cassandra all hosted in the Amazon Public Cloud
• The service uses hundreds of instances that must be brought online very quickly as additional capacity is required and then released as the load declines after the show.

Malcolm and the team at Livetalkback have done an incredible job to put this together in a short space of time and have it work reliably throughout this year’s programme. A cloud-based approach made perfect sense for an application with such specific scaling requirements, and it was vital that the application scaled not only technically but financially as well. This is where Ubuntu on Amazon really proved its worth – customers pay for the resources they use and there are no license fees or royalties to worry about when bringing up new instances. It is the type of efficient driving of engagement that once again Government departments must be in awe of.

Which brings us onto the Cabinet Office. The UK Government is looking for ways to provide cost effective online systems that drive audience engagement. Recently there have been signs that there has been progress  through the Alpha.gov.uk project led by Martha Lane Fox. Alpha.gov.uk is a prototype site that demonstrates how digital services could be delivered more effectively and simply to users through the use of open, agile and cheaper digital technologies. It is only a prototype at the moment but it is significant in that it has been quickly put together and delivers exactly what it is supposed to do in a cost effective way. So how did they do it? Well they decided on a similar architecture to Livetalkback – Open source software based on Ubuntu Server in a public cloud. Full details of the technology used is at:

http://blog.alpha.gov.uk/colophon

British tax payers will take heart form the knowledge that someone in the Cabinet Office is looking at this and hopefully wondering why more Government services can’t be delivered like this. When it comes to engaging an audience and encouraging interaction in a cost effective way, Britain’s Got Talent and the Cabinet Office now have more in common than you’d think.

We made a small flurry of announcements last week, all of which were related to cloud computing. I think it is worthwhile to put some context around Ubuntu and the cloud and explain a little more about where we are with this critical strategic strand for our beloved OS.

First of all, the announcements. We announced the release of Ubuntu Enterprise Cloud on Dell servers. This is a hugely significant advance in the realm of internal cloud provision. It’s essentially formalising a lot of the bespoke work that Dell has done in huge data centres (based on a variety of OSes) and making similar technology available for smaller deployments. We attended the Dell sales summit in Las Vegas and we were very encouraged to meet with many of the Dell salespeople whose job it will be to deliver this to their customers. This is a big company, backing a leading technology and encouraging businesses to start their investigations of cloud computing in a very real way.

More or less simultaneously, we announced our formal support for the OpenStack project and the inclusion of their Bexar release in our next version of Ubuntu, 11.04. This will be in addition to Eucalyptus, it is worth stating. Eucalyptus is the technology at the core of UEC – and will be in Ubuntu 11.04 – as it has been since 9.04. Including two stacks has caused some raised eyebrows but it is not an unusual position for Ubuntu. While we look to pick one technology for integration into the platform in order to deliver the best user experience possible, we also want to make sure that users have access to the best and most up to date free and open-source software. The increasing speed of innovation that cloud computing is driving has meant that Ubuntu, with its 6 month release cadence, is able to deliver the tools and programs that developers and admins want before any other operating system.

Users will ultimately decide what deployment scenarios each stack best suits. Eucalyptus certainly has the advantage of maturity right now, especially for internal cloud deployments. OpenStack, meanwhile, continue to focus on rapid feature development and, given its heritage, has appeal to service providers looking to stand up their own public clouds. Wherever the technology is deployed, be it in the enterprise or for public clouds, we want Ubuntu to be the underlying infrastructure for all the scenarios and will continue to direct our platform team to deliver the most tightly integrated solution possible.

Finally we saw our partner Autonomic Resources announce UEC is now available for purchase by Federal US government buyers. This is the first step on a long road the federal deployment, as anyone familiar with the governmental buying cycles will realise. But it is a good example of the built-to-purpose cloud environments that we will see more of – with the common denominator of Ubuntu at the core of it.

Which actually raises an interesting question – why is it that Ubuntu is at the heart of cloud computing? Perhaps we ought to look at more evidence before the theory. In addition to being the OS at the heart of new cloud infrastructures, we are seeing enormous usage of Ubuntu as the guest OS on the big public clouds, such as AWS and Rackspace, for instance. It is probably the most popular OS on those environments and others – contact your vendor to confirm

So why is this OS that most incumbent vendors would dismiss as fringe, seeing such popularity in this new(ish) wave of computing? Well there are a host of technical reasons to do with modularity, footprint, image maintenance etc. But they are better expressed by others.

I think the reason for Ubuntu’s prominence is because it is innovation made easy. Getting on and doing things on Ubuntu is a friction-free experience. We meet more and more tech entrepreneurs who tell us how they have built more than one business on Ubuntu on the cloud. Removing licence costs and restrictions allows people to get to the market quickly.

But beyond speed, it is also about reducing risk. With open-source now firmly established in the IT industry, and with the term open used so promiscuously, it is easy to forget that the economic benefits of truly free, open-source software. The combination of cloud computing, where scale matters, and open source is a natural one and this is why Ubuntu is the answer for those who need the reassurance that they can both scale quickly but also avoid vendor lock-in in the long-term.

More specifically, and this brings us back to the announcements, there are now clear scenarios where users can reach a point where even the economics of a licence-free software on a public cloud start to break down. At a certain stage it is simply cheaper to make the hardware investment to run your own cloud infrastructure. Or there might be regulatory, cultural or a host of other reasons for wanting cloud-like efficiencies built on internal servers.

The work we have done with OpenStack and with Eucalyptus means Ubuntu is an ideal infrastructure on which to build a cloud. This will typically be for the internal provision of a cloud environment but equally could be the basis or a new public cloud. It is entirely open as to the type of guest OS and in all cases continues to support the dominant API of Amazon EC2, ensuring portability for those writing applications.

And as we have seen, Ubuntu is the ultimate OS to deploy in a cloud and with which to build a cloud. No-one provides more up-to-date images on the most popular public cloud platforms. Our work to ensure compatibility to the most popular standards means that those guests will run just as well on a UEC cloud however that is deployed – either internally or for cloud provision externally.

So technology moves markets. Economics does too, only more so. Ubuntu has come at the right point in our short IT history to ride both waves. The scale is there, the standards are emerging and the ability to provide an answer to the choice between running a cloud or running on a cloud is more fully realised on Ubuntu than on any other OS – open source or not.

Canonical over the last four years or so has brought businesses a growing range of services and software tools to help them make better use of the Ubuntu platform. Many of these services, such as Landscape systems management and technical support, have proven valuable for companies that want to more easily manage and maintain Ubuntu in their business.

Rather than having to decide which tools or services are useful, we decided to make things simple by bringing together all the necessary tools and services into a single offering, Ubuntu Advantage.

Ubuntu Advantage has four service components:

* systems management

* enterprise technical support

* legal assurance

* access to knowledge base

At Canonical, we believe these are they key service areas that help enterprises make successful use of Ubuntu in their business. As new technology features and capabilities are incorporated into the Ubuntu platform, the Ubuntu Advantage service offering will also grow to support those new platform capabilities.

The systems management service category offers Canonical’s Landscape systems management and monitoring tool. Within any enterprise it is crucial for IT departments to have the necessary systems management tool to avoid having to spend copious amounts of time managing and maintaining systems with patches and security upgrades. Although, these tasks are vital for enterprise systems to remain safe, they can also be tedious and unnecessarily time consuming without the right tools. The package management and automation features of Landscape help to remove much of this manual work.

Ubuntu Advantage includes enterprise-level technical support for the desktop and server to give businesses direct backing from the source of Ubuntu, Canonical. This is a valuable service because businesses can deploy Ubuntu with a greater sense of security; should they run into any problems, they have the support from the organisation which released it.

Our aim is to provide comprehensive support, but we also want to give customers flexibility with the type of service they receive as we recognise that different machines will run different workloads and need different levels of support. On the server there are three options ranging from support for basic server workloads to the most complex setups:

* Essential Server – to cover common workloads such as file and print serving

* Standard Server – for more advanced business needs like server virtualisation and integration into existing Windows networks

* Advanced Server – to cover complex configurations such as high-availability and clustering

On the desktop there were two main usage types we want to cover, general business use and developer use:

* Standard Desktop – covers general end users using standard business applications such as email, office suites and web browsing

* Advanced Desktop – covers developers that have more complex desktop configurations, such as desktop virtualisation, and use advanced developer tools

A major aim of Ubuntu Advantage is to ease the adoption of Ubuntu by providing quick and easy access to a definitive answers. The online Knowledge Base gives customers a central repository from which they can quickly reference at any time definitive guides on how to resolve common issues or information about best practices deployments. Canonical’s support engineers create the content in the knowledge base keeping it accurate and up-to-date on the latest releases.

It’s also crucial that staff using Ubuntu feel comfortable with it, because the more confident they feel the more they can take advantage of Ubuntu’s many features and the fewer problems they will come across. So we also included training credits in Ubuntu Advantage. These can be redeemed to train end users on how to make the most of Ubuntu Desktop for their daily job, or they can be redeemed for system administrator training to help them more easily deploy and manage Ubuntu systems.

We know it is important for many organisations to have legal assurance to enable the adoption of an open source platform, which is why we have also included our legal assurance programme, Ubuntu Assurance, with all Ubuntu Advantage service options.

Ubuntu Advantage provides simplicity and an easier way for businesses to purchase the necessary tools and services to manage, support and use their Ubuntu platform more effectively and efficiently. Ultimately, it saves them precious time and money that can be spent elsewhere in their businesses. Initial reception has been very positive and we look forward to getting more feedback on the new services as users become familiar with them and hopefully see the value in them.

The Ubuntu Advantage website is live at: visit http://bit.ly/cOasJ3

Fern Ho, Ubuntu Advantage Product Manager

On Wednesday Dell announced a comprehensive overview of its enterprise strategy. Significant in its announcement, was the addition of Ubuntu Enterprise Cloud (UEC) as an infrastructure solution, joining the proprietary offerings from VMWare and Microsoft. This is the first major offering of a true open source Cloud solution backed by a major corporate vendor.

Dell will offer a series of ‘blueprint’ configurations that have been optimised for different use cases  and scale. These will include PowerEdge-C hardware, UEC software and full technical support – you will be able to buy these straight from Dell or you can use the ‘blueprints’ as a base to create your own bespoke solution. The Dell team have great strength and experience here and will provide detailed guidance on all the ‘blueprint’ solutions, as well as enterprise class deployments.

Ubuntu Enterprise Cloud leads the Linux field with integration of cloud capabilities directly into the OS. UEC is based on Eucalyptus which builds on the de facto cloud API standards of Amazon EC2 and S3. The relationship between Canonical and Eucalyptus Systems ensures that you have one escalation path to resolve any issues with the OS or the cloud service. Offering the same APIs as the dominant public cloud offering, Amazon EC2, you can build your applications to run on either platform. The Dell solution will be based on Ubuntu 10.04 LTS – which is released on April 29th.

Behind the scenes we’ve worked with Dell’s DCS team for over six months to test and validate the integration of the cloud stack on their new PowerEdge-C series. Within the industry, the DCS team has an excellent reputation for full design, integration, installation anddeployment. It has been both challenging and exciting working to meet and exceed their expectations, a result of excellent cooperation between the Dell core team, our Cloud & Server team and Eucalyptus.

Mark Murphy, Global Alliances Director

A few weeks ago myself and Dustin Kirkland had the privilege of travelling to the Intel facility in Hillsboro, Oregon to work with Billy Cox, Rekha Raghu, Paul Guermonprez, Trevor Cooper and Kamal Natesan of Intel and Dan Nurmi and Neil Soman of Eucalyptus Systems and a few others on developing a proof of concept whitepaper on the use of Ubuntu Enterprise Cloud on Intel Xeon processors (Nehalem).

The whitepaper is published today on the Intel site (registration required) so it seems like a good time to talk about why we collaborated.

The Intel Cloud Builder program is intended to develop some best practice information for businesses and institutions looking to take advantage of the promise of cloud computing. As we do consistently with UEC, we are being specific when we talk about cloud as the ability to build Infrastructure as a Service behind a corporate firewall – that is on your own systems, protected by your own security protocols.

In Portland we had access to some great hardware and as an ex-Intel man, it was good to mess directly with the metal again. Intel defined a number of use and test cases and the guys from Intel, Eucalyptus and myself were able to have some fun putting UEC through its paces. And the results were good. We documented them and the whitepaper gives numerous code and scenario examples to help anyone new to cloud to get up to speed really quickly and the make the most of the capabilities of the Xeon processor in supporting an internal IaaS infrastructure. You can find out how to get started on UEC with existing documentation. but this whitepaper takes it to the next stage.

Being able to test the software as part of the Intel Cloud Builder program and jointly publish this whitepaper is a great endorsement of what is still a young technology. And I hope it will give users confidence to start building their own UEC deployment on x86 technology.

Nick Barcet, Ubuntu Server Product Manager