Windows Azure and dynamic elasticity

Question

Is there a way do do dynamic elasticity in Windows Azure? If my workers begin to get overloaded, or queues start to get too full, or too many workers have no work to do, is there a way to dynamically add or remove workers through code or is that just done manually (requires human intervention) right now? Does anyone know of any plans to add that if its not currently available?

Answer 1

Microsoft shipped the Autoscaling Application Block (Wasabi) to provide dynamic scaling. Some of the supported scenarios:

1. Autoscaling both web and worker roles in Windows Azure by dynamically changing instance counts or performing application throttling.
2. Autoscaling Windows Azure roles based on timetables.
3. Autoscaling Windows Azure roles based on metrics collected from the application and/or Windows Azure but constrained by upper and lower bounds on the instance count per role.
4. Preventing fast oscillations in the number of role instances with the stabilizer. The stabilizer can also help to optimize costs by limiting scaling up operations to the beginning of the hour and scaling down operations to the end of the hour.
5. Monitoring and logging autoscaling activity.
6. Sending notifications to preview any scaling operations before they take place.
7. Encrypting the rules and other configuration in Windows Azure blob storage or in local file storage.
8. Managing the autoscaler configuration by using Windows PowerShell.

A comprehensie sample application (Tailspin Surveys) showcasing all these features is provided (installation instructions are available here). Also, check out the Developer's Guide and the Channel9 video walkthrough.

The block is available as standalone download of binaries, source or via NuGet.

Here are a couple of talks/demos showing Wasabi in action:

• CloudCover Episode on autoscaling

• p&p symposium talk "Windows Azure app scaling to need"

Answer 2

There's a Service Management API, and you can use that to scale your application (from code running in Windows Azure or from code running outside of Windows Azure).

http://msdn.microsoft.com/en-us/library/ee460799.aspx and http://code.msdn.microsoft.com/Release/ProjectReleases.aspx?ProjectName=windowsazuresamples&ReleaseId=3233.