What sort of workloads would be appropriate for use on Amazon EC2 Spot Instances?

Question

Amazon just announced "Spot Instances" for their EC2 based infrastructure. I was wondering what sort of workloads would be appropriate for such service?

Spot Instances enable you to bid for unused Amazon EC2 capacity. Instances are charged the Spot Price set by Amazon EC2, which fluctuates periodically depending on the supply of and demand for Spot Instance capacity.

Interesting quote:

The philosophy of JIT is simple: inventory is waste.

---

EDITED:

I wonder if there are applications that could sustain themselves (read: be viable) just by leveraging a large volume of those Spot instances. Think about it: imagine you get 10 instances for the price of 1 on average... of course there wouldn't be guarantees but in the case that no Spot instances are available, a number of "normal" instances could be kicked-of.

Answer 1

Obviously this is for any workload that doesn't need to be real-time.

Let's say on smaller scale, how this could apply to stackoverflow? For example, many badges on this site are not calculated in real-time. There is periodical process that will evaluate eligibility and it doesn't matter whether it runs at 4am or 4pm everyday as long as it runs. Doing it at 4am could be 5 cents cheaper. (obviously they don't use EC2 at all for this)

Larger scale? Search engine over large set of data might need huge computing capacity to build its indexes. If you index new data once a day and it takes 2 hours to index them on hundreds of servers, you can do it overnight and save perhaps thousands of dollars every day.

By spreading workload around the clock helps Amazon maximize utilization of their resources and therefore provide the cheapest prices on the market.

Answer 2

Amazon could only think of these workloads:

• Image and video processing, conversion and rendering
• Scientific research data processing
• Financial modeling and analysis

Spot Instances remind me of "double tariff electricity meters", where you pay less for energy when the demand is less. I think it is a very interesting concept, and quite an unexpected introduction to the cloud, but it will probably be difficult to apply to conventional business problems.