Too Long; Didn't Read
AWS announced in the summer of 2019 that SageMaker can manage Spot instances without needing additional tooling. Spot instances are Amazon's unused cloud computing capacity. They are the exact same as On-Demand EC2 instances in terms of capabilities and infrastructure, except that AWS can reclaim the Spot instance and sell it back to On-demand customers when necessary. How much of a discount and how frequently the Spot instances is interrupted can depend on the instance type and Availability Zone. For example, a Spot p3.16xlarge in the US East, Ohio AZ costs 70% less than EC2 and is interrupted by Amazon less than 5% of the time.