能亚马逊自动缩放服务工作，弹性的Map Reduce服务？ [英] Can Amazon Auto Scaling Service work with Elastic Map Reduce Service?

问题描述

由于亚马逊网络服务需要付费，所以只想问问谁曾在它的工作之前，我跳进去的脂肪酶，并确认它的一些知识。

since amazon web service need to pay, so just wanna ask ppl who had worked on it before i jump into it, and confirm some knowledge about it.

问题一： 在亚马逊自动缩放的服务，它说可以放大和缩小实例。 那这意味着什么？

Question one: In Amazon auto scaling service, it says can scale up and down instances. that does this mean?

它意味着改变实例的类型？或可以启动/停止增加/减少实例的基础上的条件下定义？

does it mean changing the type of instance? or can start/stop more/less instance base on the condition define?

问题二： 可与地图自动缩放框架的工作减少？

Question two: can the auto scaling framework work with map reduce?

例如，如果我有一个极端的情况下，我都会有无尽的任务，完成任务将是随时间而变化，并且可能会非常计算密集型的。 所以我可以使用自动缩放的服务来缩放地图降低？

for example, if i have a extreme case, i will have endless tasks, and the time to finish the task will be vary, and might be very computation intensive. so can i use auto scaling service to scale the map reduce?

感谢

推荐答案

重。问题之一：扩大和缩小是指它们可以根据需要添加更多的实例和实例的数量然后可以减小（即虚拟机实例可以关闭）时，他们不再需要

re. question one: "scale up and scale down" means they can add more instances as needed and the number of instances can then be reduced (i.e. virtual machine instances can be shut down) when they're no longer required.

重。问题二：我认为，自动缩放并没有真正意义在地图降低，至少如果你正在考虑的Hadoop：一个背后的Map / Reduce和放大器的主要思路; Hadoop是该数据分割中大量的节点，然后这些节点可以处理的数据是的代码的他们 - 最好是在本地磁盘或至少在另一台机器的紧密（物理）接近。当然，开始一个新的实例是可能的，但是那才有意义，只要你不必复制你要处理到新实例中的数据。希望这个解释是有道理的，你......在任何情况下，请 Amazon的Elastic地图缩小发行，这你想要做什么，至少如果我正确地理解你的问题。

re. question two: I would argue that auto-scaling does not really make sense for map reduce, at least if you're thinking about Hadoop: One of the main ideas behind Map/Reduce & Hadoop is that the data is split up among a lot of nodes and the nodes can then process the data that is close to them - ideally on their local disk or at least on another machine in close (physical) proximity. Starting a new instance would of course be possible, but that makes sense only as long as you do not have to copy the data you want to process over to the new instance. Hope this explanation makes sense to you... In any case, check out Amazon's Elastic Map Reduce offering, which does what you want, at least if I understood your question correctly.

这篇关于能亚马逊自动缩放服务工作，弹性的Map Reduce服务？的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！