AWS Glue 定价与 AWS EMR [英] AWS Glue pricing against AWS EMR

查看:72
本文介绍了AWS Glue 定价与 AWS EMR的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!

问题描述

我正在 AWS Glue 与 AWS EMR 之间进行一些定价比较,以便在 EMR 和胶水.

I am doing some pricing comparison between AWS Glue against AWS EMR so as to chose between EMR & Glue.

我考虑过 6 个 DPU(4 个 vCPU + 16 GB 内存),其中 ETL 作业运行 10 分钟,持续 30 天.假设抓取工具的预期请求比免费层级高 100 万个,对于 100 万个额外请求,按 1 美元计算.

I have considered 6 DPUs (4 vCPUs + 16 GB Memory) with ETL Job running for 10 minutes for 30 days. Expected crawler requests is assumed to be 1 million above free tier and is calculated at $1 for the 1 million additional requests.

在 EMR 上,我已考虑将 m3.xlarge 用于 EC2 和EMR(价格分别为 0.266 美元和 0.070 美元),有 6 个节点,运行 10 分钟,持续 30 天.

On EMR I have considered m3.xlarge for both EC2 & EMR (pricing at $0.266 & $0.070 respectively) with 6 nodes, running for 10 minutes for 30 days.

计算一个月后,我发现 AWS Glue 的计算结果约为 14.64 美元,而 EMR 的计算结果约为 10.08 美元.我没有考虑其他额外的费用,比如S3、RDS、Redshift等&DEV Endpoint 是可选的,因为我的目标是比较 ETL 作业价格优势

On calculating for a month, I see that AWS Glue works out to be around $14.64, whereas for EMR it works out to be around $10.08. I have not taken into account other additional expenses such as S3, RDS, Redshift, etc. & DEV Endpoint which is optional, since my objective is to compare ETL job price benefits

与 AWS Glue 相比,EMR 看起来更便宜.EMR 定价是否正确,如果有任何遗漏,有人可以提出建议吗?我已经尝试过 EMR 的 AWS 价格计算器,但很困惑,并且不清楚是否将标准化的工时计入其中.

Looks like EMR is cheaper when compared to AWS Glue. Is the EMR pricing correct, can someone please suggest if anything missing? I have tried the AWS price calculator for EMR, but confused, and not clear if normalized hours are billed into it.

问候

尤瓦

推荐答案

是的,EMR 确实比 Glue 便宜,这是因为 Glue 是无服务器的并且完全由 AWS 管理,因此用户不需要不必担心在幕后运行的基础设施,但 EMR 需要进行大量配置才能设置.因此,这是用户友好性和成本之间的权衡,对于技术性更强的用户来说,EMR 可能是更好的选择.

Yes, EMR does work out to be cheaper than Glue, and this is because Glue is meant to be serverless and fully managed by AWS, so the user doesn't have to worry about the infrastructure running behind the scenes, but EMR requires a whole lot of configuration to set up. So it's a trade off between user friendliness and cost, and for more technical users EMR can be the better option.

这篇关于AWS Glue 定价与 AWS EMR的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!

查看全文
登录 关闭
扫码关注1秒登录
发送“验证码”获取 | 15天全站免登陆