使用自定义资源Lambda运行Crawler [英] Run Crawler using custom resource Lambda

问题描述

我正在尝试使用云形成来创建和调用AWS Glue搜寻器.爬网程序的创建部分(以动态DB为目标)在lambda函数中.

I am trying to create and invoke an AWS Glue crawler using cloud formation. The creation part of the crawler(dynamo DB as target) is in lambda function.

如何使用云形成来实现所有这些目标?即从s3中存在的cod创建lambda函数，创建lambda函数后，应该触发它来创建搜寻器，然后应该调用搜寻器来创建targted表.我希望所有这些都是云的形成.

how can I achieve all this using cloud formation? i.e creation of lambda function from cod present in s3 , After lambda function is created, it should get triggered to create crawler and then crawler should be invoked to create targted tables. I want all of this is cloud formation.

链接以供参考:是从CloudFormation模板创建时可能触发lambda

推荐答案

您应该编写cloudformation来部署搜寻器.然后在您的ci/cd中，编写shell/python脚本，以在通过cloudformation部署爬虫之后运行爬虫.

You should write cloudformation to deploy crawler. And then in your ci/cd, write shell/python script to run crawler after it is deployed through cloudformation.

这篇关于使用自定义资源Lambda运行Crawler的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！