重度iTunes Connect抓取 [英] heavy iTunes Connect scraping

查看:135
本文介绍了重度iTunes Connect抓取的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!

问题描述

我正在寻找不同的选择,以从iTunes Connect网站获取销售报告和其他数据.由于Apple不提供API,因此我找到的所有解决方案都基于抓取页面.

I'm looking at different options to get the sales reports and other data out of the iTunes Connect website. Since Apple doesn't provide an API, all the solutions I found are based on scraping the page.

由于我需要我们提供的产品的信息,所以我不愿意将所有iTunes帐户都提供给第三方服务.这就是为什么我要自己刮或使用在我们的服务器上运行的产品的原因.

As I need the information for a product that we offer, I'm not that happy to give all the iTunes accounts to a 3rd party service. This is why I want to scrape it myself or use a product that runs on our servers.

我的问题是:

  • 有人经历过苹果多久更改一次网络前端吗?
  • 有人从一台服务器到站点的最大请求经历了吗?我怕被苹果取缔.
  • 我还有其他需要引起严重麻烦的事情吗?

只要有人对我看过的工具感兴趣,下面是列表:

Just if someone is interested in the tools I looked at, here is a list:

服务:

  • http://www.appfigures.com (has API)
  • http://www.itunesapis.com
  • http://www.appannie.com/
  • http://www.heartbeatapp.com

产品:

  • http://www.appclix.com (has a enterprise licence that runs on your own server, includes API. Tends to me more a mobile analytics tool in general)
  • http://www.ideaswarm.com/products/appviz/ (Mac enduser app)

开源工具:

  • http://code.google.com/p/appdailysales/
  • http://metacpan.org/pod/WWW::iTunesConnect
  • http://www.rogueamoeba.com/utm/2009/05/04/itunesconnectarchiver/
  • http://github.com/kasatani/iphone-stats
  • http://bfoz.net/projects/itc/
  • http://sourceforge.net/projects/itunesanalytics/

更新:

我开始使用Kirby的python脚本( https://github.com/kirbyt/appdailysales )和效果很好.

I started using Kirby's python script (https://github.com/kirbyt/appdailysales) and it works very well.

推荐答案

有人体验过苹果多久更换一次网络前端吗?

does someone have experience how frequent apple is changing the web front-end?

我不能代表所有iTunes Connect,只能下载每日销售报告.我的脚本非常稳定,在2009年11月至2010年9月之间不需要进行任何更改.在Apple于2010年9月推出新网站时,这一更改便有所变化.这打破了旧的脚本,必须编写一个新的脚本.自推出新网站以来,我每隔几天进行更改,以应对Apple的调整.我希望这些调整能很快结束.

I can't speak for all of iTunes Connect, only downloading daily sales reports. My script was rock solid and didn't require a single change between November 2009 and September 2010. This changed in September 2010 when Apple rolled out the new web site. This broke the old script, and a new one had to be written. Since rolling out the new web site, I make changes every few days to handle the tweaks from Apple. I'm hoping the tweaks will end soon.

查看appdailysales.py的下载页面.这些日期将使您大致了解我对脚本进行更改的频率.

Take a look at the download page for appdailysales.py. The dates will give you a general idea of how often I make changes to the script.

https://github.com/kirbyt/appdailysales

同样,这仅用于每日销售报告.我不确定iTC的其他领域会多久更改一次.

Again, this is only for daily sales reports. I'm not sure how frequently others areas of iTC change.

有人从一台服务器到站点的最大请求经历了吗?我怕被苹果取缔.

has someone experience in maximum request from one server to the site? I'm afraid of being baned by apple.

我还没有经历过,但是我的服务器每天只运行一次脚本.在处理脚本时,我经常会碰到iTC,但不足以在Apple的服务器上造成负担.

I've not experienced this, but my server runs the script only once a day. I frequently hit the iTC when working on the script, but not enough to cause a load on Apple's servers.

我还有其他需要引起严重麻烦的事情吗?

anything else I have to have in mind that will cause serious trouble?

我不知道是什么让您遇到与苹果有关的麻烦,但确实引起严重头痛的一件事是网站的更改.该网站的新版本使屏幕抓取该网站更加容易,但确实需要编写一个新脚本. Apple不会提醒您他们正在更改某些内容.您可以在屏幕刮板发生故障时查明事实.

I don't know what might get you in trouble with Apple, but one thing that does cause a serious headache is changes to the web site. While the new version of the web site makes screen scraping the site easier, it did involve writing a new script. Apple does not give you a heads up that they are changing something. You find out after the fact when something in your screen scraper breaks.

如果每天都要依赖数据,则必须删除所有内容并进行必要的修复.没有任何阻止苹果在将来某个时候推出另一个新站点的事情.

If you depend on the data daily, then you have to drop everything and make the necessary fixes. And there is nothing stopping Apple from rolling out another new site sometime in the future.

希望有帮助.

-基尔比

这篇关于重度iTunes Connect抓取的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!

查看全文
登录 关闭
扫码关注1秒登录
发送“验证码”获取 | 15天全站免登陆