Python:您如何使用 Python 从动态 Web 中抓取每日数据? [英] Python: How do you scrape daily data from dynamic web using Python?
本文介绍了Python:您如何使用 Python 从动态 Web 中抓取每日数据?的处理方法,对大家解决问题具有一定的参考价值,需要的朋友们下面随着小编来一起学习吧!
问题描述
以下代码有效,但在 2 月 29 日之后停止.网站返回您输入的日期无效.请重新输入您的搜索",这需要单击确定".我该如何解决这个问题?
The following code works but stops after 29th of Feb. The website returns "you have entered an invalid date. Please re-enter your search", which necessitate clicking on "OK". How do I get around this?
country_search("United States")
time.sleep(2)
date_select = Select(driver.find_element_by_name("dr"))
date_select.select_by_visible_text("Enter date range...") #All Dates
select_economic_news()
#btnModifySearch
for month in range(1,9):
for day in range(1,32):
try:
set_from_month(month)
set_from_date(day)
set_from_year("2020")
set_to_month(month)
set_to_date(day)
set_to_year("2020")
time.sleep(5)
#select_economic_news()
time.sleep(5)
search_now()
time.sleep(8)
export_csv()
modify_search()
time.sleep(5)
#country_remove()
except ElementClickInterceptedException:
break
注销()
推荐答案
也许你可以使用这些函数来计算一个月的天数:
Maybe You can use these function to get count days of month:
import datetime
def get_month_days_count(year: int, month: int) -> int:
date = datetime.datetime(year, month, 1)
while (date + datetime.timedelta(days=1)).month == month:
date = date + datetime.timedelta(days=1)
return date.day
这篇关于Python:您如何使用 Python 从动态 Web 中抓取每日数据?的文章就介绍到这了,希望我们推荐的答案对大家有所帮助,也希望大家多多支持IT屋!
查看全文