了解如何获取此特定的URL [英] Finding out how to get this specific URL

问题描述

在另一个问题中，用户使用了此url( 1)(其中包含一个数据表)，并以某种方式将代码转换为

In another question a user used this url(1) which contains a data table and somehow converted the code into this url(2) in order to scrape using json and beautiful soup.

我的问题是，您如何获得给定第一个网址的第二个网址呢?

My question is how do you get the second url which is scrape friendly given the first url?

以某种方式获得第二个URL的用户被问到他是如何获得的，已经有一段时间了，他从未回应.这是一个

The user which somehow got the 2nd url was asked how he got it and it has been a while and he never responded..Here is a link to the original thread.

推荐答案

您可以使用Google Chrome开发者工具(以及其他浏览器)来做到这一点.

You can do that by using Google Chrome Developer Tools (and with other browsers as well).

1. 打开 Google Chrome浏览器，然后导航到第一个 URL
2. 打开开发者工具(⌘+选项+ i)
3. 转到"网络"标签
4. 单击"保留日志"和" XHR "(因为它是XMLHttpRequest)
5. 重新加载页面，您会在第二个

1. Open Google Chrome browser and navigate to the first URL
2. Open Developer Tools (⌘ + option + i)
3. Head to "Network" tab
4. Click on "Preserve log" and on "XHR" (since it's an XMLHttpRequest)
5. Reload the page and you'll see the XMLHttpRequest to the second URL

注意:在这种情况下，我猜想它是由XHR加载的，但是我建议下次单击全部"而不是"XHR".您会看到更多结果，并且需要过滤和/或花费更多时间来找到有关此问题的呼叫/请求，但这会更加准确.

Note: In this case I guessed that it was loaded by an XHR but I'd recommend to click "All" instead of "XHR" next time. You'll see more results and you'll need to filter and/or take some more time to find the call/request on the matter, but it'll be more accurate.

这篇关于了解如何获取此特定的URL的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！