我知道一点 Grep，但我无法决定让它在这里工作，也有人告诉我使用 Awk，它似乎最适合这种任务.
感谢您的帮助.
非常感谢.
第一行匹配项目标题行.s/// 命令只捕获
行.s/// 删除前导空格；G 在换行符之后将保持空间附加到模式空间；s///p 捕获换行符之前的部分(描述)和换行符之后的部分(来自保持空间的标题)，并用标题和描述替换它们，用一个分隔符分隔分号，并打印结果.
组件之前、中间和之后的任意空白序列.对其他正则表达式重复令人作呕的事情.您可以安排单词之间有一个空格.您可以将多行描述安排为一行打印一次，而不是像现在这样单独打印每个线段.
您也可以将整个结构包装在里面的文件中:
/^$/,/^
$/{…脚本和以前一样…}
您可以重复这个想法，以便仅在 <div class="item"> 和 </div> 等中选取项目标题.
I'm trying to make a Bash script to extract results from an HTML page.
I achieved to get the content of the page with Curl, but the next step is parsing the output, which is problematic.
The interesting content of the page looks like this:
<div class="result">
...
<div class="item">
<div class="item_title">ITEM 1</div>
</div>
...
<div class="item_desc">
ITEM DESCRIPTION 1
</div>
...
</div>
<div class="result">
...
<div class="item">
<div class="item_title">ITEM 2</div>
</div>
...
<div class="item_desc">
ITEM DESCRIPTION 2
</div>
...
</div>
I'd like to output something like:
ITEM1;ITEM DESCRIPTION 1
ITEM2;ITEM DESCRIPTION 2
I know a bit of Grep, but I can't wrap my mind about making it to work here, also some people told me to use Awk, which seems best suited for this kind of task.
I'd appreciate any help.
Thank you very much.
解决方案
A bare minimal program to handle the HTML, loosely, with no validation, and easily confused by variations in the HTML, is:
sed.script
/ *<div class="item_title">(.*)</div>/ { s//1/; h; }
/ *<div class="item_desc">/,/</div>/ {
/<div class="item_desc">/d
/</div>/d
s/^ *//
G
s/(.*)
(.*)/2;1/p
}
The first line matches item title lines. The s/// command captures just the part between the <div …> and </div>; the h copies that into the hold space (memory).
The rest of the script matches lines between the item description <div> and its </div>. The first two lines delete (ignore) the <div> and </div> lines. The s/// removes leading spaces; the G appends the hold space to the pattern space after a newline; the s///p captures the part before the newline (the description) and the part after the newline (the title from the hold space), and replaces them with the title and description, separated by a semi-colon, and prints the result.
Example
$ sed -n -f sed.script items.html
ITEM 1;ITEM DESCRIPTION 1
ITEM 2;ITEM DESCRIPTION 2
$
Note the -n; that means "don't print unless told to do so".
You can do it without a script file, but there's less to worry about if you use one. You can probably even squeeze it all onto one line if you're careful. Beware that the ; after the h is necessary with BSD sed and harmless but not crucial with GNU sed.
Modification
There are all sorts of ways to make it more nearly bullet-proof (but it is debatable whether they're worthwhile). For example:
/ *<div class="item_title">(.*)</div>/
could be revised to:
/^[[:space:]]*<div class="item_title">[[:space:]]*(.*)[[:space:]]*</div>[[:space:]]*$/
to deal with arbitrary sequences of white space before, in the middle, and after the <div> components. Repeat ad nauseam for the other regexes. You could arrange to have single spaces between words. You could arrange for a multi-line description to be printed just once as a single line, rather than each line segment being printed separately as it would be now.
You could also wrap the whole construct in the file inside:
/^<div class="result">$/,/^</div>$/ {
…script as before…
}
And you could repeat that idea so that the item title is only picked inside <div class="item"> and </div>, etc.
这篇关于使用 AWK/Grep/Bash 从 HTML 中提取数据的文章就介绍到这了，希望我们推荐的答案对大家有所帮助，也希望大家多多支持IT屋！
