数据采集
文档状态：编辑中....
- 今日音乐
Table of Contents
Intro
1.[lib]I choose bs4 2.[version]python3.x
Object[BeautifulSoup]
构造参数
Encode
输入编码其实可以自动检测,但是不一定准哦,输出指定UTF8
- from_encoding[以文档指定的编码解析]E:from_encoding="iso-8859-8"
- exclude_encodings[排除编码]E: exclude_encodings=["ISO-8859-7"]
Parser
- xml
- lxml[推荐]
- html5lib
- html.parser[内置]
- 差异比较
parse_only
- SoupStrainer对象
- SoupStrainer("TAG_NAME")
- SoupStrainer(id='##')[选择器]
- SoupStrainer(method引用)
Attribute
- soup.tag-------------[获得标签] [属]
- soup.tag['Attr']---[获得键值] [属]
- soup.contents-----[获得.descendants子节点
<html>#</html>] [属] - soup.children------[获得子节点] [属]
- soup.descendants-[获得子孙节点] [属]
- soup.strings-----[文档去标签化] [属]
- soup.stripped_strings---[忽略空行去标签化] [属]
- soup.parent------[父节点NONE] [属]
- soup.original_encoding---[模糊识别编码] [属]
Method
Normal
- soup.prettify([编码默认utf8])[格式化输出] [IO]
- soup.get_text()---[获得文本]
- soup.get_text("character")[tag之间character分割]
- soup.get_text("|", strip=True)[以‘|’分割标签,移除空白]
Search
- soup.new_tag("a", href="url")[增加新标签] [增]
- soup.new_string("string", Comment)[Comment] [添加注释] [增]
- soup.find_all('tag')---[查找.标签] [得到.列表] [查]
- soup.find(id='#')------[查找.定位] [得到.唯一] [查]
- soup.select("tag")[CSS选择器] [直接查找] [查]
- soup.select("tag1 tag2")[CSS选择器] [逐层查找] [tag1 的子孙是tag2皆可] [查]
- soup.select("tag1 > tag2")[CSS选择器] [tag1的儿子tag2] [查]
- soup.select("#tag1 ~ .class")[CSS选择器] [tag1的所有class兄弟] [查]
- soup.select("#tag1 + .class")[CSS选择器] [tag1的紧邻的class兄弟] [查]
- soup.select(".class") [CSS选择器] [所有的class节点] [查]
- soup.select("[class~=some_name]")[CSS选择器] [忘了] [查]
- soup.select("#id") [CSS选择器] [查]
- soup.select("tag#id") [CSS选择器] [查]
- soup.select("#id1，#id2")[CSS选择器] [查]
- soup.select('a[href]')[具有属性] [查]
- soup.select_one("选择器")[返回查找回的第一个] [查]
Traversal
周末放映室
没想到center标签不支持width属性,只能自定义<div>了
