python beautiful soup庫入門安裝教程

更新時間：2021年08月30日 14:31:21 作者：Cachel wood

Beautiful Soup是python的一個庫，最主要的功能是從網(wǎng)頁抓取數(shù)據(jù)。今天通過本文給大家分享python beautiful soup庫入門教程，需要的朋友參考下吧

beautiful soup庫的安裝

pip install beautifulsoup4

beautiful soup庫的理解

beautiful soup庫是解析、遍歷、維護(hù)“標(biāo)簽樹”的功能庫

beautiful soup庫的引用

from bs4 import BeautifulSoup
import bs4

BeautifulSoup類

BeautifulSoup對應(yīng)一個HTML/XML文檔的全部內(nèi)容

回顧demo.html

import requests

r = requests.get("http://python123.io/ws/demo.html")
demo = r.text
print(demo)

<html><head><title>This is a python demo page</title></head>
<body>
<p class="title"><b>The demo python introduces several python courses.</b></p>
<p class="course">Python is a wonderful general-purpose programming language. You can learn Python from novice to professional by tracking the following courses:
<a  class="py1" id="link1">Basic Python</a> and <a  class="py2" id="link2">Advanced Python</a>.</p>
</body></html>

Tag標(biāo)簽

基本元素	說明
Tag	標(biāo)簽，最基本的信息組織單元，分別用<>和</>標(biāo)明開頭和結(jié)尾

import requests
from bs4 import BeautifulSoup
r = requests.get("http://python123.io/ws/demo.html")
demo = r.text
soup = BeautifulSoup(demo,"html.parser")
print(soup.title)
tag = soup.a
print(tag)

<title>This is a python demo page</title>
<a   >Basic Python</a>

任何存在于HTML語法中的標(biāo)簽都可以用soup.訪問獲得。當(dāng)HTML文檔中存在多個相同對應(yīng)內(nèi)容時，soup.返回第一個

Tag的name

基本元素	說明
Name	標(biāo)簽的名字， … 的名字是'p',格式：.name

import requests
from bs4 import BeautifulSoup
r = requests.get("http://python123.io/ws/demo.html")
demo = r.text
soup = BeautifulSoup(demo,"html.parser")
print(soup.a.name)
print(soup.a.parent.name)
print(soup.a.parent.parent.name)

a
p   
body

Tag的attrs（屬性）

基本元素	說明
Attributes	標(biāo)簽的屬性，字典形式組織，格式：.attrs

import requests
from bs4 import BeautifulSoup
r = requests.get("http://python123.io/ws/demo.html")
demo = r.text
soup = BeautifulSoup(demo,"html.parser")
tag = soup.a
print(tag.attrs)
print(tag.attrs['class'])
print(tag.attrs['href'])
print(type(tag.attrs))
print(type(tag))

{'href': 'http://www.icourse163.org/course/BIT-268001', 'class': ['py1'], 'id': 'link1'}
['py1']
http://www.icourse163.org/course/BIT-268001
<class 'dict'>
<class 'bs4.element.Tag'>

Tag的NavigableString

基本元素	說明
NavigableString	標(biāo)簽內(nèi)非屬性字符串，<>…</>中字符串，格式：.string

Tag的Comment

基本元素	說明
Comment	標(biāo)簽內(nèi)字符串的注釋部分，一種特殊的Comment類型

import requests
from bs4 import BeautifulSoup
newsoup = BeautifulSoup("<b><!--This is a comment--></b><p>This is not a comment</p>","html.parser")
print(newsoup.b.string)
print(type(newsoup.b.string))
print(newsoup.p.string)
print(type(newsoup.p.string))

This is a comment
<class 'bs4.element.Comment'>
This is not a comment
<class 'bs4.element.NavigableString'>

HTML基本格式

標(biāo)簽樹的下行遍歷

屬性	說明
.contents	子節(jié)點的列表，將所有兒子結(jié)點存入列表
.children	子節(jié)點的迭代類型，與.contents類似，用于循環(huán)遍歷兒子結(jié)點
.descendents	子孫節(jié)點的迭代類型，包含所有子孫節(jié)點，用于循環(huán)遍歷

BeautifulSoup類型是標(biāo)簽樹的根節(jié)點

import requests
from bs4 import BeautifulSoup
r = requests.get("http://python123.io/ws/demo.html")
demo = r.text

soup = BeautifulSoup(demo,"html.parser")
print(soup.head)
print(soup.head.contents)
print(soup.body.contents)
print(len(soup.body.contents))
print(soup.body.contents[1])

<head><title>This is a python demo page</title></head>
[<title>This is a python demo page</title>]
['\n', <p ><b>The demo python introduces several python courses.</b></p>, '\n', <p >Python 
is a wonderful general-purpose programming language. You can learn Python from novice to professional by tracking the 
following courses:
<a   >Basic Python</a> and <a   >Advanced Python</a>.</p>, '\n']
5
<p ><b>The demo python introduces several python courses.</b></p>

for child in soup.body.children:
	print(child)  #遍歷兒子結(jié)點
for child in soup.body.descendants:
	print(child) #遍歷子孫節(jié)點

標(biāo)簽樹的上行遍歷

屬性	說明
.parent	節(jié)點的父親標(biāo)簽
.parents	節(jié)點先輩標(biāo)簽的迭代類型，用于循環(huán)遍歷先輩節(jié)點

import requests
from bs4 import BeautifulSoup
r = requests.get("http://python123.io/ws/demo.html")
demo = r.text

soup = BeautifulSoup(demo,"html.parser")
print(soup.title.parent)
print(soup.html.parent)

<head><title>This is a python demo page</title></head>
<html><head><title>This is a python demo page</title></head>
<body>
<p ><b>The demo python introduces several python courses.</b></p>
<p >Python is a wonderful general-purpose programming language. You can learn Python from novice to professional by tracking the following courses:
<a   >Basic Python</a> and <a   >Advanced Python</a>.</p>
</body></html>

import requests
from bs4 import BeautifulSoup
r = requests.get("http://python123.io/ws/demo.html")
demo = r.text

soup = BeautifulSoup(demo,"html.parser")
for parent in soup.a.parents:
    if parent is None:
        print(parent)
    else:
        print(parent.name)

p
body      
html      
[document]

標(biāo)簽的平行遍歷

屬性	說明
.next_sibling	返回按照HTML文本順序的下一個平行節(jié)點標(biāo)簽
.previous.sibling	返回按照HTML文本順序的上一個平行節(jié)點標(biāo)簽
.next_siblings	迭代類型，返回按照HTML文本順序的后續(xù)所有平行節(jié)點標(biāo)簽
.previous.siblings	迭代類型，返回按照HTML文本順序的前續(xù)所有平行節(jié)點標(biāo)簽

import requests
from bs4 import BeautifulSoup
r = requests.get("http://python123.io/ws/demo.html")
demo = r.text

soup = BeautifulSoup(demo,"html.parser")
print(soup.a.next_sibling)
print(soup.a.next_sibling.next_sibling)

print(soup.a.previous_sibling)
print(soup.a.previous_sibling.previous_sibling)

print(soup.a.parent)

and 
<a class="py2"  id="link2">Advanced Python</a>
Python is a wonderful general-purpose programming language. You can learn Python from novice to professional by tracking the following courses:

None
<p class="course">Python is a wonderful general-purpose programming language. You can learn Python from novice to professional by tracking the following courses:
<a class="py1"  id="link1">Basic Python</a> and <a class="py2"  id="link2">Advanced Python</a>.</p>

for sibling in soup.a.next_sibling:
	print(sibling)  #遍歷后續(xù)節(jié)點
for sibling in soup.a.previous_sibling:
	print(sibling)  #遍歷前續(xù)節(jié)點

在這里插入圖片描述

bs庫的prettify()方法

import requests
from bs4 import BeautifulSoup
r = requests.get("http://python123.io/ws/demo.html")
demo = r.text

soup = BeautifulSoup(demo,"html.parser")
print(soup.prettify())

<html>
 <head>
  <title>
   This is a python demo page
  </title>
 </head>
 <body>
  <p class="title">
   <b>
    The demo python introduces several python courses.
   </b>
  </p>
  <p class="course">
   Python is a wonderful general-purpose programming language. You can learn Python from novice to professional by tracking the following courses:
    Basic Python
   </a>
   and
   <a class="py2"  id="link2">
    Advanced Python
   </a>
   .
  </p>
 </body>
</html>

.prettify()為HTML文本<>及其內(nèi)容增加更加'\n'
.prettify()可用于標(biāo)簽，方法：.prettify()

bs4庫的編碼

bs4庫將任何HTML輸入都變成utf-8編碼
python 3.x默認(rèn)支持編碼是utf-8,解析無障礙

import requests
from bs4 import BeautifulSoup

soup = BeautifulSoup("<p>中文</p>","html.parser")
print(soup.p.string)

print(soup.p.prettify())

中文

<p>  
 中文
</p>

到此這篇關(guān)于python beautiful soup庫入門安裝教程的文章就介紹到這了,更多相關(guān)python beautiful soup庫入門內(nèi)容請搜索腳本之家以前的文章或繼續(xù)瀏覽下面的相關(guān)文章希望大家以后多多支持腳本之家！

您可能感興趣的文章:

相關(guān)文章

深入理解python中if?__name__?==?‘__main__‘
很多python的文件中會有語句if?__name=='__main__':,一直不太明白,最近查閱了一下資料,現(xiàn)在明白,本文就來深入理解一下,感興趣的可以了解一下
2023-08-08
解決jupyter notebook import error但是命令提示符import正常的問題
這篇文章主要介紹了解決jupyter notebook import error但是命令提示符import正常的問題，具有很好的參考
2020-04-04
基于python實現(xiàn)銀行管理系統(tǒng)
這篇文章主要介紹了基于python實現(xiàn)銀行管理系統(tǒng),文中有非常詳細(xì)的代碼示例,對正在學(xué)習(xí)python項目制作的小伙伴們有很好的幫助,需要的朋友可以參考下
2021-04-04
python區(qū)塊鏈基本原型簡版實現(xiàn)示例
這篇文章主要為大家介紹了python區(qū)塊鏈基本原型簡版實現(xiàn)示例，有需要的朋友可以借鑒參考下，希望能夠有所幫助，祝大家多多進(jìn)步，早日升職加薪
2022-05-05
python3 cmp實現(xiàn)方式
這篇文章主要介紹了python3 cmp實現(xiàn)方式，具有很好的參考價值，希望對大家有所幫助。如有錯誤或未考慮完全的地方，望不吝賜教
2022-02-02
Django正則URL匹配實現(xiàn)流程解析
這篇文章主要介紹了Django正則URL匹配實現(xiàn)流程解析,文中通過示例代碼介紹的非常詳細(xì)，對大家的學(xué)習(xí)或者工作具有一定的參考學(xué)習(xí)價值,需要的朋友可以參考下
2020-11-11
這篇文章主要介紹了python基礎(chǔ)教程之面向?qū)ο蟮囊恍└拍?面向?qū)ο笫且环N代碼組織方式,讓代碼復(fù)用最大化,需要的朋友可以參考下
2014-08-08

Python與C語言分別解決完全平方數(shù)問題

完全平方數(shù)指用一個整數(shù)乘以自己例如1*1.2*2.3*3等依次類推，若一個數(shù)能表示成某個整數(shù)的平方的形式，則稱這個數(shù)為完全平方數(shù)。完全平方數(shù)是非負(fù)數(shù)，而一個完全平方數(shù)的項有倆個，讓我們用程序來練習(xí)一下

2022-03-03

python遍歷數(shù)組的方法小結(jié)

這篇文章主要介紹了python遍歷數(shù)組的方法,實例總結(jié)了兩種Python遍歷數(shù)組的技巧,非常具有實用價值,需要的朋友可以參考下

2015-04-04

Python字典常見操作實例小結(jié)【定義、添加、刪除、遍歷】

這篇文章主要介紹了Python字典常見操作,結(jié)合實例形式總結(jié)分析了Python字典的定義、添加、刪除、遍歷等常見使用技巧與操作注意事項,需要的朋友可以參考下

2019-10-10

欧美bbbwbbbw肥妇,免费乱码人妻系列日韩,一级黄片