PHP實(shí)現(xiàn)抓取百度搜索結(jié)果頁(yè)面【相關(guān)搜索詞】并存儲(chǔ)到txt文件示例
本文實(shí)例講述了PHP實(shí)現(xiàn)抓取百度搜索結(jié)果頁(yè)面【相關(guān)搜索詞】并存儲(chǔ)到txt文件。分享給大家供大家參考，具體如下：
一、百度搜索關(guān)鍵詞【腳本之家】
【腳本之家】搜索鏈接
https://www.baidu.com/s?ie=utf-8&f=8&rsv_bp=0&rsv_idx=1&tn=baidu&wd=%E8%84%9A%E6%9C%AC%E4%B9%8B%E5%AE%B6&rsv_pq=ab33cfeb000086a2&rsv_t=7c65vT3KzHCNfGYOIn%2FDSS%2BOQUiCycaspxWzSOBfkHYpgRIPKMI74WIi8K8&rqlang=cn&rsv_enter=1&rsv_sug3=1
搜索結(jié)果部分源代碼：
<div id="rs"><div class="tt">相關(guān)搜索</div><table cellpadding="0"><tbody><tr><th><a href="/s?wd=%E6%B8%B8%E6%88%8F%E8%84%9A%E6%9C%AC%E4%B8%80%E8%88%AC%E9%83%BD%E5%9C%A8%E5%93%AA%E6%89%BE&rsf=4562&rsp=0&f=1&oq=%E8%84%9A%E6%9C%AC%E4%B9%8B%E5%AE%B6&ie=utf-8&rsv_idx=1&rsv_pq=c1ff4bdb000208b4&rsv_t=a1f2OCsgS6vkkBcxsdqfBfehkXoR65%2FtFlpSI30%2F%2FMmk6jQJEukZbv30XaM&rqlang=cn&rs_src=0&rsv_pq=c1ff4bdb000208b4&rsv_t=a1f2OCsgS6vkkBcxsdqfBfehkXoR65%2FtFlpSI30%2F%2FMmk6jQJEukZbv30XaM" rel="external nofollow" >游戲腳本一般都在哪找</a></th><td></td><th><a href="/s?wd=%E8%84%9A%E6%9C%AC%E6%80%8E%E4%B9%88%E5%86%99&rsf=4562&rsp=1&f=1&oq=%E8%84%9A%E6%9C%AC%E4%B9%8B%E5%AE%B6&ie=utf-8&rsv_idx=1&rsv_pq=c1ff4bdb000208b4&rsv_t=a1f2OCsgS6vkkBcxsdqfBfehkXoR65%2FtFlpSI30%2F%2FMmk6jQJEukZbv30XaM&rqlang=cn&rs_src=0&rsv_pq=c1ff4bdb000208b4&rsv_t=a1f2OCsgS6vkkBcxsdqfBfehkXoR65%2FtFlpSI30%2F%2FMmk6jQJEukZbv30XaM" rel="external nofollow" >腳本怎么寫(xiě)</a></th><td></td><th><a href="/s?wd=%E8%84%9A%E6%9C%AC%E6%98%AF%E4%BB%80%E4%B9%88%E6%84%8F%E6%80%9D&rsf=4562&rsp=2&f=1&oq=%E8%84%9A%E6%9C%AC%E4%B9%8B%E5%AE%B6&ie=utf-8&rsv_idx=1&rsv_pq=c1ff4bdb000208b4&rsv_t=a1f2OCsgS6vkkBcxsdqfBfehkXoR65%2FtFlpSI30%2F%2FMmk6jQJEukZbv30XaM&rqlang=cn&rs_src=0&rsv_pq=c1ff4bdb000208b4&rsv_t=a1f2OCsgS6vkkBcxsdqfBfehkXoR65%2FtFlpSI30%2F%2FMmk6jQJEukZbv30XaM" rel="external nofollow" >腳本是什么意思</a></th></tr><tr><th><a href="/s?wd=%E8%84%9A%E6%9C%AC%E4%B9%8B%E5%AE%B6app&rsf=4562&rsp=3&f=1&oq=%E8%84%9A%E6%9C%AC%E4%B9%8B%E5%AE%B6&ie=utf-8&rsv_idx=1&rsv_pq=c1ff4bdb000208b4&rsv_t=a1f2OCsgS6vkkBcxsdqfBfehkXoR65%2FtFlpSI30%2F%2FMmk6jQJEukZbv30XaM&rqlang=cn&rs_src=0&rsv_pq=c1ff4bdb000208b4&rsv_t=a1f2OCsgS6vkkBcxsdqfBfehkXoR65%2FtFlpSI30%2F%2FMmk6jQJEukZbv30XaM" rel="external nofollow" >腳本之家app</a></th><td></td><th><a href="/s?wd=%E6%89%8B%E6%9C%BA%E8%84%9A%E6%9C%AC%E5%88%B6%E4%BD%9C&rsf=4562&rsp=4&f=1&oq=%E8%84%9A%E6%9C%AC%E4%B9%8B%E5%AE%B6&ie=utf-8&rsv_idx=1&rsv_pq=c1ff4bdb000208b4&rsv_t=a1f2OCsgS6vkkBcxsdqfBfehkXoR65%2FtFlpSI30%2F%2FMmk6jQJEukZbv30XaM&rqlang=cn&rs_src=0&rsv_pq=c1ff4bdb000208b4&rsv_t=a1f2OCsgS6vkkBcxsdqfBfehkXoR65%2FtFlpSI30%2F%2FMmk6jQJEukZbv30XaM" rel="external nofollow" >手機(jī)腳本制作</a></th><td></td><th><a href="/s?wd=%E6%89%8B%E6%9C%BA%E8%84%9A%E6%9C%AC%E5%A4%A7%E5%85%A8&rsf=4562&rsp=5&f=1&oq=%E8%84%9A%E6%9C%AC%E4%B9%8B%E5%AE%B6&ie=utf-8&rsv_idx=1&rsv_pq=c1ff4bdb000208b4&rsv_t=a1f2OCsgS6vkkBcxsdqfBfehkXoR65%2FtFlpSI30%2F%2FMmk6jQJEukZbv30XaM&rqlang=cn&rs_src=0&rsv_pq=c1ff4bdb000208b4&rsv_t=a1f2OCsgS6vkkBcxsdqfBfehkXoR65%2FtFlpSI30%2F%2FMmk6jQJEukZbv30XaM" rel="external nofollow" >手機(jī)腳本大全</a></th></tr><tr><th><a href="/s?wd=%E8%84%9A%E6%9C%AC%E6%B8%B8%E6%88%8F%E5%88%B6%E4%BD%9C%E5%A4%A7%E5%B8%88&rsf=4562&rsp=6&f=1&oq=%E8%84%9A%E6%9C%AC%E4%B9%8B%E5%AE%B6&ie=utf-8&rsv_idx=1&rsv_pq=c1ff4bdb000208b4&rsv_t=a1f2OCsgS6vkkBcxsdqfBfehkXoR65%2FtFlpSI30%2F%2FMmk6jQJEukZbv30XaM&rqlang=cn&rs_src=0&rsv_pq=c1ff4bdb000208b4&rsv_t=a1f2OCsgS6vkkBcxsdqfBfehkXoR65%2FtFlpSI30%2F%2FMmk6jQJEukZbv30XaM" rel="external nofollow" >腳本游戲制作大師</a></th><td></td><th><a href="/s?wd=%E6%B8%B8%E6%88%8F%E8%84%9A%E6%9C%AC%E5%88%B6%E4%BD%9C%E6%95%99%E7%A8%8B&rsf=4562&rsp=7&f=1&oq=%E8%84%9A%E6%9C%AC%E4%B9%8B%E5%AE%B6&ie=utf-8&rsv_idx=1&rsv_pq=c1ff4bdb000208b4&rsv_t=a1f2OCsgS6vkkBcxsdqfBfehkXoR65%2FtFlpSI30%2F%2FMmk6jQJEukZbv30XaM&rqlang=cn&rs_src=0&rsv_pq=c1ff4bdb000208b4&rsv_t=a1f2OCsgS6vkkBcxsdqfBfehkXoR65%2FtFlpSI30%2F%2FMmk6jQJEukZbv30XaM" rel="external nofollow" >游戲腳本制作教程</a></th><td></td><th><a href="/s?wd=%E8%84%9A%E6%9C%AC%E7%B2%BE%E7%81%B5&rsf=4562&rsp=8&f=1&oq=%E8%84%9A%E6%9C%AC%E4%B9%8B%E5%AE%B6&ie=utf-8&rsv_idx=1&rsv_pq=c1ff4bdb000208b4&rsv_t=a1f2OCsgS6vkkBcxsdqfBfehkXoR65%2FtFlpSI30%2F%2FMmk6jQJEukZbv30XaM&rqlang=cn&rs_src=0&rsv_pq=c1ff4bdb000208b4&rsv_t=a1f2OCsgS6vkkBcxsdqfBfehkXoR65%2FtFlpSI30%2F%2FMmk6jQJEukZbv30XaM" rel="external nofollow" >腳本精靈</a></th></tr></tbody></table></div>
二、抓取并保存本地
源代碼
index.php：
<form action="index.php" method="post">
<input name="q" type="text" />
<input type="submit" value="Get Keywords" />
</form>
<?php
header('Content-Type:text/html;charset=gbk');
class ComBaike{
private $o_String=NULL;
public function __construct(){
include('cls.StringEx.php');
$this->o_String=new StringEx();
}
public function getItem($word){
$url = "http://www.baidu.com/s?wd=".$word;
// 構(gòu)造包頭，模擬瀏覽器請(qǐng)求
$header = array (
"Host:www.baidu.com",
"Content-Type:application/x-www-form-urlencoded",//post請(qǐng)求
"Connection: keep-alive",
'Referer:http://www.baidu.com',
'User-Agent: Mozilla/5.0 (compatible; MSIE 9.0; Windows NT 6.1; WOW64; Trident/5.0; BIDUBrowser 2.6)'
);
$ch = curl_init ();
curl_setopt ( $ch, CURLOPT_URL, $url );
curl_setopt ( $ch, CURLOPT_HTTPHEADER, $header );
curl_setopt ( $ch, CURLOPT_RETURNTRANSFER, 1 );
$content = curl_exec ( $ch );
if ($content == FALSE) {
echo "error:" . curl_error ( $ch );
}
curl_close ( $ch );
//輸出結(jié)果echo $content;
$this->o_String->string=$content;
$s_begin='<div id="rs">';
$s_end='</div>';
$summary=$this->o_String->getPart($s_begin,$s_end);
$s_begin='<div class="tt">相關(guān)搜索</div><table cellpadding="0"><tr><th>';
$s_end='</th></tr></table></div>';
$content=$this->o_String->getPart($s_begin,$s_end);
return $content;
}
public function __destruct(){
unset($this->o_String);
}
}
if($_POST){
$com = new ComBaike();
$q = $_POST['q'];
$str = $com->getItem($q); //獲取搜索內(nèi)容
$pat = '/<a(.*?)href="(.*?)" rel="external nofollow" (.*?)>(.*?)<\/a>/i';
preg_match_all($pat, $str, $m);
//print_r($m[4]); 鏈接文字
$con = implode(",", $m[4]);
//生成文件夾
$dates = date("Ymd");
$path="./Search/".$dates."/";
if(!is_dir($path)){
mkdir($path,0777,true);
}
//生成文件
$file = fopen($path.iconv("UTF-8","GBK",$q).".txt",'w');
if(fwrite($file,$con)){
echo $con;
echo '<script>alert("success")</script>';
}else{
echo '<script>alert("error")</script>';
}
fclose($file);
}
?>
cls.StringEx.php：
<?php
header('Content-Type: text/html; charset=UTF-8');
class StringEx{
public $string='';
public function __construct($string=''){
$this->string=$string;
}
public function pregGetPart($s_begin,$s_end){
$s_begin==preg_quote($s_begin);
$s_begin=str_replace('/','\/',$s_begin);
$s_end=preg_quote($s_end);
$s_end=str_replace('/','\/',$s_end);
$pattern='/'.$s_begin.'(.*?)'.$s_end.'/';
$result=preg_match($pattern,$this->string,$a_match);
if(!$result){
return $result;
}else{
return isset($a_match[1])?$a_match[1]:'';
}
}
public function strstrGetPart($s_begin,$s_end){
$string=strstr($this->string,$s_begin);
$string=strstr($string,$s_end,true);
$string=str_replace($s_begin,'',$string);
$string=str_replace($s_end,'',$string);
return $string;
}
public function getPart($s_begin,$s_end){
$result=$this->pregGetPart($s_begin,$s_end);
if(!$result){
$result=$this->strstrGetPart($s_begin,$s_end);
}
return $result;
}
}
?>
更多關(guān)于PHP相關(guān)內(nèi)容感興趣的讀者可查看本站專(zhuān)題：《php curl用法總結(jié)》、《PHP網(wǎng)絡(luò)編程技巧總結(jié)》、《PHP數(shù)組(Array)操作技巧大全》、《php字符串(string)用法總結(jié)》、《PHP數(shù)據(jù)結(jié)構(gòu)與算法教程》及《PHP中json格式數(shù)據(jù)操作技巧匯總》
希望本文所述對(duì)大家PHP程序設(shè)計(jì)有所幫助。
- 利用PHP抓取百度閱讀的方法示例
- PHP網(wǎng)頁(yè)抓取之抓取百度貼吧郵箱數(shù)據(jù)代碼分享
- php下通過(guò)curl抓取yahoo boss 搜索結(jié)果的實(shí)現(xiàn)代碼
- PHP抓取淘寶商品的用戶(hù)曬單評(píng)論+圖片+搜索商品列表實(shí)例
- PHP統(tǒng)計(jì)nginx訪(fǎng)問(wèn)日志中的搜索引擎抓取404鏈接頁(yè)面路徑
- PHP實(shí)現(xiàn)采集抓取淘寶網(wǎng)單個(gè)商品信息
- PHP的cURL庫(kù)功能簡(jiǎn)介 抓取網(wǎng)頁(yè)、POST數(shù)據(jù)及其他
相關(guān)文章
php set_time_limit(0) 設(shè)置程序執(zhí)行時(shí)間的函數(shù)
一個(gè)簡(jiǎn)單的例子，在網(wǎng)頁(yè)里顯示1500條語(yǔ)句，如果未設(shè)置失效時(shí)間，則程序執(zhí)行到791時(shí)結(jié)束了，如果把 set_time_limit(0); 前的注釋符//去除，則程序直到1才結(jié)束。2010-05-05
解決php的“It is not safe to rely on the system’s timezone setti
這篇文章主要介紹了解決php的“It is not safe to rely on the system’s timezone settings”問(wèn)題的方法，需要的朋友可以參考下2015-10-10
PHP函數(shù)strip_tags的一個(gè)bug淺析
PHP 函數(shù) strip_tags 提供了從字符串中去除 HTML 和 PHP 標(biāo)記的功能，該函數(shù)嘗試返回給定的字符串 str 去除空字符、HTML 和 PHP 標(biāo)記后的結(jié)果。2014-05-05
這篇文章主要介紹了php修改指定文件后綴的方法,文中的函數(shù)foreachDir可實(shí)現(xiàn)文件目錄的檢測(cè)、讀取、打開(kāi)及文件后綴替換等功能,是非常實(shí)用的技巧,需要的朋友可以參考下2014-09-09
解析PHP的Yii框架中cookie和session功能的相關(guān)操作
這篇文章主要介紹了PHP的Yii框架中cookie和session功能的相關(guān)操作,需要的朋友可以參考下2016-03-03
PHP簡(jiǎn)單選擇排序（Simple Selection Sort）算法學(xué)習(xí)
這篇文章主要為大家詳細(xì)介紹了PHP簡(jiǎn)單選擇排序（Simple Selection Sort）算法，具有一定的參考價(jià)值，感興趣的小伙伴們可以參考一下2018-01-01
本篇文章是對(duì)eAccelerator的安裝與使用進(jìn)行了詳細(xì)的分析介紹，需要的朋友參考下2013-06-06
PHP提示Cannot modify header information - headers already sent
這篇文章主要介紹了PHP提示Cannot modify header information - headers already sent by解決方法,是在PHP程序開(kāi)發(fā)中非常典型的錯(cuò)誤情況,非常具有實(shí)用價(jià)值,需要的朋友可以參考下2014-09-09
在登錄的時(shí)候記住用戶(hù)輸入的密碼在某些情況下是很有必要的，下面是一個(gè)小例子，感興趣的朋友可以參考下哈，希望對(duì)你有所幫助2013-05-05
眾所周知php原生函數(shù)substr是不支持截取中文字符串的。下面的代碼提供了多種截取php中文字符串的方法。2011-07-07