淘寶IP地址庫(kù)采集器c#代碼
采集器概貌,如下:
最近做一個(gè)項(xiàng)目,功能類似于CNZZ站長(zhǎng)統(tǒng)計(jì)功能，要求顯示Ip所在的省份市區(qū)/提供商等信息。網(wǎng)上的Ip純真數(shù)據(jù)庫(kù)，下載下來(lái)一看，發(fā)現(xiàn)沒(méi)提供商內(nèi)容，省市區(qū)都很少，居然有XXX網(wǎng)吧，哥瞬間倒了。沒(méi)標(biāo)準(zhǔn)化、并且雜亂、還不連續(xù)的IP段、總體說(shuō)來(lái)沒(méi)達(dá)到要求。
在百度上找啊找，找到淘寶Ip地址庫(kù)，官方介紹的準(zhǔn)確率高，數(shù)據(jù)質(zhì)量有保障，提供國(guó)家、省、市、縣、運(yùn)營(yíng)商全方位信息，信息維度廣，格式規(guī)范，但是限制每秒10次的訪問(wèn)（這個(gè)比較無(wú)語(yǔ)）。
接口說(shuō)明
1. 請(qǐng)求接口（GET）：
http://ip.taobao.com/service/getIpInfo.php?ip=[ip地址字串]
2. 響應(yīng)信息：
（json格式的）國(guó)家 、?。ㄗ灾螀^(qū)或直轄市）、市（縣）、運(yùn)營(yíng)商
3. 返回?cái)?shù)據(jù)格式：
{"code":0,"data":{"ip":"210.75.225.254","country":"\u4e2d\u56fd","area":"\u534e\u5317",
"region":"\u5317\u4eac\u5e02","city":"\u5317\u4eac\u5e02","county":"","isp":"\u7535\u4fe1",
"country_id":"86","area_id":"100000","region_id":"110000","city_id":"110000",
"county_id":"-1","isp_id":"100017"}}
其中code的值的含義為，0：成功，1：失敗。
1 ：IP轉(zhuǎn)換
準(zhǔn)備好工具,后面就好弄啦, IPHelper提供了各種,IP<->byte[]<->Long 轉(zhuǎn)換
public class IPHelper
{
/// <summary>
/// ip轉(zhuǎn)成long
/// </summary>
/// <param name="ip"></param>
/// <returns></returns>
public static long Ip2Long(string ip)
{
byte[] bytes = Ip2Bytes(ip);
return Bytes2Long(bytes);
}
/// <summary>
/// long轉(zhuǎn)成ip
/// </summary>
/// <param name="ipLong"></param>
/// <returns></returns>
public static string Long2Ip(long ipLong)
{
byte[] bytes = Long2Bytes(ipLong);
return Bytes2Ip(bytes);
}
/// <summary>
/// long轉(zhuǎn)成byte[]
/// </summary>
/// <param name="ipvalue"></param>
/// <returns></returns>
public static byte[] Long2Bytes(long ipvalue)
{
byte[] b = new byte[4];
for (int i = 0; i < 4; i++)
{
b[3 - i] = (byte)(ipvalue >> 8 * i & 255);
}
return b;
}
/// <summary>
/// byte[]轉(zhuǎn)成long
/// </summary>
/// <param name="bt"></param>
/// <returns></returns>
public static long Bytes2Long(byte[] bt)
{
int x = 3;
long o = 0;
foreach (byte f in bt)
{
o += (long)f << 8 * x--;
}
return o;
}
/// <summary>
/// ip轉(zhuǎn)成byte[]
/// </summary>
/// <param name="ip"></param>
/// <returns></returns>
public static byte[] Ip2Bytes(string ip)
{
string[] sp = ip.Split('.');
return new byte[] { Convert.ToByte(sp[0]), Convert.ToByte(sp[1]), Convert.ToByte(sp[2]), Convert.ToByte(sp[3]) };
}
/// <summary>
/// byte[]轉(zhuǎn)成ip
/// </summary>
/// <param name="bytes"></param>
/// <returns></returns>
public static string Bytes2Ip(byte[] bytes)
{
return string.Format("{0}.{1}.{2}.{3}"
, bytes[0]
, bytes[1]
, bytes[2]
, bytes[3]);
}
}
2 ：多線程瘋狂獲取IP
/// <summary>
/// 描述:開始采集
/// </summary>
private void StratCollect()
{
foreach (Thread thread in ThreadList)
{
thread.Start();
}
}
/// <summary>
/// 描述:獲取要采集的ip long
/// </summary>
private long GetCurrentIp()
{
long curip = System.Threading.Interlocked.Increment(ref CurrentCollectIP);
return curip;
}
/// <summary>
/// 線程中采集的方法
/// </summary>
private void GetTaobaoData()
{
long currentipLong = GetCurrentIp();
while (currentipLong <= EndIP)
{
try
{
CaptureTaobaoIPData(currentipLong);
}
catch (Exception ex)
{
TextLog.SetString(currentipLong + ex.Message);
}
currentipLong = GetCurrentIp();
}
}
/// <summary>
/// 描述:線程中采集并得到IP
/// </summary>
private void CaptureTaobaoIPData(long currentipLong)
{
string ip = IPHelper.Long2Ip(currentipLong);
string url = string.Format(UrlFomat, ip);
string js =HttpHelper. HttpRequest(url, Encoding.UTF8);
taobaoIPdata m = Newtonsoft.Json.JsonConvert.DeserializeObject<TaobaoJsonData>(js).data;
m.ipLong = currentipLong;
//更新界面
this.Invoke(new Action<taobaoIPdata>(v =>
{
taobaoIPdataList.Add(v);
this.dgv.DataSource = taobaoIPdataList;
}), m);
}
3： Http請(qǐng)求的Json結(jié)果，并反序列化成對(duì)象
http請(qǐng)求這個(gè)相當(dāng)簡(jiǎn)單。網(wǎng)上一大把，這里主要說(shuō)一下json序列化，在這里本人建議采用Newtonsoft.Json.dll 下載地址： http://json.codeplex.com/ 性能和兼容性達(dá)到最好
Http請(qǐng)求
public class HttpHelper
{
public static string HttpRequest(string url, Encoding encoding)
{
try
{
HttpWebRequest request = (HttpWebRequest)WebRequest.Create(url);
request.Timeout = 6 * 1000;
request.Method = "GET";
//得到處理結(jié)果
HttpWebResponse response = (HttpWebResponse)request.GetResponse();
Stream myResponseStream = response.GetResponseStream();
StreamReader myStreamReader = new StreamReader(myResponseStream, encoding);
string result = myStreamReader.ReadToEnd();
return result;
}
catch (Exception ex)
{
throw ex;
}
}
}
Json序列化
taobaoIPdata m = Newtonsoft.Json.JsonConvert.DeserializeObject<TaobaoJsonData>(js).data;
序列號(hào)對(duì)象taobaoIPdata
/// <summary>
/// 淘寶數(shù)據(jù)
/// </summary>
public partial class taobaoIPdata
{
private long _ipLong;
/// <summary>
/// IP 長(zhǎng)整形
/// </summary>
public long ipLong
{
get { return _ipLong; }
set { _ipLong = value; }
}
private string _ip;
/// <summary>
/// IP地址
/// </summary>
public string ip
{
get { return _ip; }
set { _ip = value; }
}
private string _country;
/// <summary>
/// 國(guó)家
/// </summary>
public string country
{
get { return _country; }
set { _country = value; }
}
private string _country_id;
/// <summary>
/// 國(guó)家編號(hào)
/// </summary>
public string country_id
{
get { return _country_id; }
set { _country_id = value; }
}
private string _area;
/// <summary>
/// 地區(qū)
/// </summary>
public string area
{
get { return _area; }
set { _area = value; }
}
private string _area_id;
/// <summary>
/// 地區(qū)編號(hào)
/// </summary>
public string area_id
{
get { return _area_id; }
set { _area_id = value; }
}
private string _region;
/// <summary>
/// 區(qū)域
/// </summary>
public string region
{
get { return _region; }
set { _region = value; }
}
private string _region_id;
/// <summary>
/// 區(qū)域編號(hào)
/// </summary>
public string region_id
{
get { return _region_id; }
set { _region_id = value; }
}
private string _city;
/// <summary>
///城市
/// </summary>
public string city
{
get { return _city; }
set { _city = value; }
}
private string _city_id;
/// <summary>
/// 城市編號(hào)
/// </summary>
public string city_id
{
get { return _city_id; }
set { _city_id = value; }
}
private string _county;
/// <summary>
/// 縣
/// </summary>
public string county
{
get { return _county; }
set { _county = value; }
}
private string _county_id;
/// <summary>
/// 縣編號(hào)
/// </summary>
public string county_id
{
get { return _county_id; }
set { _county_id = value; }
}
private string _isp;
/// <summary>
/// 供應(yīng)商
/// </summary>
public string isp
{
get { return _isp; }
set { _isp = value; }
}
private string _isp_id;
/// <summary>
/// 供應(yīng)商ID
/// </summary>
public string isp_id
{
get { return _isp_id; }
set { _isp_id = value; }
}
}
/// <summary>
/// 淘寶api 返回的json數(shù)據(jù)
/// </summary>
public partial class TaobaoJsonData
{
public int code { get; set; }
public taobaoIPdata data { get; set; }
}
序列號(hào)對(duì)象taobaoIPdata
相關(guān)文章
組合模式：將對(duì)象組合成樹形結(jié)構(gòu)以表示‘部分-整體’的層次結(jié)構(gòu)。組合模式使得用戶對(duì)單個(gè)對(duì)象和組合對(duì)象的使用具有一致性。需求中式體現(xiàn)部分與整體層次的結(jié)構(gòu)時(shí)，統(tǒng)一地使用組合對(duì)象中的所有對(duì)象時(shí)，應(yīng)該考慮使用組合模式2012-10-10
這篇文章主要介紹了c#中利用Tu Share獲取股票交易信息,本文通過(guò)實(shí)例代碼給大家介紹的非常詳細(xì)，對(duì)大家的學(xué)習(xí)或工作具有一定的參考借鑒價(jià)值，需要的朋友可以參考下2020-06-06
Unity游戲開發(fā)之炸彈人游戲的實(shí)現(xiàn)
大家小時(shí)候肯定玩過(guò)這款游戲，炸彈人也算是經(jīng)典中的經(jīng)典啦。本文將利用Unity模擬實(shí)現(xiàn)這一經(jīng)典游戲，感興趣的小伙伴可以跟隨小編一起學(xué)習(xí)一下2022-03-03
Unity3D利用DoTween實(shí)現(xiàn)卡牌翻轉(zhuǎn)效果
這篇文章主要為大家詳細(xì)介紹了Unity3D利用DoTween實(shí)現(xiàn)卡牌翻轉(zhuǎn)效果，具有一定的參考價(jià)值，感興趣的小伙伴們可以參考一下2019-02-02
Windows 8 Metro用C#連接SQLite及創(chuàng)建數(shù)據(jù)庫(kù),數(shù)據(jù)表的增刪改查的實(shí)現(xiàn)
本篇文章小編為大家介紹，Windows 8 Metro用C#連接SQLite及創(chuàng)建數(shù)據(jù)庫(kù),數(shù)據(jù)表的增刪改查的實(shí)現(xiàn)。需要的朋友參考下2013-04-04
現(xiàn)在是2012-12-04 11:29:59，發(fā)表時(shí)間是：2012-12-02 21:29:59，傳統(tǒng)的ts.Days因?yàn)橹禐?天14小時(shí)0分0秒，會(huì)返回“昨天”，而這個(gè)會(huì)返回“前天”2012-12-12
這篇文章主要介紹了使用淘寶ip地址庫(kù)查ip的示例,需要的朋友可以參考下2014-03-03
這篇文章主要介紹了C＃枚舉中使用Flags特性的方法，本文給大家介紹的非常詳細(xì)，對(duì)大家的學(xué)習(xí)或工作具有一定的參考借鑒價(jià)值,需要的朋友可以參考下2022-03-03
這篇文章主要介紹了C#之CLR內(nèi)存字符串常量池（string）,對(duì)于學(xué)習(xí)和理解C#內(nèi)存原理很有幫助,需要的朋友可以參考下2014-08-08
c# asp .net 動(dòng)態(tài)創(chuàng)建sql數(shù)據(jù)庫(kù)表的方法
c# asp .net 動(dòng)態(tài)創(chuàng)建sql數(shù)據(jù)庫(kù)表的方法，需要的朋友可以參考一下2013-04-04