欧美bbbwbbbw肥妇,免费乱码人妻系列日韩,一级黄片

python使用心得之獲得github代碼庫列表

 更新時間:2014年06月25日 17:26:52   投稿:hebedich  
最近接了個項(xiàng)目,要求獲得github的repo的api,度娘了一下,有不少文章介紹,總結(jié)了本文,分享給大家并附上代碼

1.背景

項(xiàng)目需求,要求獲得github的repo的api,以便可以提取repo的數(shù)據(jù)進(jìn)行分析。研究了一天,終于解決了這個問題,雖然效率還是比較低下。

因?yàn)間ithub的那個顯示repo的api,列出了每個repo的詳細(xì)信息,而且是json格式的?,F(xiàn)在貌似還沒有找到可以分析多個json格式數(shù)據(jù)的方法,所以用的是比較蠢得splite加re的方法。如果大家有更好的方法,不發(fā)留言討論!

2.代碼

import re
import os

def GetUrl(num):
 str = os.popen("curl -G https://api.github.com/repositories?since=%d"%(num)).read()
 pattern = '"url"'
 pattern1='repos'
 urls=str.split(',\n')  
 for i in urls:
  if pattern in i and pattern1 in i:   
#  text1=i.splite(':')
  text=re.compile('"(.*?)"').findall(i)[1]
  print text
if __name__=='__main__':
 GetUrl(1000)

    其中num的值指的是頁面的id,我們可以做一個循環(huán),不斷增大num的值,就可以無限提取repo。因?yàn)間ithub的api對于流量是有限制的,所以這么做是一個可行的方法。

效果如下(提取下來的repo的api地址):

https://api.github.com/repos/wycats/merb-core

https://api.github.com/repos/rubinius/rubinius

https://api.github.com/repos/mojombo/god

https://api.github.com/repos/vanpelt/jsawesome

https://api.github.com/repos/wycats/jspec

https://api.github.com/repos/defunkt/exception_logger

https://api.github.com/repos/defunkt/ambition

https://api.github.com/repos/technoweenie/restful-authentication

https://api.github.com/repos/technoweenie/attachment_fu

https://api.github.com/repos/topfunky/bong

https://api.github.com/repos/Caged/microsis

https://api.github.com/repos/anotherjesse/s3

https://api.github.com/repos/anotherjesse/taboo

https://api.github.com/repos/anotherjesse/foxtracs

https://api.github.com/repos/anotherjesse/fotomatic

https://api.github.com/repos/mojombo/glowstick

https://api.github.com/repos/defunkt/starling

https://api.github.com/repos/wycats/merb-more

https://api.github.com/repos/macournoyer/thin

https://api.github.com/repos/jamesgolick/resource_controller

https://api.github.com/repos/jamesgolick/markaby

https://api.github.com/repos/jamesgolick/enum_field

https://api.github.com/repos/defunkt/subtlety

https://api.github.com/repos/defunkt/zippy

https://api.github.com/repos/defunkt/cache_fu

https://api.github.com/repos/KirinDave/phosphor

相關(guān)文章

最新評論