[PYTHON] I tried to verify the Big Bang theorem [Is it about to come back?]
What is the Big Bang theorem?
The theory that any word results in the "Big Bang"
Quote
I tried to verify the theory that every word reaches the big bang when the meaning is traced back in the dictionary. https://www.youtube.com/watch?v=CN7q1thA7mU
Implementation
This time, we will use "MediaWiki API" to get a list of articles linked to articles. Verify how many articles are linked to Big Bang articles
Source
python
url = "http://ja.wikipedia.org/w/api.php"
payload = {"format":"json", "action":"query", "list":"backlinks", "blnamespace":"0"}
payload['bltitle'] = word
r = requests.get(url, params=payload)
#json plastic surgery
json_load = r.json()
json_load = json.dumps(json_load)
json_load = json.loads(json_load)
#Partially cut out
json_load = json_load['query']['backlinks']
theList = []
#Loop for articles
for value in json_load:
theDict = {}
theDict['id'] = value['pageid']
theDict['title'] = value['title']
theDict['blTitle'] = word
theDict['url'] = 'https://ja.wikipedia.org/wiki/' + value['title']
theDict['floor'] = floor
theDict['ns'] = value['ns']
theList.append(theDict)
dataFrame = pd.io.json.json_normalize(theList)
reference
https://qiita.com/yubessy/items/16d2a074be84ee67c01f#記事へリンクしている記事の一覧を取得
inspection result
https://ja.wikipedia.org/wiki/Wikipedia:日本語版の統計 Increase the total number of articles to "1227198"
- As of September 2020
n = number of times to return to the big bang
Representative value
n=0 ·big Bang
n=1 ·Physics ·chronology ・ Cosmology
n=2 ·geography ・ Biology ·biology
Output result CSV
All acquisition results (with duplicate articles) https://github.com/Syogo-Suganoya/bigBanete/blob/master/downloads/record.csv
All acquisition results (no duplicate articles) https://github.com/Syogo-Suganoya/bigBanete/blob/master/downloads/uniqueRecord.csv
Conclusion
The article link loop occurred at the 10th trial, and the article coverage rate reached the ceiling. The coverage rate (Big Bangite rate) in Japanese articles of Big Bang is 0.0993%. The proposition "Any word results in the" Big Bang "" is a mistake.
github https://github.com/Syogo-Suganoya/bigBanete