[PYTHON] Crawl Follower for an account with Instagram

Overview

Crawl all follower information for an account on Instagram. The official Instagram API has an API to get your follower list, but no API to get someone else's follower list. So this time I created a program to crawl the follower information of any account.

Prerequisites

Prerequisites for using this program

1. Have an Instagram account
2. Know the User ID of the account you want to look up
3. Know what your Query ID is

How to check 2 and 3 will be described later.

program

crawl_followers.py

import requests
import json

# Your Account info
def get_user_info():
    return {
            "username": "your_account",
            "password": "your_password"
            }

# HTTP Headers to login
def login_http_headers():
    ua = "".join(["Mozilla/5.0 (Windows NT 6.1; WOW64) ",
                  "AppleWebKit/537.36 (KHTML, like Gecko) ",
                  "Chrome/56.0.2924.87 Safari/537.36"])
    return {
            "user-agent": ua,
            "referer":"https://www.instagram.com/",
            "x-csrftoken":"null",
            "cookie":"sessionid=null; csrftoken=null"
            }

# login session
def logined_session():
    session = requests.Session()
    login_headers = login_http_headers()
    user_info = get_user_info()
    login_url = "https://www.instagram.com/accounts/login/ajax/"
    session.post(login_url, data=user_info, headers=login_headers)
    return session

# a fetch (max 3000 followers)
def fetch_followers(session, user_id, query_id, after=None):
    variables = {
        "id": user_id,
        "first": 3000,
    }
    if after:
        variables["after"] = after

    followers_url = "".join(["https://www.instagram.com/graphql/query/?",
                             "query_id=" + query_id + "&",
                             "variables=" + json.dumps(variables)])
    # HTTP Request
    followers = session.get(followers_url)
    dic = json.loads(followers.text)
    edge_followed_by = dic["data"]["user"]["edge_followed_by"]

    count = edge_followed_by["count"] # number of followers
    after = edge_followed_by["page_info"]["end_cursor"] # next pagination
    has_next = edge_followed_by["page_info"]["has_next_page"]
    return {
            "count": count,
            "after": after,
            "has_next":  has_next,
            "followers": edge_followed_by["edges"]
            }

def fetch_all_followers(session, user_id, query_id):
    after     = None # pagination
    followers = []  

    while(True):
        fetched_followers = fetch_followers(session, user_id, query_id, after)
        followers += fetched_followers["followers"]

        if fetched_followers["has_next"]:
            after = fetched_followers["after"]
        else:
            return {
                    "count": fetched_followers["count"],
                    "followers": followers
                    }

def main(user_id, query_id):
    session = logined_session()
    return fetch_all_followers(session, user_id, query_id)

if __name__ == '__main__':
    user_id  = "3425874156" # user id to search 
    query_id = "" # your query id
    main(user_id, query_id)

Know the User ID of the account you want to look up

It's fairly easy to know the user id of an account. You can usually find it from the Instagram GUI. Example: Know the user id of taylorswift Step 1: Open chrome Step 2: Open the developer tool Step 3: Go to the Network tab Step 4: Go to https://www.instagram.com/taylorswift/ Step 5: Click / query at ↓

Step 6: Go to the Response tab and look for the key "owner"

Step 7: The string next to the key "id" in "owner" is the User ID

Know your query id

Step 1: Open chrome Step 2: Login from https://www.instagram.com/ Step 3: Go to https://www.instagram.com/taylorswift/ Step 4: Open the developer tool Step 5: Open Network Step 6: Click taylor's Followers Step 7: The? Query_id part of the request in ↓ is your query id (actually in the hidden part)

What I learned about Query ID

・ It is always the same even if you log in again ・ If you change your account, it will be different. ・ You can't get those things from the official Instagram API. ・ Conclusion, I don't know what it is, but some ID that has a one-to-one relationship with the account.

That's it