Python URL and query parameter parsing summary

tl;dr

This section summarizes how to parse URLs and query parameters in Python and convert percent encoding.

In Python3, modules such as URL acquisition and parsing are unified to ʻurllib`. The correspondence table is summarized below.

Python3

The code below assumes an import of ʻurllib`.

import urllib

URL parsing

urllib.parse.urlparse("http://example.com/example.html?foo=bar&hoge=fuga")
# => ParseResult(scheme='http', netloc='example.com', path='/example.html', params='', query='foo=bar&hoge=fuga', fragment='') 

• http://docs.python.jp/3/library/urllib.parse.html#urllib.parse.urlparse

Parsing query parameters

urllib.parse.parse_qs("foo=bar&hoge=fuga")
# => {'hoge': ['fuga'], 'foo': ['bar']}                                                                                           

urllib.parse.parse_qs("query=%E3%83%86%E3%82%B9%E3%83%88")
# => {'query': ['test']}

• http://docs.python.jp/3/library/urllib.parse.html#urllib.parse.parse_qs

Create query parameters from dictionary

urllib.parse.urlencode({"query":"test"})
# => query=%E3%83%86%E3%82%B9%E3%83%88

• http://docs.python.jp/3/library/urllib.parse.html#urllib.parse.urlencode

Percent-encoding string conversion

urllib.parse.quote("test")
# => %E3%83%86%E3%82%B9%E3%83%88

urllib.parse.unquote("%E3%83%86%E3%82%B9%E3%83%88")
# =>test

• http://docs.python.jp/3/library/urllib.parse.html#url-quoting

Python2

The code below assumes the import of ʻurllib and ʻurlparse.

import urllib
import urlparse

URL parsing

urlparse.urlparse("http://example.com/example.html?foo=bar&hoge=fuga")
# => ParseResult(scheme='http', netloc='example.com', path='/example.html', params='', query='foo=bar&hoge=fuga', fragment='') 

• http://docs.python.jp/2/library/urlparse.html#urlparse.urlparse

Parsing query parameters

urlparse.parse_qs("foo=bar&hoge=fuga")
# => {'hoge': ['fuga'], 'foo': ['bar']}                                                                                           

urlparse.parse_qs("query=%E3%83%86%E3%82%B9%E3%83%88")
# => {'query': ['test']}

http://docs.python.jp/2/library/urlparse.html#urlparse.parse_qs

Create query parameters from dictionary

urllib.urlencode({"query":"test"})
# => query=%E3%83%86%E3%82%B9%E3%83%88

• http://docs.python.jp/2/library/urllib.html#urllib.urlencode

Percent-encoding string conversion

urllib.quote("test")
# => %E3%83%86%E3%82%B9%E3%83%88

urllib.unquote("%E3%83%86%E3%82%B9%E3%83%88")
# =>test

• http://docs.python.jp/2/library/urllib.html#utility-functions

reference

• Python2 -20.5. urllib — Accessing any resource by URL — Python 2.7.x documentation -20.16. urlparse — Parsing URL into components — Python 2.7.x documentation
• Python3 -21.8. Urllib.parse — Parsing URL into components — Python 3.5.2 documentation -[Porting code to Python 3 using 2to3 --Dive Into Python 3 Japanese version](http://diveintopython3-ja.rdy.jp/porting-code-to-python-3-with-2to3.html #urllib)