Resources

Accessing web pages from Python

All the information you need has been provided in the previous pages. All you are likely to need for accessing web pages in Python3 is:

• Import the request method from urllib

  from urllib import request
  

• Read the content of a URL:

  result = request.urlopen(url).read()
  

• Decode the results into UTF-8:

  result = str(result, encoding='utf-8')
  

Access to regular expressions is also extremely useful for parsing results:

• Import the regular expression module:

  import re
  

• Create a regular expression:

  pattern  = re.compile('...pattern...')
  

• Match the pattern to a string:

  match    = pattern.match(string)
  

• Extract a match that was in a '(group)':

  upresnum = int(match.group(1))