160

I have two urls:

url1 = "http://127.0.0.1/test1/test2/test3/test5.xml"
url2 = "../../test4/test6.xml"

How can I get an absolute url for url2?

2

6 Answers 6

307

You should use urlparse.urljoin :

>>> import urlparse
>>> urlparse.urljoin(url1, url2)
'http://127.0.0.1/test1/test4/test6.xml'

With Python 3 (where urlparse is renamed to urllib.parse) you could use it as follow:

>>> import urllib.parse
>>> urllib.parse.urljoin(url1, url2)
'http://127.0.0.1/test1/test4/test6.xml'
7
  • 10
    How we use urljoin with 3 or mode parameters or which library do you recommend for this? Apr 23, 2013 at 0:13
  • @mesuutt try to make a loop and join each part with the previously joined URL. Apr 23, 2013 at 7:35
  • 3
    @CédricJulien: a simple loop will not work, as any path with a leading / will "reset" and return scheme + netloc + lasturl: urlparse.urljoin('http://www.a.com/b/c/d', '/e') => 'http://www.a.com/e'
    – MestreLion
    Nov 5, 2013 at 17:12
  • If using the urljoin, there's a problem. For example, urljoin('http://www.a.com/', '../../b/c.png'), the result is 'http://www.a.com/../../b/c.png', but not http://www.a.com/b/c.png. So, is there any method to get http://www.a.com/b/c.png?
    – bigwind
    Jul 2, 2014 at 3:54
  • 1
    Link to Python 3 documentation points to Python 2 documentation, it needs to updated in the answer, it is docs.python.org/3.6/library/…
    – Harsh
    Jun 8, 2017 at 6:55
21

If your relative path consists of multiple parts, you have to join them separately, since urljoin would replace the relative path, not join it. The easiest way to do that is to use posixpath.

>>> import urllib.parse
>>> import posixpath
>>> url1 = "http://127.0.0.1"
>>> url2 = "test1"
>>> url3 = "test2"
>>> url4 = "test3"
>>> url5 = "test5.xml"
>>> url_path = posixpath.join(url2, url3, url4, url5)
>>> urllib.parse.urljoin(url1, url_path)
'http://127.0.0.1/test1/test2/test3/test5.xml'

See also: How to join components of a path when you are constructing a URL in Python

12

You can use reduce to achieve Shikhar's method in a cleaner fashion.

>>> import urllib.parse
>>> from functools import reduce
>>> reduce(urllib.parse.urljoin, ["http://moc.com/", "path1/", "path2/", "path3/"])
'http://moc.com/path1/path2/path3/'

Note that with this method each fragment should have trailing forward-slash, with no leading forward-slash, to indicate it is a path fragment being joined.

This is more correct/informative, telling you that path1/ is a URI path fragment, and not the full path (e.g. /path1/) or an unknown (e.g. path1). An unknown could be either, but they are handled as a full path.

If you need to add / to a fragment lacking it, you could do:

uri = uri if uri.endswith("/") else f"{uri}/"

To learn more about URI resolution, Wikipedia has some nice examples.

Updates

  • Just noticed Peter Perron commented about reduce on Shikhar's answer, but I'll leave this here then to demonstrate how that's done.

  • Updated wikipedia URL

11
es = ['http://127.0.0.1', 'test1', 'test4', 'test6.xml']
base = ''
map(lambda e: urlparse.urljoin(base, e), es)
1
  • 9
    Good way to support a list of values. You can remove your side effect (your "base" variable) by using a reduce though. reduce(lambda a, b: urlparse.urljoin(a, b), es) A map is list[n] - to -> list[n] A reduce is list[n] - to -> a calculated value Apr 9, 2018 at 13:16
11

For python 3.0+ the correct way to join urls is:

from urllib.parse import urljoin
urljoin('https://10.66.0.200/', '/api/org')
# output : 'https://10.66.0.200/api/org'
1
  • This is limited to join only two path components. Cannot be easily used if there is more. Jan 20, 2021 at 16:34
4
>>> from urlparse import urljoin
>>> url1 = "http://www.youtube.com/user/khanacademy"
>>> url2 = "/user/khanacademy"
>>> urljoin(url1, url2)
'http://www.youtube.com/user/khanacademy'

Simple.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.