38

While matching an email address, after I match something like yasar@webmail, I want to capture one or more of (\.\w+)(what I am doing is a little bit more complicated, this is just an example), I tried adding (.\w+)+ , but it only captures last match. For example, yasar@webmail.something.edu.tr matches but only include .tr after yasar@webmail part, so I lost .something and .edu groups. Can I do this in Python regular expressions, or would you suggest matching everything at first, and split the subpatterns later?

4
  • 2
    Capturing repeated expressions was proposed in Python Issue 7132 but rejected. It is however supported by the third-party regex module.
    – Todd Owen
    Oct 15, 2018 at 0:27
  • @ToddOwen But, isn't this now possible in 2.7? I don't know when it became possible. But, the answer from stackoverflow.com/a/9765037/3541976 seems to work just fine for me in 2.7 using the re module. Nov 25, 2018 at 0:22
  • 3
    @MichaelOhlrogge Issue 7132 is about what happens if the capturing parentheses are inside a repeat. The issue is not fixed, and will still only keep the last match. A possible workaround, as mentioned in the answer you linked to, is to put the capturing parentheses around a repeating pattern. (Note that (?: ...) are not capturing parentheses).
    – Todd Owen
    Nov 28, 2018 at 21:36
  • @ToddOwen Got it, thank you, that is a helpful clarification! Nov 29, 2018 at 1:03

4 Answers 4

39

re module doesn't support repeated captures (regex supports it):

>>> m = regex.match(r'([.\w]+)@((\w+)(\.\w+)+)', 'yasar@webmail.something.edu.tr')
>>> m.groups()
('yasar', 'webmail.something.edu.tr', 'webmail', '.tr')
>>> m.captures(4)
['.something', '.edu', '.tr']

In your case I'd go with splitting the repeated subpatterns later. It leads to a simple and readable code e.g., see the code in @Li-aung Yip's answer.

5
  • Out of curiosity, how do you write a replacement pattern when you match repeated captures? Does the meaning of \1, \2, \3 etc. change depending on how many times you matched (\.\w+)? Mar 19, 2012 at 7:55
  • @Li-aung Yip: \1 corresponds to m.group(1); the meaning hasn't changed. You could use a function as a replacement pattern and call m.captures() in it.
    – jfs
    Mar 19, 2012 at 9:03
  • In your example, the meaning of \1, \2, and \3 is obvious because they only capture once. But what is the meaning of \4, corresponding to (\.\w+)+? \4 appears to be "the last substring matched by the 4th capture group", in this case .tr. Mar 19, 2012 at 9:12
  • @Li-aung Yip: m.groups() above explicitly shows what \4 is.
    – jfs
    Mar 19, 2012 at 9:13
  • The meaning hasn't changed: \4 is m.group(4) whatever it is.
    – jfs
    Mar 19, 2012 at 9:21
13

You can fix the problem of (\.\w+)+ only capturing the last match by doing this instead: ((?:\.\w+)+)

3
  • 2
    For abbreviations (if you've lower-cased): re.sub(ur'((?:[a-z]\.){2,})', lambda m: m.group(1).replace('.', ''), text)
    – scharfmn
    Aug 15, 2015 at 9:58
  • 1
    Thanks. I was able adding parentheses allowed me to match a repeated subpattern, but then there was a group in the match with the last one of the pattern. I hadn't seen that (?: ...) makes a non-capturing group. docs.python.org/2/library/re.html#regular-expression-syntax Adding that fixes that problem.
    – Tim Swast
    Jul 21, 2016 at 22:22
  • this doesn't split the groups
    – Jules G.M.
    Nov 18, 2022 at 21:26
13

This will work:

>>> regexp = r"[\w\.]+@(\w+)(\.\w+)?(\.\w+)?(\.\w+)?(\.\w+)?(\.\w+)?"
>>> email_address = "william.adama@galactica.caprica.fleet.mil"
>>> m = re.match(regexp, email_address)
>>> m.groups()
('galactica', '.caprica', '.fleet', '.mil', None, None)

But it's limited to a maximum of six subgroups. A better way to do this would be:

>>> m = re.match(r"[\w\.]+@(.+)", email_address)
>>> m.groups()
('galactica.caprica.fleet.mil',)
>>> m.group(1).split('.')
['galactica', 'caprica', 'fleet', 'mil']

Note that regexps are fine so long as the email addresses are simple - but there are all kinds of things that this will break for. See this question for a detailed treatment of email address regexes.

5

This is what you are looking for:

>>> import re

>>> s="yasar@webmail.something.edu.tr"
>>> r=re.compile("\.\w+")
>>> m=r.findall(s)

>>> m
['.something', '.edu', '.tr']
3
  • 1
    This doesn't match for the yasar@webmail. As such, it could easily pick up false positive results where there are things other than email addresses with multiple periods separating them. Nov 24, 2018 at 18:07
  • 1
    OP has clearly written that this is just an example and what he is trying to do is more complicated. Hence, my answer. Nov 24, 2018 at 18:09
  • 2
    Yes, but the problem is that your solution won't work even on the simplified version of the problem OP gave. Your solution is trivially simple for anyone with even the most basic understanding of RegEx. All other answers are more complicated because this is a genuinely non-trivial problem to solve. Nov 24, 2018 at 18:31

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.