136

How to give a pattern for new line in grep? New line at beginning, new line at end. Not the regular expression way. Something like \n.

3
  • 6
    It's not clear what you want. new line at the beginning is a blank line and new line at end applies to every line in the file. Can you post an example?
    – P.P
    Sep 29, 2012 at 12:11
  • 4
    Actually you can just use $. It's somewhat limited, but usable in simple cases. Feb 13, 2014 at 7:03
  • 1
    gnu.org/software/grep/manual/grep.html#Usage see item 15.
    – jarno
    Nov 12, 2016 at 12:29

6 Answers 6

113

try pcregrep instead of regular grep:

pcregrep -M "pattern1.*\n.*pattern2" filename

the -M option allows it to match across multiple lines, so you can search for newlines as \n.

1
  • 1
    This is an excellent suggestion. I've used pcregrep a LOT the last week. For example, pcregrep -lMr "\r\n" * to recursively find all files that have at least one CRLF line ending. And after conversion to Unix line endings, I used pcregrep -lMr " \n" * to find all files having Markdown soft line breaks. Very helpful!
    – Henke
    Mar 10 at 16:33
107

grep patterns are matched against individual lines so there is no way for a pattern to match a newline found in the input.

However you can find empty lines like this:

grep '^$' file
grep '^[[:space:]]*$' file # include white spaces 
2
  • 5
    At least GNU grep has -z option that makes grep break lines by null character. However, it does not seem to support newline or \n in pattern to match newline, see bug report.
    – jarno
    Nov 12, 2016 at 12:15
  • 2
    @jarno It supports \n in patterns with the -P flag Mar 9, 2018 at 11:01
40

Thanks to @jarno I know about the -z option and I found out that when using GNU grep with the -P option, matching against \n is possible. :)

Example:

grep -zoP 'foo\n\K.*'<<<$'foo\nbar'

Result:

bar

Example that involves matching everything including newlines:

.* will not match newlines. To match everything including newlines, use1 (.|\n)*:

grep -zoP 'foo\n\K(.|\n)*'<<<$'foo\nbar\nqux'

Result:

bar
qux

1 Seen here: https://stackoverflow.com/a/33418344

3
  • 1
    Great, note that I do not get notification about the "@jarno" in the answer.
    – jarno
    Mar 13, 2018 at 11:59
  • 4
    This is great! Thank you so much for sharing! Apr 6, 2018 at 17:43
  • Works for me. Thanks a lot. grep -zoPnir "dex\n035" ./dir/
    – galian
    Dec 18, 2020 at 7:11
27

You can use this way...

grep -P '^\s$' file
  • -P is used for Perl regular expressions (an extension to POSIX grep).
  • \s match the white space characters; if followed by *, it matches an empty line also.
  • ^ matches the beginning of the line. $ matches the end of the line.
5
  • 2
    -P is a GNU extension. I am fine for using it when the situation calls for it (typically lookahead/lookbehind), but POSIX grep can do this just file with [[:space:]].
    – jordanm
    Sep 29, 2012 at 21:29
  • 1
    FWIW, Solaris' and BSD's grep manpages (didn't check others) both have a paragraph for -P. GNU is quite standard anyway. :)
    – K3---rnc
    Jun 24, 2013 at 5:09
  • 1
    From manual page: [-P] This option is not supported in FreeBSD. Dec 4, 2014 at 13:31
  • No [-P] for MacOsX either: grep [-abcdDEFGHhIiJLlmnOopqRSsUVvwxZ] [-A num] [-B num] [-C[num]] [-e pattern] [-f file] [--binary-files=value] [--color[=when]] [--colour[=when]] [--context[=num]] [--label] [--line-buffered] [--null] [pattern] [file ...]
    – Niccolò
    Jan 12, 2017 at 10:50
  • @Niccolò You'll want to brew install grep to get GNU grep, which is superior in several ways. apple.stackexchange.com/questions/193288/… May 11, 2018 at 23:21
8

As for the workaround (without using non-portable -P), you can temporary replace a new-line character with the different one and change it back, e.g.:

grep -o "_foo_" <(paste -sd_ file) | tr -d '_'

Basically it's looking for exact match _foo_ where _ means \n (so __ = \n\n). You don't have to translate it back by tr '_' '\n', as each pattern would be printed in the new line anyway, so removing _ is enough.

1
  • 1
    pardon my ignorance, but is using process substituion not yet another NON posix compatible, hence non-portable feature? in posix shell I could not do <(p paste -sd_ file )? Sep 6, 2018 at 11:23
6

just found

grep $'\r'

It's using $'\r' for c-style escape in Bash.

in this article

1
  • carriage return \r is not a newline \n. If your grepping for windows style line ending you need \r\n
    – CervEd
    Jan 7, 2022 at 11:27

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.