How to give a pattern for new line in grep? New line at beginning, new line at end. Not the regular expression way. Something like \n.
6 Answers
try pcregrep
instead of regular grep
:
pcregrep -M "pattern1.*\n.*pattern2" filename
the -M
option allows it to match across multiple lines, so you can search for newlines as \n
.
-
1This is an excellent suggestion. I've used
pcregrep
a LOT the last week. For example,pcregrep -lMr "\r\n" *
to recursively find all files that have at least one CRLF line ending. And after conversion to Unix line endings, I usedpcregrep -lMr " \n" *
to find all files having Markdown soft line breaks. Very helpful!– HenkeMar 10 at 16:33
grep
patterns are matched against individual lines so there is no way for a pattern to match a newline found in the input.
However you can find empty lines like this:
grep '^$' file
grep '^[[:space:]]*$' file # include white spaces
-
5At least GNU grep has -z option that makes grep break lines by null character. However, it does not seem to support newline or \n in pattern to match newline, see bug report.– jarnoNov 12, 2016 at 12:15
-
2
Thanks to @jarno I know about the -z option and I found out that when using GNU grep with the -P option, matching against \n
is possible. :)
Example:
grep -zoP 'foo\n\K.*'<<<$'foo\nbar'
Result:
bar
Example that involves matching everything including newlines:
.*
will not match newlines. To match everything including newlines, use1 (.|\n)*
:
grep -zoP 'foo\n\K(.|\n)*'<<<$'foo\nbar\nqux'
Result:
bar
qux
1 Seen here: https://stackoverflow.com/a/33418344
-
1Great, note that I do not get notification about the "@jarno" in the answer.– jarnoMar 13, 2018 at 11:59
-
4
-
You can use this way...
grep -P '^\s$' file
-P
is used for Perl regular expressions (an extension to POSIXgrep
).\s
match the white space characters; if followed by*
, it matches an empty line also.^
matches the beginning of the line.$
matches the end of the line.
-
2
-P
is a GNU extension. I am fine for using it when the situation calls for it (typically lookahead/lookbehind), but POSIX grep can do this just file with[[:space:]]
.– jordanmSep 29, 2012 at 21:29 -
1FWIW, Solaris' and BSD's grep manpages (didn't check others) both have a paragraph for
-P
. GNU is quite standard anyway. :)– K3---rncJun 24, 2013 at 5:09 -
1
-
No [-P] for MacOsX either: grep [-abcdDEFGHhIiJLlmnOopqRSsUVvwxZ] [-A num] [-B num] [-C[num]] [-e pattern] [-f file] [--binary-files=value] [--color[=when]] [--colour[=when]] [--context[=num]] [--label] [--line-buffered] [--null] [pattern] [file ...]– NiccolòJan 12, 2017 at 10:50
-
@Niccolò You'll want to
brew install grep
to get GNU grep, which is superior in several ways. apple.stackexchange.com/questions/193288/… May 11, 2018 at 23:21
As for the workaround (without using non-portable -P
), you can temporary replace a new-line character with the different one and change it back, e.g.:
grep -o "_foo_" <(paste -sd_ file) | tr -d '_'
Basically it's looking for exact match _foo_
where _
means \n
(so __
= \n\n
). You don't have to translate it back by tr '_' '\n'
, as each pattern would be printed in the new line anyway, so removing _
is enough.
-
1pardon my ignorance, but is using process substituion not yet another NON posix compatible, hence non-portable feature? in posix shell I could not do
<(p paste -sd_ file )
? Sep 6, 2018 at 11:23
-
carriage return
\r
is not a newline\n
. If your grepping for windows style line ending you need\r\n
– CervEdJan 7, 2022 at 11:27
new line at the beginning
is a blank line andnew line at end
applies to every line in the file. Can you post an example?$
. It's somewhat limited, but usable in simple cases.