37

I am learning awk/gawk. So recently I just try to solve any problem with it to gain more practice opportunities.

My coworker asked a question yesterday,

"how to remove first and last line from file"

. I know that sed '1d;$d' file would work. also head/tail works too even if the poor performance. I told him the sed one, he was happy.

Later, I was trying to wrote an awk one-liner: so far what I got is:

awk 'NR>1{a[++k]=$0}END{for(i=1;i<k;i++)print a[i]}'

This will store whole file in array just to skip the last line. I feel that there should be an easier(or better) way to do that..

(if there is no easier or faster or better way, I would remove the question)

0

3 Answers 3

82

This does the trick:

awk 'NR>2 {print last} {last=$0}'

awk executes the action print last only when NR > 2 (that is, on all lines but the first 2). On all lines, it sets the variable last to the current line. So when awk reads the third line, it prints line 2 (which was stored in last). When it reads the last line (line n) it prints the content of line n-1. The net effect is that lines 2 through n-1 are printed.

7
  • 1
    YES!!! I though of this way too, but gave NR>1..then gave up...urrrr. didn't think about NR>2 at all, how stupid!.. great! thank you! up! Apr 6, 2013 at 22:36
  • 1
    Use FNR when reading multiple files. See Two-file processing in backreference.org/2010/02/10/idiomatic-awk
    – Aditya
    Feb 6, 2018 at 22:24
  • gawk -i inplace 'NR>2 {print last} {last=$0}' file if someone wants in-place edits. Requires GNU awk 4.1.0+.
    – Xeverous
    Jul 13, 2021 at 10:22
  • @Xeverous -i is a minor abomination. As long as you remember that the file is not edited "in place" at all but is replaced by a new file, it can be a useful feature. But it remains an abomination. Jul 13, 2021 at 10:47
  • Note that if it did actually edit the file in place, its status would be escalated to major abomination. Jul 13, 2021 at 10:48
23

Let me suggest another solution. In case if you need custom N for top and bottom lines you can use tail and head commands:

awk '{print $1}'  | head -n -1 | tail -n+2

head -n -1 - removes last line

tail -n+2 - starts output from second line (removes 1 line)

Following command will remove 3 lines from top and bottom:

awk '{print $1}'  | head -n -3 | tail -n +4

Actually we don't even need awk here:

more | head -n -1 | tail -n +2

or

cat | head -n -1 | tail -n +2

Thanks to Igor Fobia for comment!

2
2

Here is another way, but it required gawk function length:

awk '{firstline=2; cuttail=1; l[NR]=$0} END {for (i=firstline; i<=length(l)-cuttail; i++) print l[i]}'

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge that you have read and understand our privacy policy and code of conduct.

Not the answer you're looking for? Browse other questions tagged or ask your own question.