Say, I have a file foo.txt
specifying N
arguments
arg1
arg2
...
argN
which I need to pass to the command my_command
How do I use the lines of a file as arguments of a command?
Say, I have a file foo.txt
specifying N
arguments
arg1
arg2
...
argN
which I need to pass to the command my_command
How do I use the lines of a file as arguments of a command?
If your shell is bash (amongst others), a shortcut for $(cat afile)
is $(< afile)
, so you'd write:
mycommand "$(< file.txt)"
Documented in the bash man page in the 'Command Substitution' section.
Alterately, have your command read from stdin, so: mycommand < file.txt
<
operator. It means that the shell itself will perform the redirection rather than executing the cat
binary for it's redirection properties.
"$(…)"
, the contents of file.txt
would be passed to the standard input of mycommand
, not as an argument. "$(…)"
means run the command and give back the output as a string; here the “command” only reads the file but it could be more complex.
Feb 7, 2019 at 13:39
cat
process sounds like it would save resources. The ref man describes this substitution as "equivalent but faster." Maybe you mean "it's not just a shorter way of typing the same thing"?
As already mentioned, you can use the backticks or $(cat filename)
.
What was not mentioned, and I think is important to note, is that you must remember that the shell will break apart the contents of that file according to whitespace, giving each "word" it finds to your command as an argument. And while you may be able to enclose a command-line argument in quotes so that it can contain whitespace, escape sequences, etc., reading from the file will not do the same thing. For example, if your file contains:
a "b c" d
the arguments you will get are:
a
"b
c"
d
If you want to pull each line as an argument, use the while/read/do construct:
while read i ; do command_name $i ; done < filename
read -r
unless you want to expand backslash-escape sequences -- and NUL is a safer delimiter to use than the newline, particularly if the arguments you're passing are things like filenames, which can contain literal newlines. Also, without clearing IFS, you get leading and trailing whitespace implicitly cleared from i
.
Jun 5, 2014 at 12:41
command `< file`
will pass file contents to the command on stdin, but will strip newlines, meaning you couldn't iterate over each line individually. For that you could write a script with a 'for' loop:
for line in `cat input_file`; do some_command "$line"; done
Or (the multi-line variant):
for line in `cat input_file`
do
some_command "$line"
done
Or (multi-line variant with $()
instead of ``
):
for line in $(cat input_file)
do
some_command "$line"
done
< file
in backticks means it doesn't actually perform a redirection for command
at all.
May 30, 2017 at 17:25
command `< file`
doesn't work in either bash or POSIX sh; zsh is a different matter, but that's not the shell this question is about).
Jul 8, 2017 at 13:42
Hello World
on one line. You'll see it first run some_command Hello
, then some_command World
, not some_command "Hello World"
or some_command Hello World
.
Aug 16, 2019 at 2:26
You do that using backticks:
echo World > file.txt
echo Hello `cat file.txt`
echo "Hello * Starry * World" > file.txt
in the first step, you'd get at least four separate arguments passed to the second command -- and likely more, as the *
s would expand to the names of files present in the current directory.
Jul 8, 2017 at 13:41
fork()
ing off a subshell with a FIFO attached to its stdout, then invoking /bin/cat
as a child of that subshell, then reading the output through the FIFO; compare to $(<file.txt)
, which reads the file's contents into bash directly with no subshells or FIFOs involved.
Jul 8, 2017 at 13:43
If you want to do this in a robust way that works for every possible command line argument (values with spaces, values with newlines, values with literal quote characters, non-printable values, values with glob characters, etc), it gets a bit more interesting.
To write to a file, given an array of arguments:
printf '%s\0' "${arguments[@]}" >file
...replace with "argument one"
, "argument two"
, etc. as appropriate.
To read from that file and use its contents (in bash, ksh93, or another recent shell with arrays):
declare -a args=()
while IFS='' read -r -d '' item; do
args+=( "$item" )
done <file
run_your_command "${args[@]}"
To read from that file and use its contents (in a shell without arrays; note that this will overwrite your local command-line argument list, and is thus best done inside of a function, such that you're overwriting the function's arguments and not the global list):
set --
while IFS='' read -r -d '' item; do
set -- "$@" "$item"
done <file
run_your_command "$@"
Note that -d
(allowing a different end-of-line delimiter to be used) is a non-POSIX extension, and a shell without arrays may also not support it. Should that be the case, you may need to use a non-shell language to transform the NUL-delimited content into an eval
-safe form:
quoted_list() {
## Works with either Python 2.x or 3.x
python -c '
import sys, pipes, shlex
quote = pipes.quote if hasattr(pipes, "quote") else shlex.quote
print(" ".join([quote(s) for s in sys.stdin.read().split("\0")][:-1]))
'
}
eval "set -- $(quoted_list <file)"
run_your_command "$@"
If all you need to do is to turn file arguments.txt
with contents
arg1
arg2
argN
into my_command arg1 arg2 argN
then you can simply use xargs
:
xargs -a arguments.txt my_command
You can put additional static arguments in the xargs
call, like xargs -a arguments.txt my_command staticArg
which will call my_command staticArg arg1 arg2 argN
-d '\n'
, or else won't work for lines with spaces in the file
Aug 21, 2022 at 19:48
Here's how I pass contents of a file as an argument to a command:
./foo --bar "$(cat ./bar.txt)"
$(<bar.txt)
(when using a shell, such as bash, with the appropriate extension). $(<foo)
is a special case: unlike regular command substitution, as used in $(cat ...)
, it doesn't fork off a subshell to operate in, and thus avoids a great deal of overhead.
Aug 24, 2017 at 21:51
None of the answers seemed to work for me or were too complicated. Luckily, it's not complicated with xargs
(Tested on Ubuntu 20.04).
This works with each arg on a separate line in the file as the OP mentions and was what I needed as well.
cat foo.txt | xargs my_command
One thing to note is that it doesn't seem to work with aliased commands.
The accepted answer works if the command accepts multiple args wrapped in a string. In my case using (Neo)Vim it does not and the args are all stuck together.
xargs
does it properly and actually gives you separate arguments supplied to the command.
I suggest using:
command $(echo $(tr '\n' ' ' < parameters.cfg))
Simply trim the end-line characters and replace them with spaces, and then push the resulting string as possible separate arguments with echo.
In my bash shell the following worked like a charm:
cat input_file | xargs -I % sh -c 'command1 %; command2 %; command3 %;'
where input_file is
arg1
arg2
arg3
As evident, this allows you to execute multiple commands with each line from input_file, a nice little trick I learned here.
$(somecommand)
, you'll get that command executed rather than passed through as text. Likewise, >/etc/passwd
will be processed as a redirection and overwrite /etc/passwd
(if run with appropriate permissions), etc.
May 30, 2017 at 17:22
xargs -d $'\n' sh -c 'for arg; do command1 "$arg"; command2 "arg"; command3 "arg"; done' _
-- and also more efficient, since it passes as many arguments to each shell as possible rather than starting one shell per line in your input file.
May 30, 2017 at 17:24
Both solutions work even when lines have spaces:
readarray -t my_args < foo.txt
my_command "${my_args[@]}"
if readarray
doesn't work, replace it with mapfile
, they're synonyms.
I formerly tried this one below, but had problems when my_command
was a script:
xargs -d '\n' -a foo.txt my_command
After editing @Wesley Rice's answer a couple times, I decided my changes were just getting too big to continue changing his answer instead of writing my own. So, I decided I need to write my own!
Read each line of a file in and operate on it line-by-line like this:
#!/bin/bash
input="/path/to/txt/file"
while IFS= read -r line
do
echo "$line"
done < "$input"
This comes directly from author Vivek Gite here: https://www.cyberciti.biz/faq/unix-howto-read-line-by-line-from-file/. He gets the credit!
Syntax: Read file line by line on a Bash Unix & Linux shell:
1. The syntax is as follows for bash, ksh, zsh, and all other shells to read a file line by line
2.while read -r line; do COMMAND; done < input.file
3. The-r
option passed to read command prevents backslash escapes from being interpreted.
4. AddIFS=
option before read command to prevent leading/trailing whitespace from being trimmed -
5.while IFS= read -r line; do COMMAND_on $line; done < input.file
And now to answer this now-closed question which I also had: Is it possible to `git add` a list of files from a file? - here's my answer:
Note that FILES_STAGED
is a variable containing the absolute path to a file which contains a bunch of lines where each line is a relative path to a file I'd like to do git add
on. This code snippet is about to become part of the "eRCaGuy_dotfiles/useful_scripts/sync_git_repo_to_build_machine.sh" file in this project, to enable easy syncing of files in development from one PC (ex: a computer I code on) to another (ex: a more powerful computer I build on): https://github.com/ElectricRCAircraftGuy/eRCaGuy_dotfiles.
while IFS= read -r line
do
echo " git add \"$line\""
git add "$line"
done < "$FILES_STAGED"
git add
on it: Is it possible to `git add` a list of files from a file?