What is the quickest and most pragmatic way to combine all *.txt file in a directory into one large text file?
Currently I'm using windows with cygwin so I have access to BASH.
Windows shell command would be nice too but I doubt there is one.
This appends the output to all.txt
cat *.txt >> all.txt
This overwrites all.txt
cat *.txt > all.txt
echo *.txt | xargs cat > all.txt
Just remember, for all the solutions given so far, the shell decides the order in which the files are concatenated. For Bash, IIRC, that's alphabetical order. If the order is important, you should either name the files appropriately (01file.txt, 02file.txt, etc...) or specify each file in the order you want it concatenated.
$ cat file1 file2 file3 file4 file5 file6 > out.txt
The Windows shell command type
can do this:
type *.txt > outputfile.txt
Type type
command also writes file names to stderr, which are not captured by the >
redirect operator (but will show up on the console).
You can use Windows shell copy
to concatenate files.
C:\> copy *.txt outputfile
From the help:
To append files, specify a single file for destination, but multiple files for source (using wildcards or file1+file2+file3 format).
Be careful, because none of these methods work with a large number of files. Personally, I used this line:
for i in $(ls | grep ".txt");do cat $i >> output.txt;done
EDIT: As someone said in the comments, you can replace $(ls | grep ".txt")
with $(ls *.txt)
EDIT: thanks to @gnourf_gnourf expertise, the use of glob is the correct way to iterate over files in a directory. Consequently, blasphemous expressions like $(ls | grep ".txt")
must be replaced by *.txt
(see the article here).
Good Solution
for i in *.txt;do cat $i >> output.txt;done
for i in $(ls *.txt);do cat $i >> output.txt;done
?
Commented
Nov 12, 2018 at 21:49
ls | grep
is a seriously bad antipattern).
Commented
Jan 25, 2019 at 9:23
ls *.txt
fail if there are too many files (Argument list too long error)?
Commented
Mar 21, 2019 at 15:25
How about this approach?
find . -type f -name '*.txt' -exec cat {} + >> output.txt
-maxdepth 1
to the find
command.
Commented
Jul 25, 2017 at 2:52
sort -u --output="$OUTPUT_FILE" --files0-from=- < <(find "$DIRECTORY_NAME" -maxdepth 1 -type f -name '*.txt' -print0)
find
. My favourite! Surely cat *.txt > all.txt
does the job within the same directory (as pointed out above). To me, however, becoming comfortably fluent in using find
has been a very good habit. Today they're all in one folder, tomorrow they have multiple file-endings across nested directory hierarchies. Don't overcomplicate, but also, do make friends with find
. :)
the most pragmatic way with the shell is the cat command. other ways include,
awk '1' *.txt > all.txt
perl -ne 'print;' *.txt > all.txt
cat
method will concatenate last line and first line from adjacent files.
type [source folder]\*.[File extension] > [destination folder]\[file name].[File extension]
For Example:
type C:\*.txt > C:\1\all.txt
That will Take all the txt files in the C:\ Folder and save it in C:\1 Folder by the name of all.txt
Or
type [source folder]\* > [destination folder]\[file name].[File extension]
For Example:
type C:\* > C:\1\all.txt
That will take all the files that are present in the folder and put there Content in C:\1\all.txt
You can do like this:
cat [directory_path]/**/*.[h,m] > test.txt
if you use {}
to include the extension of the files you want to find, there is a sequencing problem.
The most upvoted answers will fail if the file list is too long.
A more portable solution would be using fd
fd -e txt -d 1 -X awk 1 > combined.txt
-d 1
limits the search to the current directory. If you omit this option then it will recursively find all .txt
files from the current directory.
-X
(otherwise known as --exec-batch
) executes a command (awk 1
in this case) for all the search results at once.
Note,
fd
is not a "standard" Unix program, so you will likely need to install it
bash: fd: command not found
It should be mentioned that fd is a package you must install yourself.
Commented
Oct 3, 2021 at 0:56
When you run into a problem where it cats all.txt into all.txt, You can try check all.txt is existing or not, if exists, remove
Like this:
[ -e $"all.txt" ] && rm $"all.txt"
cat *.txt > all.txt
>
command overwrites all.txt if it exists >>
adds data to existing file
Commented
Jun 12, 2019 at 15:15
all of that is nasty....
ls | grep *.txt | while read file; do cat $file >> ./output.txt; done;
easy stuff.
find . -iname "*.txt" -maxdepth 1 -exec cat {} >> out.txt \;
Commented
Jan 28, 2010 at 11:43