I need to replace a string in a lot of files in a folder, with only ssh
access to the server. How can I do this?
30 Answers
cd /path/to/your/folder
sed -i 's/foo/bar/g' *
Occurrences of "foo" will be replaced with "bar".
On BSD systems like macOS, you need to provide a backup extension like -i '.bak'
or else "risk corruption or partial content" per the manpage.
cd /path/to/your/folder
sed -i '.bak' 's/foo/bar/g' *
-
18This doesn't seem to work for me if the string has whitespaces or special characters in it. Any idea why that might be, or do I need to escape them some how? Thanks! Commented Aug 6, 2014 at 17:54
-
16At least for my version of
sed
,-i
requires a string after it, which is appended to the old file names. Sosed -i .bak 's/foo/bar/g' *.xx
moves all.xx
files to the equivalent.xx.bak
name and then generates the.xx
files with the foo→bar substitution.– AnaphoryCommented Oct 4, 2014 at 22:35 -
40If anybody want to look for more options, there is an answer on unix stack exchange which covers more use cases site unix.stackexchange.com/a/112024/13488– ReddyCommented May 22, 2015 at 9:40
-
43@MatthewHerbst to escape spaces, use \ like
sed -i 's/foo\ with\ spaces/bar/g' *
. I suppose you've found out after so long... but this way it stays for others finding the same issue. Commented Dec 21, 2016 at 8:44 -
12For something recursive you could try the following. Note that it doesn't work if the list of files is huge.
sed -i -e 's/foo/bar/g' $(find /home/user/base/dir)
– ScotCommented Mar 28, 2018 at 3:06
Similar to Kaspar's answer but with the g flag to replace all the occurrences on a line.
find ./ -type f -exec sed -i 's/old_string/new_string/g' {} \;
For global case insensitive:
find ./ -type f -exec sed -i 's/old_string/new_string/gI' {} \;
Ignoring .git
directory:
find . -not -path '*/\.git/*' -name '*.rb' -exec sed -i 's/old_string/new_string/g' '{}' \;
-
31
-
2This definitely worked for me, as it enables filtering with -name "*.js"' Commented Feb 17, 2016 at 11:30
-
24Don't do this from the root of a checked-out Git repo. You might accidentally corrupt its database in
.git/
. Be sure tocd
down to a lower level. Commented Mar 7, 2017 at 20:27 -
3I just did this in my git repo and now
git status
returns:error: bad index file sha1 signature.... fatal: index file corrupt
. What gives?– JinCommented Feb 2, 2018 at 20:51 -
2This works, but not if you have special characters in the string, such as when changing a path. To get around this, us the following in the respective part of the command in this answer,
sed -i 's@old_path@new_path@g'
Commented Feb 28, 2018 at 5:56
@kev's answer is good, but only affects files in the immediate directory. The example below uses grep
to recursively find files. It works for me every time.
grep -rli 'old-word' * | xargs -i@ sed -i 's/old-word/new-word/g' @
Command breakdown
grep -r
: --recursive
, recursively read all files under each directory.
grep -l
: --print-with-matches
, prints the name of each file that has a match, instead of printing matching lines.
grep -i
: --ignore-case
.
xargs
: transform the STDIN to arguments, following this answer.
xargs -i@ ~command contains @~
: a placeholder for the argument to be used in a specific position in the ~command~
. The @
sign is a placeholder which could replaced by any string.
sed -i
: edit files in place, without backups.
sed s/regexp/replacement/
: substitute string matching regexp
with replacement
.
sed s/regexp/replacement/g
: global, make the substitution for each match instead of only the first match.
-
17this did not work for me, but this did:
grep --include={*.php,*.html,*.js} -rnl './' -e "old-word" | xargs -i@ sed -i 's/old-word/new-word/g' @
– DennisCommented Mar 5, 2014 at 22:20 -
9@pymarco Can you please explain this command? I don't know why you had to use xargs instead of just using sed after
|
, also, why-i
in xargs command? I read in the manual it is deprecated and should use-I
instead. And is@
used as a delimiter for beginning and end for pattern? Commented Nov 9, 2015 at 14:57 -
2
-
22On osx this is ok :
grep -rli 'old-word' * | xargs -I@ sed -i '' 's/2.0.0/latest/g' @
Commented Oct 27, 2017 at 10:14 -
1It would be nice if you broke down some of the options (
rli
) and the@
sign for example– FoobarCommented Aug 27, 2018 at 13:43
There are a few standard answers to this already listed. Generally, you can use find to recursively list the files and then do the operations with sed or perl.
rpl
For most quick uses, you may find the command rpl is much easier to remember.
Replace foo
with bar
on all .txt
files:
rpl -v foo bar '*.txt'
Simulate replacing the regex foo.*
with bar
in all .txt
files recursively:
rpl --dry-run 'foo.*' bar '**/*.txt'
You'll probably need to install it (apt-get install rpl
or similar).
repren
However, for tougher jobs that involve regular expressions and back substitution, or file renames as well as search-and-replace, the most general and powerful tool I'm aware of is repren, a small Python script I wrote a while back for some thornier renaming and refactoring tasks. The reasons you might prefer it are:
- Support renaming of files as well as search-and-replace on file contents.
- See changes before you commit to performing the search and replace.
- Support regular expressions with back substitution, whole words, case insensitive, and case preserving (replace foo -> bar, Foo -> Bar, FOO -> BAR) modes.
- Works with multiple replacements, including swaps (foo -> bar and bar -> foo) or sets of non-unique replacements (foo -> bar, f -> x).
To use it, pip install repren
. Check the README for examples.
-
3Wow, repren is excellent! Just used it to change part of a word inside of class names, methods and variables while renaming files to match across 1,000+ C++ header and source files and it worked perfectly the first time with one command. Thank you! Commented Nov 1, 2017 at 18:49
-
-
1Unfortunately seems like this is a Python 2 only tool. Any idea if this is ever getting migrated to Python 3?– LouCommented Jun 16, 2023 at 15:47
This worked for me:
find ./ -type f -exec sed -i 's/string1/string2/' {} \;
However, this did not: sed -i 's/string1/string2/g' *
. Maybe "foo" was not meant to be string1 and "bar" not string2.
-
1It is because sed treats the wildcard * differently. [abc]* means an arbitrary number of characters of the set {a, b, c}. [a-z0-9]* works similar to the wildcard *. Commented Mar 17, 2016 at 0:19
-
17On OSX use:
find ./ -type f -exec sed -i '' -e 's/string1/string2/' {} \;
Commented Apr 16, 2018 at 11:03
To replace a string in multiple files you can use:
grep -rl string1 somedir/ | xargs sed -i 's/string1/string2/g'
E.g.
grep -rl 'windows' ./ | xargs sed -i 's/windows/linux/g'
Given you want to search for the string search
and replace it with replace
across multiple files, this is my battle-tested, one-line formula:
grep -RiIl 'search' | xargs sed -i 's/search/replace/g'
Quick grep explanation:
-R
- recursive search-i
- case-insensitive-I
- skip binary files (you want text, right?)-l
- print a simple list as output. Needed for the other commands
The grep output is then piped to sed (through xargs) which is used to actually replace text. The -i
flag will alter the file directly. Remove it for a kind of "dry run" mode.
-
4If the text happens to be a url, remember you use different delimiters with sed ike this: 's#search#replace#g' Commented Jan 14, 2022 at 21:42
-
2When using
grep -i
for case-insensitive search, you also need to let sed do its own search in a case-insensitive way. For that, replace the sed command withsed -i 's/search/replace/gI'
.– taniusCommented Mar 21, 2022 at 2:48 -
1I think this breaks when a file name contains a 'newline' character.– kniaCommented Apr 5, 2023 at 13:33
To replace a path within files (avoiding escape characters) you may use the following command:
sed -i 's@old_path@new_path@g'
The @ sign means that all of the special characters should be ignored in a following string.
-
7Exactly what I was looking for in all the other answers. Namely, how to deal with special characters, such as when changing a string that is a path. Thank you. Seemed like a big oversight in the other answers. Commented Feb 28, 2018 at 5:54
-
The
@
has no special meaning.sed
allows you to use almost any character as the separator between the sections,s@..@...@
,s|..|..|
,s,...,...,
, ands/.../.../
are all identical and common options. The only difference here is that you're much less likely to have an@
inold_path
than to have a/
.– mtalexanCommented Aug 29 at 15:16
In case your string has a forward slash(/) in it, you could change the delimiter to '+'.
find . -type f -exec sed -i 's+http://example.com+https://example.com+g' {} +
This command would run recursively in the current directory.
-
Thanks! Helped change a load of references of
../domain.com
todomain.com
– JackCommented Mar 8, 2018 at 17:29
If you have list of files you can use
replace "old_string" "new_string" -- file_name1 file_name2 file_name3
If you have all files you can use
replace "old_string" "new_string" -- *
If you have list of files with extension, you can use
replace "old_string" "new_string" -- *.extension
-
2actually, "--file" should just be "--", at least in my version Commented Oct 7, 2014 at 23:34
-
5This utility is distributed within MySQL packages. Commented Oct 14, 2014 at 16:00
-
2Though I would like to appreciate solution, which works without quoting regular line to be regular expression. Commented Oct 14, 2014 at 16:05
-
1This works fine - and if you want to replace all strings in multiple files, which end in e.g. ".txt" , you can just do
replace "old_string" "new_string" -- *.txt
Commented Apr 6, 2016 at 12:56 -
2It's better to add from where to get this
replace
utility. Without this information, this answer is incomplete.– SiteshCommented Apr 3, 2018 at 4:34
"You could also use find and sed, but I find that this little line of perl works nicely.
perl -pi -w -e 's/search/replace/g;' *.php
- -e means execute the following line of code.
- -i means edit in-place
- -w write warnings
- -p loop
" (Extracted from http://www.liamdelahunty.com/tips/linux_search_and_replace_multiple_files.php)
My best results come from using perl and grep (to ensure that file have the search expression )
perl -pi -w -e 's/search/replace/g;' $( grep -rl 'search' )
-
I prefer this as its cross-platform with no effort between Mac/Linux– BenCommented Apr 23, 2022 at 22:41
The first line occurrences of "foo" will be replaced with "bar". And you can using the second line to check.
grep -rl 'foo' . | xargs sed -i 's/foo/bar/g'
grep 'foo' -r * | awk -F: {'print $1'} | sort -n | uniq -c
-
6Why are you linking to to your blog? It contains exactly the same text as your answer. Commented May 1, 2017 at 21:07
-
1
On a MacBook Pro, I used the following (inspired by https://stackoverflow.com/a/19457213/6169225):
sed -i '' -e 's/<STR_TO_REPLACE>/<REPLACEMENT_STR>/g' *
-i ''
will ensure you are taking no backups.
-e
for modern regex.
-
4
-e
just tells sed that the next token is a command. For extended regular expressions, use-E
instead. Commented May 17, 2019 at 13:46
I did concoct my own solution before I found this question (and answers). I searched for different combinations of "replace" "several" and "xml," because that was my application, but did not find this particular one.
My problem: I had spring xml files with data for test cases, containing complex objects. A refactor on the java source code changed a lot of classes and did not apply to the xml data files. In order to save the test cases data, I needed to change all the class names in all the xml files, distributed across several directories. All while saving backup copies of the original xml files (although this was not a must, since version control would save me here).
I was looking for some combination of find
+ sed
, because it worked for me in other situations, but not with several replacements at once.
Then I found ask ubuntu response and it helped me build my command line:
find -name "*.xml" -exec sed -s --in-place=.bak -e 's/firstWord/newFirstWord/g;s/secondWord/newSecondWord/g;s/thirdWord/newThirdWord/g' {} \;
And it worked perfectly (well, my case had six different replacements). But please note that it will touch all *.xml files under current directory. Because of that, and if you are accountable to a version control system, you might want to filter first and only pass on to sed
those actually having the strings you want; like:
find -name "*.xml" -exec grep -e "firstWord" -e "secondWord" -e "thirdWord" {} \; -exec sed -s --in-place=.bak -e 's/firstWord/newFirstWord/g;s/secondWord/newSecondWord/g;s/thirdWord/newThirdWord/g' {} \;
-
and for windows, I just found out that there is a way to find the string --didn't check yet how to replace it-- in one command:
findstr /spin /c:"quéquieresbuscar" *.xml
It will be handy. Commented Jun 8, 2016 at 11:07
Really lame, but I couldn't get any of the sed commands to work right on OSX, so I did this dumb thing instead:
:%s/foo/bar/g
:wn
^- copy these three lines into my clipboard (yes, include the ending newline), then:
vi *
and hold down command-v until it says there's no files left.
Dumb...hacky...effective...
I'd just like to add a note to do two things at once - find a file that contains a string and then do a replace, using the find 'chaining' method:
find . -type f -iname \*.php -exec fgrep -l "www." {} \; -exec sed -i "s|www||g" {} \;
In this real case, remove the anachronistic 'www' from urls found in PHP files.
The 'fgrep -l' only triggers if it finds at least one match in a file, it produces no other output. Don't forget the '\;' separators!
grep --include={*.php,*.html} -rnl './' -e "old" | xargs -i@ sed -i 's/old/new/g' @
script for multiedit command
multiedit [-n PATTERN] OLDSTRING NEWSTRING
From Kaspar's answer I made a bash script to accept command line arguments and optionally limit the filenames matching a pattern. Save in your $PATH and make executable, then just use the command above.
Here's the script:
#!/bin/bash
_help="\n
Replace OLDSTRING with NEWSTRING recursively starting from current directory\n
multiedit [-n PATTERN] OLDSTRING NEWSTRING\n
[-n PATTERN] option limits to filenames matching PATTERN\n
Note: backslash escape special characters\n
Note: enclose STRINGS with spaces in double quotes\n
Example to limit the edit to python files:\n
multiedit -n \*.py \"OLD STRING\" NEWSTRING\n"
# ensure correct number of arguments, otherwise display help...
if [ $# -lt 2 ] || [ $# -gt 4 ]; then echo -e $_help ; exit ; fi
if [ $1 == "-n" ]; then # if -n option is given:
# replace OLDSTRING with NEWSTRING recursively in files matching PATTERN
find ./ -type f -name "$2" -exec sed -i "s/$3/$4/g" {} \;
else
# replace OLDSTRING with NEWSTRING recursively in all files
find ./ -type f -exec sed -i "s/$1/$2/" {} \;
fi
-
This works well, but it's fairly slow. Took me 8 seconds to do a global replace in a Rails project. Using grep, ack or ag would be much faster than passing in all the files to sed. For me it took less than 0.1 seconds. The relevant line:
grep -RIl "$1" | xargs sed -i "s/$1/$2/g"
– JoshCommented May 19 at 21:59
To maintain my personal English node, I wrote an utility script that help to replace multiple pair of old/new string, for all files under a directory recursively.
The multiple pair of old / new string are managed in a hash map.
The dir can be set via command line or environment variable, the map is hard coded in the script, but you can modify the code to load from a file, if necessary.
It requires bash 4.2, due to some new feature.
en_standardize.sh:
#! /bin/bash
# (need bash 4.2+,)
#
# Standardize phonetic symbol of English.
#
# format:
# en_standardize.sh [<dir>]
#
# params:
# * dir
# target dir, optional,
# if not specified then use environment variable "$node_dir_en",
# if both not provided, then will not execute,
# *
#
paramCount=$#
# figure target dir,
if [ $paramCount -ge 1 ]; then # dir specified
echo -e "dir specified (in command):\n\t$1\n"
targetDir=$1
elif [[ -v node_dir_en ]]; then # environable set,
echo -e "dir specified (in environment vairable):\n\t$node_dir_en\n"
targetDir=$node_dir_en
else # environable not set,
echo "dir not specified, won't execute"
exit
fi
# check whether dir exists,
if [ -d $targetDir ]; then
cd $targetDir
else
echo -e "invalid dir location:\n\t$targetDir\n"
exit
fi
# initial map,
declare -A itemMap
itemMap=( ["ɪ"]="i" ["ː"]=":" ["ɜ"]="ə" ["ɒ"]="ɔ" ["ʊ"]="u" ["ɛ"]="e")
# print item maps,
echo 'maps:'
for key in "${!itemMap[@]}"; do
echo -e "\t$key\t->\t${itemMap[$key]}"
done
echo -e '\n'
# do replace,
for key in "${!itemMap[@]}"; do
grep -rli "$key" * | xargs -i@ sed -i "s/$key/${itemMap[$key]}/g" @
done
echo -e "\nDone."
exit
The stream editor does modify multiple files “inplace” when invoked with the -i
switch, which takes a backup file ending as argument. So
sed -i.bak 's/foo/bar/g' *
replaces foo
with bar
in all files in this folder, but does not descend into subfolders. This will however generate a new .bak
file for every file in your directory.
To do this recursively for all files in this directory and all its subdirectories, you need a helper, like find
, to traverse the directory tree.
find ./ -print0 | xargs -0 sed -i.bak 's/foo/bar/g' *
find
allows you further restrictions on what files to modify, by specifying further arguments like find ./ -name '*.php' -or -name '*.html' -print0
, if necessary.
Note: GNU sed
does not require a file ending, sed -i 's/foo/bar/g' *
will work, as well; FreeBSD sed
demands an extension, but allows a space in between, so sed -i .bak s/foo/bar/g *
works.
Using the ack command would be alot faster like this:
ack '25 Essex' -l | xargs sed -i 's/The\ fox \jump/abc 321/g'
Also if you have a white space in the search result. You need to escape it.
If the file contains backslashes (paths usually) you can try something like this:
sed -i -- 's,<path1>,<path2>,g' *
ex:
sed -i -- 's,/foo/bar,/new/foo/bar,g' *.sh (in all shell scripts available)
There is an easier way by using a simple script file:
# sudo touch /bin/replace_string_files_present_dir
# sudo chmod +x /bin/replace_string_files_present_dir
open the file in gedit or an editor of your choice, I use gedit here.
# sudo gedit /bin/replace_string_files_present_dir
Then in the editor paste the following in the file
#!/bin/bash
replace "oldstring" "newstring" -- *
replace "oldstring1" "newstring2" -- *
#add as many lines of replace as there are your strings to be replaced for
#example here i have two sets of strings to replace which are oldstring and
#oldstring1 so I use two replace lines.
Save the file, close gedit, then exit your terminal or just close it and then start it to be able load the new script you added.
Navigate to the directory where you have multiple files you want to edit. Then run:
#replace_string_files_present_dir
Press enter and this will automatically replace the oldstring and oldstring1 in all the files that contain them with the correct newstring and newstring1 respectively.
It will skip all the directories and files that don't contain the old strings.
This might help in eliminating the tedious work of typing in case you have multiple directories with files that need string replacement. All you have to do is navigate to each of those directories, then run:
#replace_string_files_present_dir
All you have to do is to ensure you've included or added all the replacement strings as I showed you above:
replace "oldstring" "newstring" -- *
at the end of the file /bin/replace_string_files_present_dir.
To add a new replace string just open the script we created by typing the following in the terminal:
sudo gedit /bin/replace_string_files_present_dir
Don't worry about the number of replace strings you add, they will have no effect if the oldstring is not found.
-
1Usually, when people ask "how to ${whatever}" in bash, they are asking for a compact version to include in a script or CI jobs instruction (say a
.gitlab-ci.yml
or atravis.yml
). Every turn around consisting in writing a script to execute it later is an anti-pattern, for you'll then need to script the script creation (and I goes messy, most of the time)– zar3bskiCommented Apr 30, 2020 at 13:05 -
@zar3bski wut? You really should be putting your individual CI steps in separate shell files so that they are portable to other CI systems. It also makes them testable locally.– airtonixCommented Apr 2, 2021 at 7:20
I found this one from another post (can't remember which) and while not the most elegant, it's simple and as a novice Linux user has given me no trouble
for i in *old_str* ; do mv -v "$i" "${i/\old_str/new_str}" ; done
if you have spaces or other special characters use a \
for i in *old_str\ * ; do mv -v "$i" "${i/\old_str\ /new_str}" ; done
for strings in sub-directories use **
for i in *\*old_str\ * ; do mv -v "$i" "${i/\old_str\ /new_str}" ; done
I am giving an example for fixing a common shebang error in python sources.
You can try the grep/sed approach. Here is one that works with GNU sed and won't break a git repo:
$ grep -rli --exclude '*.git*' '#!/usr/bin/python' . | xargs -I {} \
gsed -i '' -e 's/#!\/usr\/bin\/python/#!\/usr\/bin\/env python/' {}
Or you can use greptile :)
$ greptile -x .py -l -i -g '#!/usr/bin/env python' -r '#!/usr/bin/python' .
I just tested the first script, and the second should work as well. Be careful with escape characters, I think it should be easier to use greptile in most cases. Of course, you can do many interesting things with sed, and for that it may be preferable to master using it with xargs.
My problem with many of the answers was that I needed to replace a filepath inside of many files. Though one answer provided mentioned this, it did not work for me. My solution:
First, generate a list of the filenames that you want to be changed.
filelist=($(find /path/to/your/folder | xargs grep '/path/to/fix' | cut -d : -f 1 | tr '\n' ' '))
What the commands above do is that the find
piped to grep
generates the names of the files with the /path/to/fix
inside. However, grep
also prints out the line that the string was found on, so the cut
command gets rid of this and just keeps the filename. tr
replaces newline characters with spaces, which allows for filelist
to be stored as an array.
for file in "${filelist[@]}"; do sed -i.bak 's+/path/to/fix+/new/path/for/my/file+g' $file; done
This sed
command draws on other answers to this question, and uses +
as delimiters rather than the normal /
, since the /
characters are being used in the filepath.
-
You can use
grep -l
to get rid of thecut
and-m1
to speed it up. If you are not recursing directories here, you didn't need thefind
either. Thetr
can be avoided by settingIFS
to newline. It will also fail on filenames with spaces. So, simplified:IFS=$'\n' filelist=($(grep -IRlim1 'path/to/fix' .) )
. But the other find+sed answers already work fine for paths as long as you use a different delimiter, like you did with '+'. Commented Mar 28 at 5:32
After research I found this solution (\b is for word limit if you only want to change words):
$ STRING_OLD="\bPeter\b"; STRING_NEW="John"; find bin/ -type f -name '*.sh' -not -name "*.bak" -print0 | xargs -0 grep -Zl "$STRING_OLD" | xargs -t -0 sed -i.bak 's/'"$STRING_OLD"'/'"$STRING_NEW"'/g'
It works with filenames/directories with spaces,tabs,new lines and non ASCII chars.
Variable STRING_OLD is a regexp for sed s/regexp/replacement/ command. You must be aware of it.
You also see changed files. It only changes (and backs up) in files where STRING_OLD is found in regexp. The rest of the files remain untouched (that's what I wanted).
I used ag
, the_silver_searcher:
ag -0 -l 'old' | xargs -0 sed -ri.bak -e 's/old/new/g';
Then git clean
to remove .bak files (rm
was being buggy when running inside a git rebase exec
)
git clean -f '**/*.bak';
On the command line it depends on the string you're trying to search-and-replace. What works in my case:
STR="a-?fairly@complicated,*String;but%3A=fortunately&without_quotes.css"
for f in $(grep -lir "$STR" *); do sed -i "s/$STR/newstyle.css/g" $f; done
66% speed boost relative to find
, grepping recursively over ~15k files generated by a web spider. The grep
-with-xargs -i@
answer didn't work for me, possibly due to the @
symbol.
Below command can be used to first search the files and replace the files:
find . | xargs grep 'search string' | sed 's/search string/new string/g'
For example
find . | xargs grep abc | sed 's/abc/xyz/g'