What's the best way to go about making a patch for a binary file? I want it to be simple for users to apply(a simple patch application would be nice). Running diff on the file just gives Binary files [...] differ
Check out bsdiff and bspatch (website, manpage, paper, GitHub fork).
To install this tool:
- Windows: Download and extract this package. You will also need a copy of
bzip2.exeinPATH; download that from the "Binaries" link here. - macOS: Install Homebrew and use it to install
bsdiff. - Linux: Use your package manager to install
bsdiff.
-
2Quite old source. It is not easy to compile with modern Visual Studio- with VS 2009 it has worked, but I got errors with newer versions. Furthermore it is only 32-bit- which is a real issue concerning the memory consumption (see other answers). I am not sure, if just compiling with x64 fixes this- I switched to a .NET port, see other answer.– PhilmJul 7 '15 at 17:23
-
1
bsdiffandcourgetteare optimized for executable binaries; found some unofficial Windows binaries, but it failed right away Sep 5 '17 at 7:44
Courgette, by the Google Chrome team, looks like most efficient tool for binary patching executables.
To quote their data:
Here are the sizes for the recent 190.1 -> 190.4 update on the developer channel:
- Full update: 10,385,920 bytes
- bsdiff update: 704,512 bytes
- Courgette update: 78,848 bytes
Here are instructions to build it. Here is a Windows binary from 2018 courtesy of Mehrdad.
-
10The document says, "we wrote a new diff algorithm that knows more about the kind of data we are pushing - large files containing compiled executables". The implication is that it won't work as well (or maybe not at all) for other binary files.– JamesJul 8 '14 at 10:56
-
2Thank you for that link. But it is a real story to get it compiled under Windows. It installs a whole developer system first, e.g. Git, Python, etc. Maybe it works, but on my machine, the fetch has used some ports which were secured and failed. Anybody knows a binary download link?– PhilmJul 7 '15 at 17:40
-
2@James Courgette is a true successor of
bsdiff. From the document: Courgettediff = bsdiff(concat(original, guess), update). With a reasonablebdiffalgorithm you havelen(bdiff(concat(original,guess),update)) < len(bdiff(original,update))+Cwith a small (constant)C. HavingCset to 10 is a safe bet. Perhaps someone can calculate theCforbsdiff. Note that C==1 if the givenbdiffalgorithm guaranteeslen(bdiff(concat(original,random),update)) <= len(bdiff(original,update))for any values of original, random and update.– TinoJun 30 '16 at 7:16 -
1Unlike bsdiff's output, which is already compressed (with bzip2), you can further reduce the size of Courgette's output by using something like gzip or lzma on it. Feb 4 '19 at 7:23
xdelta (website, GitHub) is another option. It seems to be more recent, but otherwise I have no idea how it compares to other tools like bsdiff.
Usage:
- Creating a patch:
xdelta -e -s old_file new_file delta_file - Applying a patch:
xdelta -d -s old_file delta_file decoded_new_file
Installation:
- Windows: Download the official binaries.
- Chocolatey:
choco install xdelta3 - Homebrew:
brew install xdelta - Linux: Available as
xdeltaorxdelta3in your package manager.
-
-
This just saved me hours. Needed to test a certain build of an exe self extracting installer that was 1.1 GB. Copying that over the vpn was going to take 2.5 hours. I already had a different release from 3 months ago... Followed your instructions, the generated patch was (luckily) 18MB - guess there have only been minor changes. Applied the patch on the remote system. Performed various checksums on newly patched exe and it matches on both systems. There are so many ways this could have not worked but in my case it worked perfectly!– RyanFeb 17 at 23:50
Modern port: Very useful .NET port for bsdiff/bspatch:
https://github.com/LogosBible/bsdiff.net
My personal choice. I tested it, and it was the only of all links, I was able out of the box to compile it (with Visual Studio, e.g. 2013). (The C++ source elsewhere is a bit outdated and needs at least a bit polishing and is only 32 bit which sets real memory (diff source size) limits. This is a port of this C++ code bsdiff and even tests if the patch results are identical to original code).
Further idea: With .NET 4.5 you could even get rid of #Zip lib, which is a dependency here.
I haven't measured if it is slightly slowlier than the c++ code, but it worked fine for me, (bsdiff: 90 MB file in 1-2 min.), and time-critical for me is only the bspatch, not the bsdiff.
I am not really sure, if the whole memory of a x64 machine is used, but I assume it. The x64 capable build ("Any CPU") works at least. Tried with a 100 MB file.
- Besides: The cited Google project 'Courgette' may be the best choice if your main target are executable files. But it is work to build it (for Windows measures, at least), and for binary files it is also using pure bsdiff/bspatch, as far as I have understood the doc.
For small, simple patches, it's easiest just to tell diff to treat the files as text with the -a (or --text) option. As far as I understand, more complicated binary diffs are only useful for reducing the size of patches.
$ man diff | grep -B1 "as text"
-a, --text
treat all files as text
$ diff old new
Binary files old and new differ
$ diff -a old new > old.patch
$ patch < old.patch old
patching file old
$ diff old new
$
If the files are the same size and the patch just modifies a few bytes, you can use xxd, which is commonly installed with the OS. The following converts each file to a hex representation with one byte per line, then diffs the files to create a compact patch, then applies the patch.
$ xxd -c1 old > old.hex
$ xxd -c1 new > new.hex
$ diff old.hex new.hex | grep "^+" | grep -v "^++" | sed "s/^+//" > old.hexpatch
$ xxd -c1 -r old.hexpatch old
$ diff old new
$
HDiffPatch: https://github.com/sisong/HDiffPatch
can run on: windows,macos,linux,android
support diff between binary files or directories;
Creating a patch: hdiffz [-m|-s-64] [-c-lzma2] old_path new_path out_delta_file
Applying a patch: hpatchz old_path delta_file out_new_path
install:
Download from last release,or Download download Source code & make;
Jojos Binary Diff: https://sourceforge.net/projects/jojodiff/
another good binary diff algorithm;
diff and git-diff can handle binary files by treating them as text with -a.
With git-diff you can also use --binary which produces ASCII encodings of binary files, suitable for pasting into an email for example.
https://github.com/reproteq/DiffPatchWpf DiffPatchWpf DiffPatchWpf simple binary patch maker tool.
Compare two binary files and save the differences between them in new file patch.txt
Apply the patch in another binary fast and easy.
Now you can apply the differences in another binary quickly and easily.
example:
1- Load file Aori.bin
2- Load file Amod.bin
3- Compare and save Aori-patch.txt
4- Load file Bori.bin
5- Load patch Aori-patch.txt
6- Apply patch and save file Bori-patched.bin
alt tag
Microsoft Visual Studio Community 2019
Versión 16.7.7
.NETFramework,Version=v4.7.2
Tested in windows 10x64bits
Assuming you know the structure of the file you could use a c / c++ program to modify it byte by byte:
http://msdn.microsoft.com/en-us/library/c565h7xx(VS.71).aspx
Just read in the old file, and write out a new one modified as you like.
Don't forget to include a file format version number in the file so you know how to read any given version of the file format.
-
5This solution is insane. Using C / C++ when
sedalready does everything you could ever want. Or, if you'd prefer to use an industrial-strength portable programming language,perl's your best bet. If I'm writing router firmware, of course I'll go with C or C++, but diffing...? Jun 5 '15 at 23:33