368
votes

I'm currently developing an application using a MySQL database.

The database-structure is still in flux and changes while development progresses (I change my local copy, leaving the one on the test-server alone).

Is there a way to compare the two instances of the database to see if there were any changes?

While currently simply discarding the previous test server database is fine, as testing starts entering test data it could get a bit tricky.
The same though more so will happen again later in production...

Is there an easy way to incrementally make changes to the production database, preferably by automatically creating a script to modify it?


Tools mentioned in the answers:

9
  • 4
    I believe RedGate's tools are for SQL Server only.
    – Dave R.
    Dec 23, 2008 at 15:50
  • 4
    Red Gate now has a MySQL version as well, currently free as it's in extended early access: red-gate.com/products/MySQL_Compare/index.htm Oct 24, 2010 at 12:58
  • 2
    It is a real problem. I deploy from dev to production machine and it ALWAYS breaks something. Thank you for this informative post
    – Herr
    May 15, 2011 at 9:37
  • 1
    The MySQL tool from Redgate is now $70/user. Even at that price I'll evaluate and post comments here. Jul 17, 2011 at 21:01
  • Also needed this just now, had to increase the size of a field. Didn't want to just increase it and suspect everything was okay. @Jared suggested exactly what I used.
    – Tass
    Jan 20, 2012 at 21:52

21 Answers 21

210
votes

If you're working with small databases I've found running mysqldump on both databases with the --skip-comments and --skip-extended-insert options to generate SQL scripts, then running diff on the SQL scripts works pretty well.

By skipping comments you avoid meaningless differences such as the time you ran the mysqldump command. By using the --skip-extended-insert command you ensure each row is inserted with its own insert statement. This eliminates the situation where a single new or modified record can cause a chain reaction in all future insert statements. Running with these options produces larger dumps with no comments so this is probably not something you want to do in production use but for development it should be fine. I've put examples of the commands I use below:

mysqldump --skip-comments --skip-extended-insert -u root -p dbName1>file1.sql
mysqldump --skip-comments --skip-extended-insert -u root -p dbName2>file2.sql
diff file1.sql file2.sql
11
  • 12
    Double-plus upvotes for command-line literacy!!!
    – dogenpunk
    Jan 20, 2012 at 21:56
  • 5
    To compare data, use this instead; still be some MySQL4+ comments about character sets, etc. mysqldump --opt --compact --skip-extended-insert -u user -p db table > file.sql
    – zanlok
    Mar 6, 2012 at 21:53
  • 41
    -d, --no-data may be of interest to those needing production use but only care about the schema
    – lsl
    May 10, 2013 at 5:06
  • 7
    A better tool to use would be the mysqldbcompare utility developed by MySQL themselves which you can use on Windows, Linux or Mac - it can also output SQL statements for both data AND schema changes and does a lot more tests than a simple command line diff could determine. Oct 4, 2014 at 14:22
  • 4
    For a nice diff with colors try vimdiff
    – gitaarik
    May 20, 2015 at 12:22
98
votes

Toad for MySQL has data and schema compare features, and I believe it will even create a synchronization script. Best of all, it's freeware.

13
  • 2
    All the tools mentioned look good. I am selecting Toad arbitrarily for now until I could conduct some more research. Oct 22, 2008 at 14:25
  • 64
    I got all excited about this tool until I realized that it runs in windows, not linux. Back to searching...
    – jdias
    Sep 10, 2011 at 21:45
  • 2
    Worked fantastic for me. Did everything I needed it to do and the highlighted cells for changed records made it easy to see what changed.
    – thames
    Jan 2, 2012 at 4:35
  • 4
    mysqldbcompare with --run-all-tests --difftype sql --disable-binary-logging options can do almost the same job(except the output is mixed with comment, and special characters in string are not escaped).
    – schemacs
    Oct 27, 2012 at 11:08
  • 4
    @Anson Smith Can you tell me the alternative for linux?
    – Visruth
    Sep 25, 2013 at 5:11
20
votes

I use a piece of software called Navicat to :

  • Sync Live databases to my test databases.
  • Show differences between the two databases.

It costs money, it's windows and mac only, and it's got a whacky UI, but I like it.

4
  • It does runs on Linux. I have it open on another desktop at the moment. The structure sync feature to push schema changes from dev->test->live is worth the licence fee alone. Oct 22, 2008 at 14:10
  • 2
    Nice catch, I didn't even know it had those features. It's the best thing on the mac so far.
    – O.O
    Jul 24, 2011 at 4:33
  • It seems to only compare databases that live on servers, not native sql files
    – AlxVallejo
    Dec 11, 2014 at 14:42
  • @seanyboy, Why do you like the whacky UI?
    – Pacerier
    Feb 24, 2015 at 7:08
17
votes

There is a Schema Synchronization Tool in SQLyog (commercial) which generates SQL for synchronizing two databases.

enter image description here

3
  • 1
    yep this is the best solution to this so far for me, provides fine SQL sync queries so that you can update it anytime, anywhere..
    – Anupam
    Feb 11, 2012 at 13:00
  • over-costly and heavy, not good for after-the-fact patchings
    – zanlok
    Mar 6, 2012 at 20:00
  • 1
    Very slow, and for some reason it drops and recreates a lot of foreign keys even when it's not needed. No way to follow progress. Mar 8, 2012 at 12:54
13
votes

From the feature comparison list... MySQL Workbench offers Schema Diff and Schema Synchronization in their community edition.

3
  • 7
    Works great! And it's free, thanks. For those who couldn't find it (Like me). It's here: Database -> Reverse Engineer -> In MySQL Model or EER Diagram -> Database -> Synchronize with any source
    – bentzy
    Jun 9, 2014 at 14:29
  • It does work well. However you can only compare databases of the same name. I have multiple (multi-tenant client) databases I want to sync from a "master" version on the same host. So I have to to rename the master to match the each client db before syncing. Otherwise nice!
    – scipilot
    Apr 23, 2015 at 23:43
  • Additional info on this can be found on this link May 21, 2015 at 18:42
13
votes

There are many ways certainly, but in my case I prefer the dump and diff command. So here is an script based on Jared's comment:

#!/bin/sh

echo "Usage: dbdiff [user1:pass1@dbname1] [user2:pass2@dbname2] [ignore_table1:ignore_table2...]"

dump () {
  up=${1%%@*}; user=${up%%:*}; pass=${up##*:}; dbname=${1##*@};
  mysqldump --opt --compact --skip-extended-insert -u $user -p$pass $dbname $table > $2
}

rm -f /tmp/db.diff

# Compare
up=${1%%@*}; user=${up%%:*}; pass=${up##*:}; dbname=${1##*@};
for table in `mysql -u $user -p$pass $dbname -N -e "show tables" --batch`; do
  if [ "`echo $3 | grep $table`" = "" ]; then
    echo "Comparing '$table'..."
    dump $1 /tmp/file1.sql
    dump $2 /tmp/file2.sql
    diff -up /tmp/file1.sql /tmp/file2.sql >> /tmp/db.diff
  else
    echo "Ignored '$table'..."
  fi
done
less /tmp/db.diff
rm -f /tmp/file1.sql /tmp/file2.sql

Feedback is welcome :)

0
12
votes

dbSolo, it is paid but this feature might be the one you are looking for http://www.dbsolo.com/help/compare.html

It works with Oracle, Microsoft SQL Server, Sybase, DB2, Solid, PostgreSQL, H2 and MySQL alt text

0
11
votes

If you only need to compare schemas (not data), and have access to Perl, mysqldiff might work. I've used it because it lets you compare local databases to remote databases (via SSH), so you don't need to bother dumping any data.

http://adamspiers.org/computing/mysqldiff/

It will attempt to generate SQL queries to synchronize two databases, but I don't trust it (or any tool, actually). As far as I know, there's no 100% reliable way to reverse-engineer the changes needed to convert one database schema to another, especially when multiple changes have been made.

For example, if you change only a column's type, an automated tool can easily guess how to recreate that. But if you also move the column, rename it, and add or remove other columns, the best any software package can do is guess at what probably happened. And you may end up losing data.

I'd suggest keeping track of any schema changes you make to the development server, then running those statements by hand on the live server (or rolling them into an upgrade script or migration). It's more tedious, but it'll keep your data safe. And by the time you start allowing end users access to your site, are you really going to be making constant heavy database changes?

2
  • Don't forget to provide both --hostN and --userN or it will fail silently. May 3, 2014 at 12:30
  • I had trouble with Oracle's mysqldbcompare tools generating bugs on indexes, and altering fields that were equivalent. The mysqldiff tool worked flawlessly and saved a good bit of time.
    – Robert K
    Feb 18, 2015 at 14:27
7
votes

Have a look at http://www.liquibase.org/

0
6
votes

check: http://schemasync.org/ the schemasync tool works for me, it is a command line tool works easily in linux command line

1
  • 1
    If you are having trouble installing this on a mac, I was only able to by installing mysql and python using homebrew, with macports of no avail. Jul 6, 2012 at 23:00
4
votes

There is another open source command-line mysql-diff tool:

http://bitbucket.org/stepancheg/mysql-diff/

1
  • This project is no longer in development.
    – user289086
    Feb 28, 2015 at 19:41
3
votes

There is a useful tool written using perl called Maatkit. It has several database comparison and syncing tools among other things.

5
  • I did not know about this project! Thanks, it looks like it has quite a few tools that would be extremely useful. Oct 22, 2008 at 13:51
  • 2
    I haven't found schema comparison tools in Maatkit.
    – stepancheg
    Sep 24, 2010 at 4:25
  • Me neither - where in the tools might we find this?
    – Shabbyrobe
    Feb 3, 2011 at 11:10
  • I don't think there is schema comparison in there. I was referring to data comparison and syncing using mk-table-checksum and mk-table-sync Feb 18, 2011 at 10:32
  • it is on process code.google.com/p/maatkit/wiki/mk_schema_sync
    – Pedro
    Jul 15, 2011 at 15:01
3
votes

SQL Compare by RedGate http://www.red-gate.com/products/SQL_Compare/index.htm

DBDeploy to help with database change management in an automated fashion http://dbdeploy.com/

3
3
votes

For myself, I'd start with dumping both databases and diffing the dumps, but if you want automatically generated merge scripts, you're going to want to get a real tool.

A simple Google search turned up the following tools:

3
votes

Take a look at dbForge Data Compare for MySQL. It's a shareware with 30-days free trial period. It's a fast MySQL GUI tool for data comparison and synchronization, management of data differences, and customizable synchronization.

dbForge Data Compare for MySQL

3
votes

After hours searching on web for simple tool, i realized i didn't look in Ubuntu Software Center. Here is a free solution i found: http://torasql.com/ They claim to have a version for Windows also, but I'm only using it under Ubuntu.

Edit: 2015-Feb-05 If you need Windows tool, TOAD is perfect and free: http://software.dell.com/products/toad-for-mysql/

1
2
votes

The apache zeta components library is a general purpose library of loosly coupled components for development of applications based on PHP 5.

eZ Components - DatabaseSchema allows you to:

   .Create/Save a database schema definition;
   .Compare database schemas;
   .Generate synchronization queries;

You can check the tutorial here: http://incubator.apache.org/zetacomponents/documentation/trunk/DatabaseSchema/tutorial.html

2
votes

Very easy to use comparison and sync tool:
Database Comparer http://www.clevercomponents.com/products/dbcomparer/index.asp

Advantages:

  • fast
  • easy to use
  • easy to select changes to apply

Disadvantages:

  • does not sync length to tiny ints
  • does not sync index names properly
  • does not sync comments
1
  • True, they've made a superficial update with a few small changes in 5 years. But it is not being actively developed. Mar 4, 2013 at 16:57
1
vote

I think Navicat for MySQL will be helpful for this case. It supports Data and Structure Synchronization for MySQL. enter image description here

0
votes

For the first part of the question, I just do a dump of both and diff them. Not sure about mysql, but postgres pg_dump has a command to just dump the schema without the table contents, so you can see if you've changed the schema any.

3
  • MySQL has a similar command mysql_dump. This might be a solution if I could integrate it in a deployment process. Thanks. Oct 22, 2008 at 13:47
  • Also, for a more user-friendly experience, you can get the same using phpMyAdmin - a real killer for MySQL users!
    – schonarth
    Oct 22, 2008 at 13:51
  • Identical schemas can easily result in different schema dumps. Different versions of the mysql client might produce slightly different dumps (a problem if you are comparing schemas from two different machines), and things like foreign keys and constraints may be dumped in a different order. Dec 1, 2011 at 19:32
0
votes

I'm working with Nob Hill's Marketing team, I wanted to tell you I'll be happy to hear your questions, suggestion or anything else, please feel free to contact me.

We originally decided to create our tool from scratch because while there are other such products on the market, none of them do the job right. It’s quite easy to show you the differences between databases. It’s quite another to actually make one database like the other. Smooth migration, both of schema and data, has always been a challenge. Well, we have achieved it here.
We are so confident that it could provide you a smooth migration, than if it doesn’t – if the migration scripts it generates are not readable enough or won’t work for you, and we can’t fix it in five business days – you will get your own free copy!

http://www.nobhillsoft.com/NHDBCompare.aspx

2
  • is that a promise? I tried it and it fell over with a fair few errors, not least that when migrating a function it attempts to use the same owner as the original database
    – Cruachan
    May 29, 2009 at 11:52
  • Yes its a promise. For most people the tool is working just fine. We promise a license for life for any bug that you find and we can't fix within 5 business days. Please contact our support team.
    – Itamar
    Jun 4, 2009 at 5:22

Not the answer you're looking for? Browse other questions tagged or ask your own question.