52

I need to migrate my db from sqlite to mysql, and the various tools/scripts out there are too many for me to easily spot the safest and most elegant solution.

This seemed to me nice http://djangosnippets.org/snippets/14/ but appears to be 3 years since getting an update which is worrying..

Can you recommend a solution that is known to be reliable with Django 1.1.1 ?

1
  • 3
    I'm guessing you already tried a dumpdata followed by a loaddata? Commented Jun 14, 2010 at 4:34

4 Answers 4

90

Execute:

python manage.py dumpdata > datadump.json

Next, change your settings.py to the mysql database.

Finally:

python manage.py loaddata datadump.json
4
  • 6
    Except sometimes this doesn't work, if you've put unicode data into strings in sql, the fixture creator and mysql don't seem to get along. At least, that's what I came here trying to figure out how to solve.
    – freyley
    Commented Dec 23, 2011 at 22:34
  • 4
    Or this doesn't work because of integrity errors...or many other issues.
    – Marcin
    Commented Apr 10, 2012 at 7:43
  • 4
    Sometimes it raise "... is not JSON serializable"
    – Nhu Trinh
    Commented Jan 20, 2014 at 4:39
  • Running dumpdata > datadump.json raises error: CommandError: No installed app with label '>'.
    – user9608133
    Commented Jul 28, 2019 at 10:36
79

After some hard searching I got several problems that I hope future answer looking people will find useful.

my formula is

  1. python manage.py dumpdata > datadump.json
  2. Change settings.py to your mysql
  3. Make sure you can connect on your mysql (permissions,etc)
  4. python manage.py migrate --run-syncdb
  5. Exclude contentype data with this snippet in shell

    python manage.py shell

    from django.contrib.contenttypes.models import ContentType ContentType.objects.all().delete() quit()

  6. python manage.py loaddata datadump.json

Hope that will help you!

6
  • 1
    What does the contenttype data exclusion do?
    – DeltaG
    Commented May 19, 2017 at 18:19
  • 1
    @DeltaG The canonical answer is this. But the best answer I found is: this one Commented May 23, 2017 at 3:13
  • That worked for me too. Step 5 was needed for the loaddata command to work. Commented Jan 25, 2018 at 12:34
  • I am getting this answer django.db.models.fields.related_descriptors.RelatedObjectDoesNotExist: Problem installing fixture '/home/ubuntu/news-manifest-master/datadump.json': Comment has no content_type. Commented Apr 17, 2019 at 1:05
  • why run-syncdb? I had to run without that
    – cikatomo
    Commented Nov 24, 2020 at 6:50
11

This is a neater way to avoid the ContentType issues described elsewhere:

./manage.py dumpdata --exclude contenttypes --exclude auth.permission --exclude sessions --indent 2 > dump.json

Then:

./manage.py loaddata dump.json
2
  • 1
    This is a useful addition; you could improve this answer by adding more steps to it like the answer by Carlos Henrique Cano.
    – florisla
    Commented Mar 5, 2020 at 7:52
  • also --exclude admin.logentry
    – mercury
    Commented Oct 18, 2023 at 5:54
2

A (fuller) list of the steps I needed for moving from sqlite to MySQL, YMMV:

  1. python manage.py dumpdata > datadump.json
  2. Make sure you can connect on your mysql (permissions, etc)
  3. Make sure you HAVE PRIVILEGES to modify FOREIGN_KEY_CHECKS (I had to install and run my own private instance of mysql for that)
  4. Make sure InnoDB engine is NOT used (use MyISAM in every table) or the next step won't work (failing silently)!
  5. Relax validation by this command (this won't take effect in InnoDB): SET GLOBAL FOREIGN_KEY_CHECKS = 0;
  6. Load django_site.sql table separately (if using contrib.sites)
  7. Change settings.py to your new mysql
  8. python manage.py migrate --run-syncdb
  9. Fix syncdb errors errors by tinkering with the code in /migrations directories of your Django apps and the DB tables as necessary
  10. Exclude contentype data with this snippet (can put it in the main urls.py module): from django.contrib.contenttypes.models import ContentType ContentType.objects.all().delete() quit()
  11. If need editing json data have to prettify it first: cat datadump.json | python -m json.tool > datadump_pretty.json
  12. python manage.py loaddata datadump.json
  13. Fix any data truncation issues
  14. Add timezone data to the database: mysql_tzinfo_to_sql /usr/share/zoneinfo | mysql -D mysql -P 1234 -u root -p --protocol=tcp mysql -P 1234 -u root -p -e "flush tables" --protocol=tcp
  15. Test the site is working without submitting any data
  16. SET GLOBAL FOREIGN_KEY_CHECKS = 1;
  17. Test the rest
1
  • From the official documentation: MySQL’s default storage engine is InnoDB. This engine is fully transactional and supports foreign key references. It’s the recommended choice.
    – am70
    Commented May 20, 2023 at 12:18

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Not the answer you're looking for? Browse other questions tagged or ask your own question.