Looking at https://docs.celeryq.dev/en/v5.2.7/getting-started/backends-and-brokers/index.html it sounds pretty much as if it's not possible / desirable. There is a section about SQLAlchemy, but Django does not use SQLAlchemy.
In way older docs, there is https://docs.celeryq.dev/en/3.1/getting-started/brokers/django.html .
Is it possible with recent Celery / Django versions to use Celery with just the database for storing messages / results?