Questions tagged [citus]
Citus is a distributed database that lets you run SQL queries over very large data sets.
135
questions
0
votes
1
answer
28
views
Citus source code build error on linux 20.04. with postgres 14
I have postgres 14. I also had postgres 16 before which was removed. I want to build citus source code using postgres 14. But the compiler keeps checking for postgres 16 folder. I tried few ways(...
1
vote
0
answers
25
views
how to implement Citus across multiple nodes
I am new to Citus. I want to know how to implement Citus across multiple nodes. I have already created three virtual machines using VirtualBox, but I don't have any idea how to connect these three.
I ...
0
votes
0
answers
18
views
Implementing django_multitenant in django 4.2
I'm working on a new django 4.2 project. To implement multi-tenancy, I'm using the django_multitenant library with Citus 12.1 and PostgreSQL 16.
While defining the models I see that there is ambiguity ...
0
votes
1
answer
31
views
How do backup from one Citus cluster and restore to another?
We need to backup one Citus cluster and restore it to another.
We are trying to use pg_dump/pg_restore, but it doesn't work.
I think because of metadata difference between Citus coordinator and ...
0
votes
1
answer
48
views
How can i add another citus coordinator?
We have citus cluster with 1 coordinator and 3 worker node and we have some problems with the coordinator node.
So can we add another coordintor node to the cluster ?
or
Can we change one of our ...
0
votes
1
answer
12
views
I am trying to locate a download link for Citus v11.3 for Postgres13. Please advise. Thanks
Is Citus v11.3 ( single node Postgres 13 ) available for download?. If so can you please advise or provide a link to a download platform. Thanks
Have tried https://www.citusdata.com/download/
Seems to ...
0
votes
0
answers
25
views
Citus Sharding balance info
I configured Citus cluster with 3 nodes, and created a few tabled and used function "create reference table". in this case able to get data (read) from other available nodes. But when one of ...
0
votes
1
answer
56
views
Problems with EF Migrations to Postgres database using Citus
I am using EFCore migrations to alter a postgres db with the Citus extension.
I am trying the following steps with my migration:
Create the table
Call SELECT create_distributed_table etc.
Create a ...
1
vote
1
answer
155
views
Distributed Sequence generation - Citus
We are using sequence generator to generate the sequence. Ex: Every time when a row is inserted there is one more column which uses sequence to create strings like R0001, R0002 etc.
We want this ...
-1
votes
1
answer
72
views
Citus-Postgres Custom Distribution Logic
I am working with Citus-Postgress to setup a cluster of coordinator and worker nodes and distribute table data across these nodes. By default, Citus uses its own logic to automatically distribute ...
0
votes
1
answer
140
views
Citus distributed table in all worker nodes
I'm trying out citus (docker-compose based on tutorial, 2 worker nodes). If I create a table and don't execute create_distributed_table the table is only created in the coordinator which seems to be ...
0
votes
0
answers
44
views
How to update entity by two fields?
Maybe some one know.
I want to use citusdb and I try to rewrite doctrine updates.
If I use standard update for entity
For example
$order = $repository->find(1);
$human->setComment("test&...
0
votes
0
answers
42
views
Citus logs show error after upgrade to 11.2
I have upgraded Citus extension from 10.2 to 11.2 running on postgres version 14. I disabled the version checks for citus and was able to apply the extension to database for the coordinator and ...
0
votes
1
answer
124
views
Citus upgrade failed
I am running citus in kubernetes and trying to do an upgrade from 10.2 to 11.2, the underneath postgres version is 14.
Image used in deployment for upgrade: citusdata/citus:11.2-pg14
After performing ...
0
votes
0
answers
160
views
Postgres running in kubernetes throws an error PANIC could not locate a valid checkpoint record
I am running postgres in kubernetes and I am seeing the below error.
PANIC could not locate a valid checkpoint record
How do I recover from this error as it goes in to crashloobackoff and I couldn't ...
0
votes
1
answer
62
views
Citus: shard_size is empty
Citus 11.1.5
select * from citus_shards return many rows, but field shard_size is empty.
I expect that field shard_size from citus_shards table are not be empty.
I need to calculate size of all shards....
0
votes
1
answer
134
views
Citus parallelism limitations
I'm experimenting with Citus extension for PostgreSQL to enable parallelism for my analythics queries (single node setup). I have a very simple UPDATE statement for a distributed table which runs ...
2
votes
1
answer
152
views
Using RDS instances as Citus worker nodes
I am considering using Citus because my app is text-book multitenancy app and my problems are exactly what Citus is meant to solve (some tenants are starting to grow so big that they are starting to ...
0
votes
1
answer
109
views
Citus: pg_stat_all_tables is empty
I need to get table usage info.
But if I run the select * from pg_stat_all_tables I see zero or null values along citus tables.
The same result on coordinator and worker node.
How can I get the tuple ...
0
votes
0
answers
31
views
How can to use ltree extension without using public schema in Azure hyperscale citus database?
My application database is deployed on Azure citus database which requires ltree extension for one of its schema. Currently the queries from my java application do not work since ltree extension is ...
0
votes
1
answer
76
views
CITUS - WARNING: Not allowed to move shard <id> anywhere from <nodename>:<nodeport>
I am trying out the Citus PSQL extension for sharding, and am trying the custom rebalancing strategies. I created the following function that is meant to check the current shardid's groupid against a ...
0
votes
1
answer
59
views
citus:truncate records of a table
I want to use sql command truncate table to truncate all records in a distributed table of citus,but seems it doesn't work,so I have to login to each datanode to truncate each shard of the table. so,
...
2
votes
0
answers
151
views
postgresql citus: ctas with select on table with columnar storage runs in error, same select with select on non-columnar storage works
We run a postgresql 14 with citus_columnar in version 11.1.
Scenario 1: select on 3 tables, where 2 two tables are partitioned and "using columnar". This works pefectly
Scenario 2: the ...
0
votes
1
answer
295
views
Postgres-15.1 is restarting continuously on using shared_preload_libraries extension
Postgres is restarting continuously on using shared_preload_libraries extension.
https://postgresqlco.nf/doc/en/param/shared_preload_libraries/
I am running postgres-15.1 using a python-based daemon ...
1
vote
0
answers
107
views
Resolve debug symbols for postgres
I am working on an adding a new extension on citus and am in the process of collecting and analyzing the stack traces for the extension, postgres, citus and other libs by running ycsb workloads ...
0
votes
0
answers
71
views
How to query JSONB column with nested array & objects in Citus postgres
I have a Postgres Table "Organization" containing "email_details" column of JSONB data.
This column will hold data in below format.
{
"emails":
[
{
...
0
votes
1
answer
131
views
citus: Can I add one more replica for a distributed table
I have a distributed table,but this table only has one replica,only one replica doesn't have
ha, I want and one more replica for the table,can i? how to do?
I have search online help docs,but didn't ...
2
votes
1
answer
133
views
How can I stop an active query on a postgres coordinator when the worker node has crashed
I have a postgres select query that can not be stopped using the standard pg_cancel/pg_terminate commands.
Both commands return true, but do nothing.
The query has access share locks on hundreds of ...
1
vote
1
answer
247
views
Query against worker nodes omitting the coordinator in Citus
Existing documentation for Citus11 explicitly points out that external clients should interact with the Citus cluster through the coordinator node, which is supposed to route request among workers.
...
2
votes
1
answer
297
views
Cannot create distributed table with foreign key on Citus 11.1
I want to migrate from Citus 11.0 to 11.1.
I'm using the docker-compose file from Citus' github.
The following script works fine on 11.0, but not on 11.1:
create table tmp_table1 (
id varchar(36) ...
0
votes
2
answers
413
views
add worker node and rebalance distributed shards problem with PostgreSQL + Citus
The cluster had 1 coordinator and 6 worker nodes. (environment: PostgreSQL 15 + Citus 11.1)
We want to add more worker nodes to it, so we executed
SELECT * from citus_add_node('node-name', 5432);
and
...
1
vote
1
answer
394
views
Update PostgreSQL 14 to 15 with active citus extension
I am trying to use the official way
to upgrade from PG 14 to 15 with Citus. If I would follow these instructions, I would have upgraded PG, but not citus, since nowhere the citus111_15 rpm is being ...
0
votes
1
answer
475
views
Delete in Postgres citus columnar storage alternatives
I am planning to use citus to store system logs for upto n no of days after which they should be deleted.Citus columnar store looked like the perfect database for this until I read
this where its ...
0
votes
2
answers
556
views
Postgresql doesn't working with Citus and pg_stat_statements at the same time
So, I built the PostgreSQL with citus extension in docker.
I use the official documentation in citus, then I run this command in the terminal.
docker run -d --network citus-network --name ...
0
votes
0
answers
49
views
ERROR: attempted to read an unexpected stripe while reading columnar table daily_p2022_10_11, stripe with id=281134 is not flushed
I am getting this error in postgres alert log:
ERROR: attempted to read an unexpected stripe while reading columnar table daily_p2022_10_11, stripe with id=281134 is not flushed.
While trying vacuum, ...
0
votes
1
answer
64
views
Citus - Possible to undo citus's create_time_partitions results?
I'm working on a database with Citus and I would like to know if it's possible to undo the results made by executing create_time_partitions. I know that it is possible to "undistribute" a ...
0
votes
1
answer
384
views
Citus data - How to query data from a single shard in a query?
We are evaluating Citus data for the large-scale data use cases in our organization. While analyzing, I am trying to see if there is a way to achieve the following with Citus data:
We want to create ...
0
votes
0
answers
361
views
Citus support the HA? ( High Availability )
i have one simply question: citus 11 support the HA?
This is the structure that i have implemented with 7 node ( replication with pg_autofailover):
The problem occurs when i disable a worker1_primary ...
2
votes
1
answer
819
views
Citus sharding, replication, and replication
I setup the citus 11 cluster using the official docker and docker compose instruction. I scaled the cluster to 5 worker nodes and created a distributed table, with replication factor 3.
I expected the ...
1
vote
1
answer
353
views
How to promote metadatasynced worker to coordinator in Citus, if coordinator completely lost
I have a citus cluster with 1 coordinator and 3 workers.
Recently, the server which hosted coordinator is completely down which cannot be recovered.
Now the cluster only does Query and Some DML, but ...
3
votes
1
answer
315
views
Citus shard rebalancing does not progress
I have a Citus cluster with 3 worker nodes, added a new worker recently then started a rebalance on a table. Everything is OK until here but rebalancing does not end. When I look at ...
0
votes
1
answer
148
views
pg_auto_failover Installation fails on Rocky linux
I want to install pg_auto_failover(https://github.com/citusdata/pg_auto_failover) on rocky linux 8.5 .
But when I key in the following install command:
(1) curl https://install.citusdata.com/community/...
2
votes
1
answer
761
views
PostgreSQL Citus Shard Rebalancing after adding new node -> connection to the remote node localhost:5432 failed with the following error
Here I have a problem while applying Citus rebalancing after distributing a specific PostgreSQL table and adding new nodes to scale my database.
You can take a look at this useful article if you would ...
0
votes
1
answer
198
views
Sharding with replication
Sharding with replication]1
I have a multi tenant database with 3 tables(store,products,purchases) in 5 server nodes .Suppose I've 3 stores in my store table and I am going to shard it with storeId .
...
0
votes
1
answer
192
views
Create a PostgreSQL Hyperscale Citus DB from Azure CLI (not ARC)
How do I create a hyperscale PostgreSQL DB from the Azure CLI?
Please note, I am not asking about Arc-enabled Kubernetes clusters.
The current documentation is for Portal only.
Is there a way to do ...
2
votes
0
answers
380
views
Could not access file “citus”:no such file or directory;
when i start postgres-14, then tell me "Could not access file “citus”:no such file or directory;"
i have insetlled citus. but i still don't start postgres-14.can you help me?
0
votes
1
answer
307
views
curl Unfortunately,your operating system distribution and version are not supported by this script
my operating system is rocky8.5。when i execute “curl https://install.citusdata.com/community/rpm.sh | sudo bash”,tell me “Detected operatiog system as rocky/8 Unfortunately,your operating system ...
0
votes
1
answer
730
views
Postgres Citus, immutable date conversion
Trying to update some dates programmatically on Citus I always get
[0A000] ERROR: STABLE functions used in UPDATE queries cannot be called with column references
From a query like
UPDATE ...
0
votes
1
answer
782
views
Citus Sharding and PostgreSQL table partitioning on the same column
We are starting a project with PostgreSQL and will need to use Citus in the near future for a multi tenant application so we are aiming at preparing our PostgreSQL database schema appropriately for
an ...
0
votes
1
answer
128
views
citus, which column can be treated as distribution column
I'm a newbie of citus and need an advice that which column will be treated as distribution column when create_distributed_table.
Exp 1, the snapshot table of order, every row containing an unique ...