Questions tagged [scylla]
Scylla is a Cassandra-compatible NoSQL data store
268
questions
0
votes
0
answers
7
views
ScyllaDB: Can I have multi DC cluster with different Scylla versions?
Currently I have a single DC cluster with 3 nodes running 4.1.7 version of Scylla. This setup has been running for a long time and I don't want to make changes to this DC, if possible. Now I have a ...
0
votes
0
answers
30
views
In Scylla DB, How can I query the records for multiple condition and without mentioning ALLOW FILTERING?
I have a table in ScyllaDB:
CREATE TABLE taxiservice.operatoragentsauditlog (
hourofyear int,
operationtime bigint,
action text,
actiontype text,
appname text,
entityid text,
...
1
vote
1
answer
57
views
How can I run the CQL query "(col1, col2) IN ((1,2), (3,4))" with GoCQLX?
Well, the title may be not quite informative, sorry.
If I use
qb.Select(...)
.Where(
qb.Eq("part_key_col1"),
qb.Eq("part_key_col1"),
qb.In("clust_key_col1")...
1
vote
1
answer
40
views
Is it possible to retrieve a blob from Cassandra as a Stream byte?
Is it possible to select a blob from Cassandra and get it as a Stream byte?
I don't want to download all bytes from database and then send it via webapi to the user.
1
vote
0
answers
63
views
ScyllaDB mutual friend relation data modeling
I'm working on a mobile App with social features, I'm currently trying on implement mutual friend relations with Scylla. I have chosen Scylla because the Friend Service will be a key feature with high ...
0
votes
1
answer
43
views
Scylla DB latency increasing after every 15 days
Usually, the read latency is around 3-4 ms but after every 15-20 days latency shoots up to 100-150 ms, and because of this I need to restart our whole cluster. The read-repair runs every midnight. I ...
1
vote
1
answer
39
views
Data modelling to faciliate pruning/bulk update/delete in scylladb/cassandra
Lets say I have a table like below with a composite partition key.
CREATE TABLE heartrate (
pet_chip_id uuid,
date text,
time timestamp,
heart_rate int,
PRIMARY KEY ((pet_chip_id, ...
0
votes
0
answers
36
views
while writing data in scylla table using pyspark.some time it write correctly sometime it did not write properly
I am using three node cluster of scylla table i am reading and doing some changes on that df .and writing this new df again the same table.it showing writing completed but actually it do not updated ...
3
votes
1
answer
47
views
What is the Likelihood of Multiple Compactions Overlapping in ScyllaDB?
In the open source version, Scylla recommends keeping up to 50% of disk space free for “compactions”. At the same time, the documentation states that each table is compacted independently of each ...
3
votes
1
answer
56
views
How does Scylla Evict Data from its Cache?
How does Scylla determine when to evict data from its cache? For example, suppose table T has the following structure:
K1 C1 V1 V2 V3
I populate the above table with 500 rows (e.g, the query SELECT * ...
0
votes
1
answer
93
views
In Scylla DB, How can I query the records in desc order?
I have a table in ScyllaDB:
CREATE TABLE myservice.auditlog (
operatorid text,
operationtime bigint,
action text,
actiontype text,
appname text,
entityid text,
entitytype ...
4
votes
1
answer
68
views
An Alternative to Counter Columns in ScyllaDB
According to the official documentation, among the restrictions on counter columns in ScyllaDB are:
The only other columns in a table with a counter column can be columns of the primary key (which ...
1
vote
1
answer
31
views
Does ScyllaDB Support Latest Version of Metrics?
When I launch ScyllaDB for the first time:
Cluster cluster = Cluster.builder().addContactPoints("xx.xxx.xx.xxx").build();
Session session = cluster.connect("my_scylladb_cluster");
...
2
votes
1
answer
71
views
How to Reset a Counter Column in Scylla DB to Zero?
Is it possible to reset a counter column in Scylla DB?
In Cassandra, it is not possible to directly reset a counter column to zero:
There is no operation that will allow resetting the counter value. ...
2
votes
1
answer
66
views
Does ScyllaDB optimize search of clustering key?
I have a table with 3 clustering keys:
K1 K2 C1 C2 C3 V1 V2
Where K1 & K2 are the partition keys, C1, C2 and C3 are the clustering keys and V1 and V2 are two value columns.
In this example, C1, ...
1
vote
1
answer
66
views
Error connecting Java Spring application to ScyllaDB Cluster in Docker
I have ScyllaDB cluster running successfully on docker, but I'm having some connectivity problems when trying to connect my Spring Boot application to it.
The cluster seems to be healthy:
Datacenter: ...
4
votes
1
answer
63
views
Does ScyllaDB Support Centos Stream 8-9?
I'm looking at the list of supported OS and I only see version 7 and 8 of Centos/RHEL are supported.
However, I plan on installing ScyllaDB on Ryzen 9 CPU which does not support Centos 7 / 8.
Does ...
1
vote
1
answer
59
views
ScyllaDB: Prevent duplicate entries on specific columns
I'm using ScyllaDB and I have a table with the following 5 columns:
K1 K2 V1 V2 V3
Where K1 is the partition key, K2 is the clustering key, V1..V3 are three columns representing 3 different values in ...
1
vote
2
answers
109
views
Efficiency of Querying 10 Billion Rows (with High Cardinality) in ScyllaDB
Suppose I have a table with ten billion rows spread across 100 machines. The table has the following structure:
PK1 PK2 PK3 V1 V2
Where PK represents a partition key and V represents a value. So in ...
1
vote
1
answer
68
views
How to save collection of user defined type to ScyllaDB with Spring Data Cassandra?
When I try to save entity with a list or set of user defined type, I get error:
Failed to convert from type [java.util.ImmutableCollections$Set12<?>] to type [com.datastax.oss.driver.api.core....
1
vote
0
answers
28
views
Scylla add new DC - Waiting long time and existing DC stuck
I have problems on running production scylla. Nodetool status output show like this
Datacenter: dc1
===============
Status=Up/Down
|/ State=Normal/Leaving/Joining/Moving
-- Address Load ...
1
vote
0
answers
63
views
How can I save the offset of ScyllaDB CDC after consumption?
I have read the doc of Scylla CDC and the Java Demo. After unremitting efforts in local code debugging but did not find how to save the CDC consumption offset. When my service is restarted, I will ...
2
votes
2
answers
184
views
Partition Keys & Data Modeling in ScyllaDB
In Scylla, data is stored by partition key. If I query a large table with many partition keys, is it equivalent to executing multiple queries against the table? For example, suppose I have the ...
2
votes
2
answers
127
views
ScyllaDB: Schema vs. No Schema?
On one hand, ScyllaDB markets itself as a wide-column database which implies that a single row can contain any number of columns and the number of columns don’t have to be uniform across rows.
On the ...
0
votes
0
answers
67
views
Is it possible to connect to scylla using cassandra connector 3.10 using Catalog?
I am trying to do a simple select in a scylla database as follows:
spark.read.table("Scylla.config.parameters").show(5)
I have created a variable with the settings that I will use as ...
0
votes
1
answer
156
views
Scylla gocqlx how to implement pagination similar to a cursor
I'm using Scylla to save parties created by a users. The method below returns a list of parties created by a user. I currently return all parties without allowing pagination, but I'm trying to ...
0
votes
1
answer
83
views
Migrating from cassandra 2.1 to scylla 4.5
made:
nodetool flush (on cassandra)
nodetool snapshot name_snapshot (on cassandra)
cqlsh [IP] "-e DESC SCHEMA" > orig_schema.cql (on cassandra)
cqlsh [IP] --file 'orig_schema.cql' (on ...
0
votes
0
answers
59
views
How to run scyllaDB in Github actions?
I'm trying to run scyllaDB docker image in github actions but its failing saying Unable to connect to any servers
name: scylla setup
on:
push:
branches:
- mybranch
jobs:
scylla-setup:
...
0
votes
1
answer
174
views
ScyllaDB : One of the nodes in a 3-node cluster fails to join the cluster after a restart
We have a 3 node cluster (single DC) running on Ubuntu 18.04. We had to upgrade all nodes in the cluster (increase the disk space) and hence stopped node-3 first, upgraded the instance and attempted ...
0
votes
0
answers
43
views
Is Scylla nodetool repair shard-aware?
Talking about Scylla, not Cassandra. Given token range ]A:B] owned by a shard. If I run nodetool repair -st A -et B will it utilize only the one CPU core dedicated for the shard?
As an example. If I ...
0
votes
0
answers
113
views
Storing and streaming big files in Cassandra and retrieving by Spring Boot
Is it a good idea to store big files in Cassandra or ScyllaDB?
The distributed architecture is:
multiple instances of Spring Boot application
ScyllaDB instances
load balancer (traffic distributed ...
0
votes
0
answers
52
views
Do Multiple gocql Sessions Cause Errors in Golang Integration Tests?
I'm running Golang integration tests that connect to one of our staging environments Scylladb clusters. When I run go test ./... it actually runs 2 packages in parallel (sub directories from root ...
-1
votes
1
answer
108
views
Why Are My Unit Tests Inconsistently Passing/Failing? (Golang and ScyllaDB)
I'm running into issue with unit tests pertaining to ScyllaDB in Golang. The code doesn't seem to be the problem. The unit tests will sometimes work perfectly, but just as often will also fail. This ...
2
votes
0
answers
40
views
Need help understanding cfhistograms output
We are using Scylla version 4.4.1-0.20210406.00da6b5e9
I am not able to understand that
How nodetool cfhistogram is showing more no of sstables touched than the number of sstables that are actually ...
0
votes
1
answer
48
views
interpret results of cassandra stress test
We have scylla cluster with tree node. Each node is in its own datacenter. Тo evaluate cluster performance i use cassandra stress test with this parameters:
cassandra-stress write "no-warmup cl=...
1
vote
1
answer
42
views
cql query statement is not working when i using timestamp string
what is the problem in my code?
3
votes
3
answers
61
views
Can Cassandra or ScyllaDB give incomplete data while reading with PySpark if either clusters are left un-repaired forever?
I use both Cassandra and ScyllaDB 3-node clusters and use PySpark to read data. I was wondering if any of them are not repaired forever, is there any challenge while reading data from either if there ...
2
votes
1
answer
57
views
How often should ScyllaDB nodes be repaired?
Our organisation has move on from Cassandra to ScyllaDB recently and since there's so little info about ScyllaDB, and as the title suggests, how often should we repair ScyllaDB nodes to maintain equal ...
0
votes
2
answers
27
views
Less rows being inserted by sstableloader in ScyllaDB
I'm trying to migrate data from Cassandra to ScyllaDB from snapshot using sstableloader and data in some tables gets loaded without any error but when verifying count using PySpark, it gives less rows ...
1
vote
1
answer
145
views
Scylla token range select result ordering
Is it guaranteed that rows returned for a token range CQL SELECT query are ordered by token value?
From the article https://www.scylladb.com/2017/02/13/efficient-full-table-scans-with-scylla-1-6/:
...
1
vote
1
answer
150
views
How to create Docker Scylla acorss Multi DC
I have 2 server in difference datacenter.
First server in DC1 with public IP 10.10.10.1
Second server in DC2 with public IP 20.20.20.2
docker-compose for first server in DC1 look like this :
...
1
vote
0
answers
117
views
How to use scylla-driver from Spark?
I have several Spark jobs which use Cassandra driver, but there is migration from Cassandra to Scylla. And I want Spark jobs to work with Scylla with shared awareness. As I understand, Spark Cassandra ...
2
votes
0
answers
84
views
Spark returning a lot of duplicates using Scylladb as a source
On Spark 2.4.4 with spark-cassandra-connector 2.5.1 when retrieving data from a materialized view a lot of duplicates are returned. The code is very simple:
val df = spark.read.format("org.apache....
1
vote
1
answer
57
views
add / remove seed scylladb from container create by docker run
How to add or remove seed from node scylladb that create with docker run, for example :
docker run -d scylladb/scylla:4.5.2 \
--authenticator PasswordAuthenticator \
--authorizer CassandraAuthorizer \
...
1
vote
0
answers
60
views
How to store and retrieve doctor surgery hours in database?
How to store doctor working hours in database in order to retrieve free time slots efficiently?
Approaches
A. Store rules and exceptions
doctor defines working hours, e.g. from 9 AM to 3 PM every 30 ...
1
vote
2
answers
179
views
ScyllaDB count(*) return difference result
I have a question about query in scylladb. I want to count the rows in a table with:
SELECT COUNT(*)
FROM tabledata;
First run returns a result of 5732 rows
Second run returns a result of 5432 rows
...
0
votes
0
answers
98
views
Using ScyllaDB, what is the most efficient way of referencing a user from a different table?
Say, I have a table that looks something like this: (it's an example)
CREATE TABLE testing.friend_requests (
sender_uuid text,
receiver_uuid text
);
CREATE TABLE testing.users (
uuid text
...
2
votes
2
answers
1k
views
How to use actix_web::client::Client in Actix-web 4.0
I use crate scylla that use tokio 1, so i must use crate actix-web 4.0 beta.
Now i have problem that use actix_web::client::Client show error :
3 | use actix_web::client::Client;
| ^^^...
1
vote
1
answer
187
views
How passing ScyllaDB connection in Rust Actix
I have problems implement scylla-rust-driver on Rust Actix. I want just create simple CRUD with scyllaDb.
First i create struct for App Data
struct AppState {
scy_session: Session,
...
1
vote
1
answer
164
views
Storing arrays in Cassandra
I have lots of fast incoming data that is organised thusly;
Lots of 1D arrays, one per logical object, where the position of each element in the array is important and each element is calculated and ...