Questions tagged [singlestore]
For programming questions relating to the use of Singlestore (formerly known as MemSQL), which is a distributed SQL database.
350
questions
119
votes
8
answers
94k
views
How to increase docker-machine memory Mac
I am new to Docker, and trying to go through this tutorial setting up MemSQL from a Docker image - http://docs.memsql.com/4.0/setup/docker/ . I am on a Mac, and the tutorial uses boot2docker which ...
23
votes
5
answers
20k
views
How to make volumes permanent with Docker Compose v2
I realize other people have had similar questions but this uses v2 compose file format and I didn't find anything for that.
I want to make a very simple test app to play around with MemSQL but I can'...
19
votes
3
answers
18k
views
MemSQL - Starting up / worth the move "Worlds Fastest Database" [closed]
MemSQL is claiming to be the "Worlds Fastest Database"
Faster than DB2, Oracle, mySQL and SQL server. Can anyone vouch for this?
I have searched the web and tried to gather as much ...
12
votes
3
answers
9k
views
Spark DataFrame InsertIntoJDBC - TableAlreadyExists Exception
Using Spark 1.4.0, I am trying to insert data from a Spark DataFrame into a MemSQL database (which should be exactly like interacting with a MySQL database) using insertIntoJdbc(). However I keep ...
7
votes
1
answer
7k
views
Pandas to_sql() performance - why is it so slow?
I am running into performance issues with Pandas and writing DataFrames to an SQL DB. In order to be as fast as possible I use memSQL (it's like MySQL in code, so I don't have to do anything). I ...
6
votes
1
answer
5k
views
MEMSQL vs. MySQL
I need to start off by pointing out that by no means am I a database expert in any way. I do know how to get around to programming applications in several languages that require database backends, and ...
5
votes
1
answer
695
views
Aurora vs MemSQL for low throughput but low latency purpose [closed]
We are changing our current user side MySQL database. We have a website + mobile app for which users around the US query our database. the relevant data is is contained in three tables, and a join ...
5
votes
1
answer
497
views
Is it possible to use EntityFramework with MemSQL?
I am trying to create an entity model for 2 super simple tables that I created in MemSQL:
CREATE TABLE foo(id int primary key auto_increment, name varchar(20));
CREATE TABLE t(id int primary key ...
4
votes
4
answers
3k
views
How to change the root password after memsql install?
I've installed MemSQL community edition (single host cluster) and all is working well. I need to allow remote access to the database, but MemSQL installs the user root without a password. If I open up ...
4
votes
1
answer
1k
views
Does memsql support Full Outer Join?
I wanted to have a full outer join in memsql. Something like
SELECT *
FROM A FULL OUTER JOIN B
ON A.id = B.id
Is it possible ?
4
votes
3
answers
2k
views
Select json column using JPA native query with MemSql
I have a table in a MemSql database which contains a column of type JSON.
I am trying to execute the following query.
select tweet from tweets_json;
The tweet column is the JSON column.
Here is ...
4
votes
1
answer
79
views
SingleStore 1.0.1 JDBC ResultsetMetadata returns type name VARSTRING while getColumns returns VARCHAR
JDBC version 1.0.1
Server version 7.6
A table defined as follows
create table TVCHAR ( RNUM integer not null , CVCHAR varchar(32 ) null , SHARD KEY ( RNUM ) ) ;
DatabaseMetadata.getColumns returns a ...
4
votes
1
answer
152
views
Scala/Java joda.time not converting date in 24 hours format
I am trying to convert a long utc value into "yyyy-MM-dd HH:mm:ss" formatted pattern. I am expecting my data to be converted on 24 hours range scale and in GMT. My code passes all the test cases, I ...
4
votes
3
answers
3k
views
Connecting to MemSQL from PHP codeigniter application
MemSQL is new. Stackoverflow did not return any search result with the keyword 'MemSQL'. MemSQL claims absolute similarity to MySQL, except that MemSQL is 30 times faster. I was just studying MemSQL ...
4
votes
1
answer
194
views
What are the supported Connection String properties for MemSQL?
This page describes the supported connection string properties for MySql Connector / .Net.
Which of these options are officially supported when connecting to MemSQL?
I suspect that options like ...
3
votes
2
answers
1k
views
memSQL How do I add partitions to an existing sharded table/database?
Adding nodes (leaves or aggregators) to a memSQL cluster is straightforward: I edited memsql_cluster.json and reran memsql-cluster setup. The problem is adding partitions to an existing table. The ...
3
votes
3
answers
3k
views
PERCENTILE_CONT() returns same value regardless of input parameter
I would like to get the 5th, 50th, 95th percentile of a table
SELECT col1, col2, col3, AVG(col4), STD(col4),
PERCENTILE_CONT(0.05) WITHIN GROUP (ORDER BY col4)
OVER (PARTITION BY col1, ...
3
votes
1
answer
1k
views
MemSQL and H2 comparison
I am considering moving from H2 to MemSQL - and I would greatly appreciate any comments:
My application has to query very quickly concurrently from large tables of up to 300Million rows. To achieve ...
3
votes
1
answer
168
views
Automatically compute GEOGRAPHY polygon from inserted values in MemSQL
In MemSQL I can compute a GEOGRAPHYPOINT automatically from inserted values easily:
CREATE TABLE point_test (
id INTEGER NOT NULL,
lon DECIMAL,
lat DECIMAL,
point AS GEOGRAPHY_POINT(lon, lat) ...
3
votes
1
answer
978
views
How to set memsql max_pooled_connections
I am using the memory database MemSQL (community version), and I am trying to increase the max_pooled_connections settings. I tried two ways:
1) In /var/lib/memsql/memsql.cnf, set ...
3
votes
1
answer
996
views
MEMSql user defined variable
I have found that MEMSql does not support user defined variables (source).
Is there any workaround of this? Is it going to be in future releases?
I want to do SQL injection protection via user ...
3
votes
1
answer
871
views
Memsql, Is it possible to add more leaf nodes on the same host machine?
I installed a functional test with Memsql on a machine with an aggregation node on port 3307 and a leaf node 3306. As queries being ran, there might be additional cpu available. Hence, is it ...
3
votes
1
answer
780
views
Liquibase with MemSQL
I am using Liquibase to manage my database migrations. There seems to be a difference in MemSQL command as compared to MySQL which is causing a problem.
I am running the following command through ...
3
votes
1
answer
169
views
Enabling Parallelization in Spark with Partition Pushdown in MemSQL
I have a columnstore table in MemSQL that has a schema similar the one below:
CREATE TABLE key_metrics (
source_id TEXT,
date TEXT,
metric1 FLOAT,
metric2 FLOAT,
…
SHARD KEY (source_id, date) USING ...
3
votes
1
answer
108
views
MemSQL geospatial union of polygons
Will the new MemSQL version be able to calculate the union of polygons? For example calcuate the border of two adjacent or even intercepting polygons?
+----+
| |
| +-+--+
+--+-+ |
| |
+-...
3
votes
1
answer
757
views
Changing MemSQL host/node to use private IP
The servers we use have both public and private internal IPs. When using MemSQL Ops GUI to add MemSQL host and nodes, the installation defaults to using the public IP even when provided with the ...
2
votes
3
answers
922
views
Change the installation directory of memsql
The memsql installation page says that
memsql-ops is installed in /var/lib/memsql-ops and memsql is installed in /var/lib/memsql
How do i change the installation directory as i donot want it to ...
2
votes
4
answers
3k
views
ERROR 1777 (HY000): Partition memsqldb:0 has no master instance
I am using community edition of memsql. I got this error while i was running a query today. So i just restarted my cluster and got this error solved.
memsql-ops cluster-restart
But what happened and ...
2
votes
3
answers
2k
views
How to free space for dropped database in MemSql
I am new to MemSQL. I have created a database and tables in MemSQL on cluster with 5 leaf nodes and 2 aggregator nodes. Spark is running on the same cluster.
Everything is in default mode. Inserted ...
2
votes
1
answer
2k
views
MemSql leaf down on Single server Cluster
I have a single server cluster installation of MemSQL on Ubuntu 14 LTS.
I am unable to connect to memsql on port 3306 but the cluster is running on port 9000.
Looks like a leaf is down. When i tried ...
2
votes
1
answer
1k
views
Error connecting to memsql with mysql C connector
I'm trying to connect to memsql via mysql C connector:
MYSQL *connection = mysql_init(NULL);
mysql_real_connect(connection, HOST, USER, NULL, DBNAME, 0, NULL, 0);
but I get "Error in server ...
2
votes
2
answers
354
views
How do I connect to MemSQL from Elixir
MemSQL is binary compatible with Mysql and uses the same drivers. However this nice-in-theory does not seem to apply when you connect from Elixir with mariaex or mysqlex.
With mariaex, I can connect ...
2
votes
2
answers
1k
views
Getting errors creating MemSQL database
I installed MemSQL per video instructions on the download page. During installation it told me that port 3306 was unavailable to use with Master Aggregator, so changed it to 4000. And I can connect ...
2
votes
2
answers
234
views
Feature 'Backup of a database containing a columnar table' is not supported by MemSQL
MemSQL doesn't support backup of columnar tables:
memsql> backup database stat to '/data/memsql-backup';
ERROR 1706 (HY000): Feature 'Backup of a database containing a columnar table' is not ...
2
votes
1
answer
520
views
MemSQL : Error 1049 - while executing procedure
I am in the process of learning MemSQL and as part of this I was trying to execute a procedure from C# client code. The stored procedure exists in the MemSQL database. However, i get the error "Error ...
2
votes
2
answers
517
views
GROUP CONCAT with ORDER in MEMSQL
Here is a toy example:
CREATE TABLE TEST
(
ID INT,
AGG NVARCHAR(20),
GRP NVARCHAR(20)
);
INSERT INTO TEST VALUES
(1, 'AB', 'X'), (2, 'BC', 'X'), (3, 'AC', 'X'),
(4, 'EF', 'Y'), (...
2
votes
1
answer
2k
views
MemSQL - Surrogate key as Primary and different unique keys at the same time in table creation
I have a situation that I need to have a surrogate key (id) in place of a composite key (4 field combined to be unique: project_id, dataset_id, table_id, view_name) to easily refer that in other ...
2
votes
2
answers
883
views
memsql multi-table delete, is it possible?
MEMSQL! I want to delete a record in a table that has a match in another table on multiple fields. Is this possible?
The MySql query I would use could be something like:
delete from t1 used t1,t2 ...
2
votes
1
answer
826
views
MemSQL multi-operations transactions
It's not clear from MemSQL documentation whether multi-operations transactions are supported or not.
In simple words let's say I have the following transaction
BEGIN
INSERT smth INTO table1
INSERT ...
2
votes
2
answers
1k
views
Slow performance when inserting records to memsql
When executing an insert or even a select statement using C# against a MemSQL installation it is very slow. Queries executed on the database server are incredibly fast.
So something between query ...
2
votes
1
answer
518
views
MemSQL Spark connector inserting nulls from Spark to MemSQL
I have this program which is reading parquet files and writing it into a MemSQL table. I can confirm Spark reading files correctly as
df.printSchema()
df.show(5)
correctly prints the schema and the ...
2
votes
1
answer
1k
views
Syntax error on SQLAlchemy with MemSQL
When I connect to MemSQL via SQLAlchemy(version 1.0.8) I'
m getting an error
sqlalchemy.exc.ProgrammingError: (_mysql_exceptions.ProgrammingError) (1064, "You have an error in your SQL syntax; check ...
2
votes
1
answer
276
views
MemSQL: Leaf error: timed out from socket after -1 seconds
We are running a 4 node cluster currently, (3 machines with 8GB and one with 4GB RAM) and while trying run a left outer join of a table (about 7.5 GB) on itself. Few of the fields of the table have ...
2
votes
2
answers
1k
views
Inserting and reading blob memsql
I'm trying to insert blob in my MemSQL database.
This is where I get my source to insert, so I convert it into a blob :
byte[] bytes = rs.getString(2).getBytes("utf-8");
Blob blob = insert....
2
votes
2
answers
1k
views
Installation of memsql on mac
How to install memsql on mac. I have tried installing it with boot2docker but there are some errors. If anyone have the minimum requirements or step by step installation it would be helpful
2
votes
2
answers
533
views
No memsql.sock file in /var/lib/memsql
The error mentioned here: http://docs.memsql.com/latest/tshoot/2002/ I was getting using Ubuntu 14.04.2. The MySQL client and the latest MemSQL advised to point the 'my.cnf' config to the 'memsql.sock'...
2
votes
2
answers
956
views
Port 3306 not opened in MemSQL community edition install
I'm not able to connect with:
mysql -u root -h 127.0.0.1 -P 3306 --prompt="memsql> "
it yields:
ERROR 2003 (HY000): Can't connect to MySQL server on '127.0.0.1' (111)
When I run nmap localhost, port ...
2
votes
1
answer
90
views
MemSQL: Load data with "skip duplicate key" option is extremely slow
I am evaluating the loading performance of Singlestore 7.6.10.
I tested two ways of loading both are important to real world practice:
loading to skip duplicated primary keys
load data local infile '/...
2
votes
1
answer
158
views
'reshuffling a singleton select' is not supported by MemSQL Distributed
Everything works find with the original query, but when translated in knex, it threw the error.
reshuffling a singleton select' is not supported by MemSQL Distributed.
const finalQuery = knex
.select('...
2
votes
1
answer
130
views
Spark Memsql connector do not work
i create a simple flow
val streamFromFirstTopic = spark
.read
.format("kafka")
.option("kafka.bootstrap.servers", s"$kafkaHost:9092")
.option("startingOffsets", "earliest")
...