446
questions
0
votes
1
answer
20
views
MonetDB: How to flatten comma separated column into individual rows
I have a column which has comma separated values.
--------
items
--------
a, b
--------
I want to list them as separate rows like:
------
Items
_____
a
b
----
I can't seem to find the syntax to do ...
0
votes
0
answers
38
views
Monetdb recovery from crash and backup
We are using Monetdb as our BI database. Sometimes we experience crash of the database during some query execution.
The data is critical and database needs to recover, but there is no way how to ...
0
votes
1
answer
93
views
What's the fastest way to clone a big table in MonetDB?
I got a table of 300 millions rows (and 10 columns) in MonetDB 11.47 and I want to clone it in the same server.
So far I've tried with
START TRANSACTION ISOLATION LEVEL SERIALIZABLE;
CREATE TABLE ...
0
votes
1
answer
93
views
Why MonetDB does not add this table to the merge table?
I am struggling with merge tables and need community help!
when I add a table to a newly created merge table, does the "added" table need to be empty?
if the "added" table has an ...
0
votes
1
answer
63
views
monet db user / role / database / tables
monetdb create ebi_dwh
monetdb release ebi_dwh
CREATE ROLE "ebi_reader";
CREATE ROLE "ebi_writer";
CREATE SCHEMA "ebi" AUTHORIZATION ebi_reader;
CREATE SCHEMA "...
-1
votes
3
answers
217
views
From SQL table find the same product have same product key
I have table in the following structure, I need to write SQL to find the product having multiple product keys? Can anyone please help to write the SQL?
Product
Product Key
First
10
First
1
Second
...
0
votes
1
answer
45
views
Monetdb slow query : trace select "aint1p" from "aTestCube"."a1b" where "aint10p"=1234567891 limit 5;
when running this simple query trace select "aint1p" from "aTestCube"."a100m" where "aint10p"=1234567891 limit 5;
I noticed that when running this query on a ...
0
votes
1
answer
69
views
pymonetdb can not upload to MonetDB server from client
I "thought" pymonetdb would allow a bulk csv file upload to a remote MonetDB server but I'm getting an error:
Error in py_call_impl(callable, call_args$unnamed, call_args$named) :
pymonetdb....
0
votes
1
answer
275
views
Creating and connecting to multiple MonetDB databases in Windows
I am completely new to MonetDB and trying to set it up on Windows. I didn't know how to create my own database, but this thread from 7 years ago helped. Now, I have follow-up questions.
At first, I ...
0
votes
1
answer
57
views
In MonetDB internals, what goes in the different files named: X.thashb, X.thashl, X.tail?
While inspecting the underlying files corresponding to a particular table's column in MonetDB, I was surprised to find that the disk storage used for this column was much more than I expected. The ...
1
vote
1
answer
104
views
After stopping MonetDB, mserver still appear to be running, and restart is now impossible. Does anyone know why?
I'm new to using MonetDB for my data. My dataset is currently about 1TB in size (spread across lots of tables).
About an hour or two ago, I ran monetdbd stop db and monetdb stop db (both the dbfarm ...
0
votes
1
answer
52
views
Modify Max number of Query Execution at same time on monetdb
Currently, I am using MonetDB Database Server Toolkit v11.43.21 (Jan2022-SP4)
Issue:
we are running more then 100 query concurrently by user in Monetdb and sys.queue in Monetdb is showing 50 tuples ...
0
votes
0
answers
508
views
SQL data versioning in DuckDB
I'm using MonetDB in a project and currently evaluating moving to DuckDB. As part of that I'm also reevaluating how we do versioning of data and if there's a better way to do it in DuckDB.
We manage ...
0
votes
1
answer
62
views
Lazy Logical Replication with MonetDB
I'm trying to implement MonetDB in three machines, one master and two replicas in lazy logical replication.
For now I'm trying to implement in only machine with the following commands I took from this ...
1
vote
1
answer
118
views
Bulk upload using csv file to remote MonetDB server
I have a remote MonetDB server running and I want to bulk upload a csv file as it is much faster.
Based on the params in MonetDB.R, there is a csvdump=TRUE option but I don't think it works when you ...
0
votes
1
answer
119
views
How to persist an inmemory monetdbe db to local disk
I am using an embedded monetdb database in python using Monetdbe.
I can see how to create a new connection with the :memory: setting
But i cant see a way to persist the created database and tables for ...
0
votes
1
answer
189
views
MonetDB : Partitioning Data by Time Intervals
I am using MonetDB for time series data. I want to partition the tables by time intervals (e.g. by day). Each partition would therefore contain data of a particular day. That ideally would later ...
0
votes
0
answers
37
views
ModuleNotFoundError for monetdbe
I created a new environment on conda and installed monetdbe using the following command
pip install monetdbe
This seems to run successfully
When i start my ide(spyder) and try the command
from ...
0
votes
1
answer
192
views
MonetDB Write Ahead Logs Not Being Cleaned
As seen in section 3.3 of this paper, MonetDB is supposed to clean write ahead logs with regular frequency:
During a server session, the MonetDB server will clean up the log files at a regular time ...
0
votes
1
answer
106
views
MonetDB: jdbc based queries return -1 as affected rows often even though the query was successful
e.g, below query:
create table t1 ( age int, name varchar(10) )
insert into t1 values(1, 'name'),(2, 'surname')
copy select * from t1 into 't1.dat' DELIMITERS '|','
','"' null as '';
The copy ...
0
votes
1
answer
52
views
pcre.index throwing TypeException:user error after using
I'm trying to get the PCRE module working with my monetDB server.
I run the following:
CREATE OR REPLACE FUNCTION pcre_index(s string, pattern string) RETURNS integer EXTERNAL NAME pcre."index&...
0
votes
0
answers
120
views
MonetDB remote table "unexpected end of file"
I'm trying to configure a remote table on a second node but receiving "unexpected end of file" every time I try to do a select statement.
Configuration Node one:
can be accessed from ...
0
votes
2
answers
330
views
Monetdb Loader Function Issue - Embedded Python 3 has not been installed
This is the error when trying to run a Python loader function through mclient.
TypeException:user.main[4]:'pyapi3.eval' undefined: Embedded Python 3 has
not been installed. Please install it first, ...
0
votes
1
answer
473
views
maximum concurrent client limit reached (65), please try again later
I have been getting the following error in my application.
maximum concurrent client limit reached (65), please try again later
I think I need to increase the limit for maximum concurrent clients. ...
0
votes
2
answers
472
views
MonetDB Crashes When Connecting. Will Not Restart. Large Logs
I recently migrated an instance of MonetDB to a machine with a more memory and a larger hard drive by transferring a machine image from one location to another. The database worked briefly but now ...
0
votes
1
answer
91
views
See number of live/dead tuples in MonetDB
I'm trying to get some precise row counts for all tables, given that some have deleted rows. I have been using sys.storage.count. But this seems to count the deleted ones also.
I assume using sys....
2
votes
1
answer
323
views
invalid credentials for user 'monetdb' when using the official docker image and a .monetdb file
How to recreate my problem
Creating the MonetDB Container
I have this setup (using windows with Docker Desktop).
Create the official monetdb docker container with the follwing command:
docker run -v $...
0
votes
1
answer
154
views
MonetDB Insert Statement Returning id support in Golang
I am trying to run this insert query statement using golang which should return an id
INSERT INTO users (u_email,u_phone,u_password_hash) VALUES (?,?,?) RETURNING u_user_id;
it seems there is no ...
0
votes
1
answer
102
views
Monetdb Conversion of string to blob failed
I have a Golang User struct with PasswordHash of type *[]byte
type User struct {
ID UserID `json:"id,omitempty" db:"u_user_id"`
PasswordHash *[]byte `json:&...
0
votes
1
answer
163
views
MonetDB error when starting mclient, cannot set locale
I installed MonetDB on a Ubuntu 16.04 using the instructions: https://www.monetdb.org/easy-setup/ubuntu-debian/
When trying to start the client: mclient -u monetdb -d testdb
I get back this error:
...
2
votes
1
answer
194
views
Monetdbe Python UDF
Given that monetdbe is a Python package, I'm optimistic that Python user-defined-functions are possible, but I haven't been able to find an example. I've tried this:
drop function every_other_letter;
...
0
votes
1
answer
175
views
"Failed to extend the BAT" error in MonetDB 11.41.5
I'm using MonetDB 11.41.5 and I'm trying to bulk upload a very large CSV file (70 Gb) to a table using COPY INTO.
After a few minutes, I get the following message:
I checked the disk space and I ...
1
vote
0
answers
441
views
Time Series Downsampling/Upsampling
I am trying to downsample and upsample time series data on MonetDB.
Time series database systems (TSDS) usually have an option to make the downsampling and upsampling with an operator like SAMPLE BY (...
0
votes
1
answer
71
views
How to pass table as a input parameter in function?
Is it possible to pass table as input parameter in Monetdb function/procedure?
I tried prepare statement but was not able to get it working.
Also it would be nice to get statementid returned directly ...
0
votes
0
answers
52
views
An efficient way to group columns in MonetDB
I have the next INSERT with SELECT in MonetDB:`
insert into colombia.agregada_region_mes
(
cod_anomes
, cod_produto
, sg_estado
, cod_subcanal
, qtd_vendidas
, valor
, valor_dolar
, valor_euro
, ...
1
vote
1
answer
114
views
Using WITH in MonetDB
I'm trying to execute the next query in MonetDB using "WITH":
with a as (select data_string from colombia.dim_tempo)
select
t.ano_mes
,f.sg_estado
,f.cod_produto
, sum(f.qtd_vendidas) as ...
0
votes
1
answer
51
views
UPDATE sentence using WITH doesn't work in MonetDB
I have this UPDATE in MonetDB (version 11.41.11):
with t as (select distinct cod_atc_nl_1 , desc_atc_nl_1 from uruguay.staging_rm_dims where desc_atc_nl_1 is not null order by 1)
update uruguay....
0
votes
0
answers
135
views
What happened with MonetDB last release and COPY INTO?
I'm using version 11.39.11 (Oct2020 SP2) of MonetDB database as part of a BI software. MonetDB feeds the fact table with a large flat file of 40 columns and 225 millions of rows. Everything works like ...
0
votes
1
answer
367
views
How to use "group by grouping sets" and "having" with total line?
I created this SQL command:
select
product_category_name a,
count(product_id) b
from
sys.odeds_2_20210811095253
group by
grouping sets ((product_category_name), ())
The result is this:...
0
votes
1
answer
41
views
Sorting accented characters in MonetDB
When I run the command "select product_name from products order by product_name" the result is this:
enter image description here
But, I would like to get this result:
enter image ...
0
votes
1
answer
481
views
how can we replace the ""(empty string) with NULL while loading the csv file data into monet db using csv bulk load command
i am trying to load some csv data into monet db using csv bulk load command. Monet team providing below command to load the data by replacing null values with "" but its not working.
Copy ...
0
votes
2
answers
114
views
data is converting to binary format while loading data into monet db using Apache pig
I am using MonetDb-Pig layer to load the csv data into Monet db. Internally it is using Binarybulkload commands to load the data but after loading data into table, the csv file values are not not ...
0
votes
1
answer
82
views
About "LOCKED MODE" (COPY INTO LOCKED)
Is the "lock" done on the entire database or only on the table involved in "COPY INTO"?
In case it is done only on the involved table: Can I have more than one connection in ...
1
vote
1
answer
544
views
Weka and SQL Server 2019 (Mac OS Big Sur 11.5 beta, MacBook Pro M1) connection problems
Good evening. I hope someone can help me with this one...
I made sure I installed weka 2-8-5 azul zulu for mac, Intel, since the ARM dmg installer seems to be corrupted. I get a damaged package ...
0
votes
0
answers
185
views
Monetdb on windows : unable to connect to mserver5 after upgrade
First message on this topic.
-I had an old monetdb installation on my windows laptop
-Did the upgrade in Oct2020-SP5
-It really looks like I can start the server
C:\Program Files\MonetDB\MonetDB5\bin&...
0
votes
2
answers
102
views
MonetDB COPY INTO java.lang.NoSuchMethodError with new JDBC 3.0 driver
I'm trying to do a MonetDB "COPY INTO" statement inside Pentaho 8.1 (JDK 1.8.0_282) with new MonetDB JDBC 3.0 driver, and I get this, error message:
java.lang.NoSuchMethodError: java.nio....
0
votes
1
answer
37
views
Error (Hung process?) when using COPY INTO with ANSI file
I'm trying to load a set of public flat files (using COPY INTO from Python) - that apparently are saved in ANSI format. Some of the files load with no issue, but there is at least one case where the ...
0
votes
2
answers
262
views
Problems debugging mserver5
I have recently started debugging the mserver5 application using vscode and a very comfy plugin for cmake called CMake Tools. Moreover, I am using gcc 9.3.0 (Ubuntu 9.3.0-17ubuntu1~20.04) as a ...
0
votes
0
answers
55
views
Using MonetDB grouping sets with Pentaho Mondrian
I know MonetDB supports grouping sets. I also know that Mondrian supports them too, but only in a couple of databases.
Is it possible to enable SQL groupings sets in Mondrian for MonetDB database?
...
0
votes
1
answer
62
views
Sqoop Import failing to import data from Monet DB
Sqoop import command failing with error -
Could not load db driver class: nl.cwi.monetdb.jdbc.MonetDriver
Sqoop Command
sqoop import \
--driver nl.cwi.monetdb.jdbc.MonetDriver \
--connect "jdbc:...