Questions tagged [monetdb]

MonetDB is an open-source implementation of a column-oriented database. It is focused on analytical applications on a main memory resident database. MonetDB is a relational database and provides an SQL top-level interface. It is actively developed at CWI in Amsterdam, The Netherlands.

Filter by
Sorted by
Tagged with
0 votes
0 answers
34 views

Monetdb - Did someone using it with kubernetes 1.25.x?

I'm using MonetDB on AWS with kubernetes 1.24 successfully. During my testing on Azure / AWS with kubernetes 1.25, I'm unable to create the db. Following error message appears: #2023-09-04 16:15:35: ...
Sebastien Pinel's user avatar
0 votes
1 answer
108 views

Creating and connecting to multiple MonetDB databases in Windows

I am completely new to MonetDB and trying to set it up on Windows. I didn't know how to create my own database, but this thread from 7 years ago helped. Now, I have follow-up questions. At first, I ...
Ray's user avatar
  • 5
0 votes
0 answers
27 views

When MonetDB is restarted, are the previously managed INDEXes lost?

I'm using MonetDB for a research project, and for data safety reasons I frequently shutdown, backup, and then restart the database. My question is whether this procedure has an impact on performance, ...
Seán Healy's user avatar
0 votes
1 answer
25 views

In MonetDB internals, what goes in the different files named: X.thashb, X.thashl, X.tail?

While inspecting the underlying files corresponding to a particular table's column in MonetDB, I was surprised to find that the disk storage used for this column was much more than I expected. The ...
Seán Healy's user avatar
0 votes
0 answers
22 views

In MonetDB, is the default hash index better or worse than an ordered index for purposes of large scale joins?

I read that MonetDB creates indexes automatically for various table columns, and that the type of those indexes is a hash. MonetDB also received the addition of the "ordered index" later on, ...
Seán Healy's user avatar
1 vote
1 answer
47 views

After stopping MonetDB, mserver still appear to be running, and restart is now impossible. Does anyone know why?

I'm new to using MonetDB for my data. My dataset is currently about 1TB in size (spread across lots of tables). About an hour or two ago, I ran monetdbd stop db and monetdb stop db (both the dbfarm ...
Seán Healy's user avatar
0 votes
1 answer
42 views

Modify Max number of Query Execution at same time on monetdb

Currently, I am using MonetDB Database Server Toolkit v11.43.21 (Jan2022-SP4) Issue: we are running more then 100 query concurrently by user in Monetdb and sys.queue in Monetdb is showing 50 tuples ...
Debug's user avatar
  • 1
0 votes
0 answers
55 views

Query the DB from a MonetDB C-UDF

How can I query data from another table from the body of a JIT-ed C-UDF in MonetDB? Is it possible to execute an arbitrary SQL query from within an UDF? E.g.: CREATE FUNCTION handle_exp(exp STRING, id ...
Mike Siomkin's user avatar
0 votes
0 answers
236 views

SQL data versioning in DuckDB

I'm using MonetDB in a project and currently evaluating moving to DuckDB. As part of that I'm also reevaluating how we do versioning of data and if there's a better way to do it in DuckDB. We manage ...
David's user avatar
  • 1,872
0 votes
1 answer
38 views

Lazy Logical Replication with MonetDB

I'm trying to implement MonetDB in three machines, one master and two replicas in lazy logical replication. For now I'm trying to implement in only machine with the following commands I took from this ...
thomastbb's user avatar
1 vote
1 answer
71 views

Bulk upload using csv file to remote MonetDB server

I have a remote MonetDB server running and I want to bulk upload a csv file as it is much faster. Based on the params in MonetDB.R, there is a csvdump=TRUE option but I don't think it works when you ...
t_creasman's user avatar
0 votes
1 answer
97 views

How to persist an inmemory monetdbe db to local disk

I am using an embedded monetdb database in python using Monetdbe. I can see how to create a new connection with the :memory: setting But i cant see a way to persist the created database and tables for ...
arif saeed's user avatar
0 votes
1 answer
142 views

MonetDB : Partitioning Data by Time Intervals

I am using MonetDB for time series data. I want to partition the tables by time intervals (e.g. by day). Each partition would therefore contain data of a particular day. That ideally would later ...
AbdelKh's user avatar
  • 510
0 votes
0 answers
36 views

ModuleNotFoundError for monetdbe

I created a new environment on conda and installed monetdbe using the following command pip install monetdbe This seems to run successfully When i start my ide(spyder) and try the command from ...
arif saeed's user avatar
0 votes
1 answer
127 views

MonetDB Write Ahead Logs Not Being Cleaned

As seen in section 3.3 of this paper, MonetDB is supposed to clean write ahead logs with regular frequency: During a server session, the MonetDB server will clean up the log files at a regular time ...
James Scott's user avatar
  • 1,062
0 votes
1 answer
84 views

MonetDB: jdbc based queries return -1 as affected rows often even though the query was successful

e.g, below query: create table t1 ( age int, name varchar(10) ) insert into t1 values(1, 'name'),(2, 'surname') copy select * from t1 into 't1.dat' DELIMITERS '|',' ','"' null as ''; The copy ...
user3391196's user avatar
0 votes
1 answer
48 views

pcre.index throwing TypeException:user error after using

I'm trying to get the PCRE module working with my monetDB server. I run the following: CREATE OR REPLACE FUNCTION pcre_index(s string, pattern string) RETURNS integer EXTERNAL NAME pcre."index&...
hiramthehero's user avatar
0 votes
0 answers
105 views

MonetDB remote table "unexpected end of file"

I'm trying to configure a remote table on a second node but receiving "unexpected end of file" every time I try to do a select statement. Configuration Node one: can be accessed from ...
Diego's user avatar
  • 1
0 votes
2 answers
274 views

Monetdb Loader Function Issue - Embedded Python 3 has not been installed

This is the error when trying to run a Python loader function through mclient. TypeException:user.main[4]:'pyapi3.eval' undefined: Embedded Python 3 has not been installed. Please install it first, ...
Andreas's user avatar
0 votes
1 answer
171 views

maximum concurrent client limit reached (65), please try again later

I have been getting the following error in my application. maximum concurrent client limit reached (65), please try again later I think I need to increase the limit for maximum concurrent clients. ...
Rahul Hindocha's user avatar
0 votes
2 answers
371 views

MonetDB Crashes When Connecting. Will Not Restart. Large Logs

I recently migrated an instance of MonetDB to a machine with a more memory and a larger hard drive by transferring a machine image from one location to another. The database worked briefly but now ...
James Scott's user avatar
  • 1,062
0 votes
1 answer
80 views

See number of live/dead tuples in MonetDB

I'm trying to get some precise row counts for all tables, given that some have deleted rows. I have been using sys.storage.count. But this seems to count the deleted ones also. I assume using sys....
dcc310's user avatar
  • 1,038
2 votes
1 answer
254 views

invalid credentials for user 'monetdb' when using the official docker image and a .monetdb file

How to recreate my problem Creating the MonetDB Container I have this setup (using windows with Docker Desktop). Create the official monetdb docker container with the follwing command: docker run -v $...
Bishares's user avatar
0 votes
1 answer
132 views

MonetDB Insert Statement Returning id support in Golang

I am trying to run this insert query statement using golang which should return an id INSERT INTO users (u_email,u_phone,u_password_hash) VALUES (?,?,?) RETURNING u_user_id; it seems there is no ...
Andrew K Odeki's user avatar
0 votes
1 answer
81 views

Monetdb Conversion of string to blob failed

I have a Golang User struct with PasswordHash of type *[]byte type User struct { ID UserID `json:"id,omitempty" db:"u_user_id"` PasswordHash *[]byte `json:&...
Andrew K Odeki's user avatar
0 votes
1 answer
139 views

MonetDB error when starting mclient, cannot set locale

I installed MonetDB on a Ubuntu 16.04 using the instructions: https://www.monetdb.org/easy-setup/ubuntu-debian/ When trying to start the client: mclient -u monetdb -d testdb I get back this error: ...
user17992646's user avatar
2 votes
1 answer
149 views

Monetdbe Python UDF

Given that monetdbe is a Python package, I'm optimistic that Python user-defined-functions are possible, but I haven't been able to find an example. I've tried this: drop function every_other_letter; ...
dcc310's user avatar
  • 1,038
0 votes
1 answer
145 views

"Failed to extend the BAT" error in MonetDB 11.41.5

I'm using MonetDB 11.41.5 and I'm trying to bulk upload a very large CSV file (70 Gb) to a table using COPY INTO. After a few minutes, I get the following message: I checked the disk space and I ...
Llorieb's user avatar
  • 25
1 vote
0 answers
329 views

Time Series Downsampling/Upsampling

I am trying to downsample and upsample time series data on MonetDB. Time series database systems (TSDS) usually have an option to make the downsampling and upsampling with an operator like SAMPLE BY (...
AbdelKh's user avatar
  • 510
0 votes
1 answer
61 views

How to pass table as a input parameter in function?

Is it possible to pass table as input parameter in Monetdb function/procedure? I tried prepare statement but was not able to get it working. Also it would be nice to get statementid returned directly ...
Alex O's user avatar
  • 1
0 votes
0 answers
49 views

An efficient way to group columns in MonetDB

I have the next INSERT with SELECT in MonetDB:` insert into colombia.agregada_region_mes ( cod_anomes , cod_produto , sg_estado , cod_subcanal , qtd_vendidas , valor , valor_dolar , valor_euro , ...
Llorieb's user avatar
  • 25
0 votes
1 answer
88 views

Using WITH in MonetDB

I'm trying to execute the next query in MonetDB using "WITH": with a as (select data_string from colombia.dim_tempo) select t.ano_mes ,f.sg_estado ,f.cod_produto , sum(f.qtd_vendidas) as ...
Llorieb's user avatar
  • 25
0 votes
1 answer
44 views

UPDATE sentence using WITH doesn't work in MonetDB

I have this UPDATE in MonetDB (version 11.41.11): with t as (select distinct cod_atc_nl_1 , desc_atc_nl_1 from uruguay.staging_rm_dims where desc_atc_nl_1 is not null order by 1) update uruguay....
Llorieb's user avatar
  • 25
0 votes
0 answers
118 views

What happened with MonetDB last release and COPY INTO?

I'm using version 11.39.11 (Oct2020 SP2) of MonetDB database as part of a BI software. MonetDB feeds the fact table with a large flat file of 40 columns and 225 millions of rows. Everything works like ...
Llorieb's user avatar
  • 25
0 votes
1 answer
252 views

How to use "group by grouping sets" and "having" with total line?

I created this SQL command: select product_category_name a, count(product_id) b from sys.odeds_2_20210811095253 group by grouping sets ((product_category_name), ()) The result is this:...
Alexandre's user avatar
0 votes
1 answer
31 views

Sorting accented characters in MonetDB

When I run the command "select product_name from products order by product_name" the result is this: enter image description here But, I would like to get this result: enter image ...
Alexandre's user avatar
0 votes
1 answer
457 views

how can we replace the ""(empty string) with NULL while loading the csv file data into monet db using csv bulk load command

i am trying to load some csv data into monet db using csv bulk load command. Monet team providing below command to load the data by replacing null values with "" but its not working. Copy ...
RamohanReddy's user avatar
0 votes
2 answers
111 views

data is converting to binary format while loading data into monet db using Apache pig

I am using MonetDb-Pig layer to load the csv data into Monet db. Internally it is using Binarybulkload commands to load the data but after loading data into table, the csv file values are not not ...
RamohanReddy's user avatar
0 votes
1 answer
65 views

About "LOCKED MODE" (COPY INTO LOCKED)

Is the "lock" done on the entire database or only on the table involved in "COPY INTO"? In case it is done only on the involved table: Can I have more than one connection in ...
Alexandre's user avatar
1 vote
1 answer
483 views

Weka and SQL Server 2019 (Mac OS Big Sur 11.5 beta, MacBook Pro M1) connection problems

Good evening. I hope someone can help me with this one... I made sure I installed weka 2-8-5 azul zulu for mac, Intel, since the ARM dmg installer seems to be corrupted. I get a damaged package ...
Michael Prendergast's user avatar
0 votes
0 answers
164 views

Monetdb on windows : unable to connect to mserver5 after upgrade

First message on this topic. -I had an old monetdb installation on my windows laptop -Did the upgrade in Oct2020-SP5 -It really looks like I can start the server C:\Program Files\MonetDB\MonetDB5\bin&...
saubert's user avatar
0 votes
2 answers
93 views

MonetDB COPY INTO java.lang.NoSuchMethodError with new JDBC 3.0 driver

I'm trying to do a MonetDB "COPY INTO" statement inside Pentaho 8.1 (JDK 1.8.0_282) with new MonetDB JDBC 3.0 driver, and I get this, error message: java.lang.NoSuchMethodError: java.nio....
Llorieb's user avatar
  • 25
0 votes
1 answer
34 views

Error (Hung process?) when using COPY INTO with ANSI file

I'm trying to load a set of public flat files (using COPY INTO from Python) - that apparently are saved in ANSI format. Some of the files load with no issue, but there is at least one case where the ...
tylerc's user avatar
  • 1
0 votes
2 answers
197 views

Problems debugging mserver5

I have recently started debugging the mserver5 application using vscode and a very comfy plugin for cmake called CMake Tools. Moreover, I am using gcc 9.3.0 (Ubuntu 9.3.0-17ubuntu1~20.04) as a ...
mledl's user avatar
  • 13
0 votes
0 answers
52 views

Using MonetDB grouping sets with Pentaho Mondrian

I know MonetDB supports grouping sets. I also know that Mondrian supports them too, but only in a couple of databases. Is it possible to enable SQL groupings sets in Mondrian for MonetDB database? ...
Llorieb's user avatar
  • 25
0 votes
1 answer
52 views

Sqoop Import failing to import data from Monet DB

Sqoop import command failing with error - Could not load db driver class: nl.cwi.monetdb.jdbc.MonetDriver Sqoop Command sqoop import \ --driver nl.cwi.monetdb.jdbc.MonetDriver \ --connect "jdbc:...
Vijiy's user avatar
  • 1,187
1 vote
1 answer
86 views

Cannot execute tests using Mtest.py in MonetDB

I am currently trying to get going with developing additional functionality for the MonetDB DBMS. I have been reading through the code and tried to debug the code using VSCODE which actually works ...
mledl's user avatar
  • 13
1 vote
1 answer
66 views

How to express "either the single resulting record or NULL", without an inner-query LIMIT?

Consider the following query: SELECT (SELECT MIN(col1) FROM table1) = 7; Assuming col1 is non-NULLable, this will yield either true or false - or possibly NULL when table1 is empty; But now suppose I ...
einpoklum's user avatar
  • 119k
0 votes
1 answer
190 views

Can several threads each open their own DB connection in Monetdbe

I am embedding Monetdbe into a multi-threaded C++ application. I have several threads running on the server-side of my application and each thread opens its own instance of the same Monetdb database, ...
arif saeed's user avatar
0 votes
1 answer
60 views

monetdb - Row count is increasing in the target table

I am loading data from SQL server DB table to MonetDB table using spark job. My source table has 100000 records. I am directly moving these records into monetdb table and no filter and joins at all. ...
Narasimha Malreddy's user avatar

1
2 3 4 5
9