Questions tagged [greenplum]

Greenplum is the worlds first open-source massively parallel processing database based on PostgreSQL.It provides powerful and rapid analytics on petabyte scale data volumes. Uniquely geared toward big data analytics, Greenplum Database is powered by the world’s most advanced cost-based query optimizer delivering high analytical query performance on large data volumes.

Filter by
Sorted by
Tagged with
0 votes
0 answers
5 views

unable to drop ERROR: unknown compresstype "quicklz" unable to drop

We have some tables defined with compression type as 'quicklz' in our Open-source greenplum database version 6.24.6. Which we want to drop. While dropping such objects it throws below error: ERROR: ...
Azeem tahir's user avatar
-1 votes
1 answer
30 views

How can I use concat in Greenplum

I have a function where I must concat 'text'||'#'||column_name How can I concat in my query using following script? p_sql_text := ' select ''MDMP'' as bk_src_cd, ''MDMP'|...
Umid Umaraliev's user avatar
0 votes
0 answers
22 views

Remove MetaData from Avro KAFKA Messages

I am trying to sync data from Avro KAFKA messages into the target table in Greenplum using GPKAFKA version 2 but the data types are also being inserted with the actual value in the columns. I am using ...
Maaheen's user avatar
0 votes
0 answers
15 views

gpupgrade tool: can I upgrade from 6.x to 7.x?

Can I use gpupgrade to upgrade my Greenplum database from 6.x to 7.x? documentation on greenplum.org only mentions 5.x to 6.x
JacquesB's user avatar
0 votes
0 answers
30 views

Unable to Insert Data in GreenPlum using GPKAFKA

I am facing issues with reading data from KAFKA using GPKAFKA and inserting the data into the GreenPlum database. My target table has multiple columns of different data types and the external table ...
Maaheen's user avatar
0 votes
1 answer
59 views

Greenplum Database: Segment data directory does not exist

I am getting below error during Greenplum database initialisation step. Using 3 hosts including primary host and two segment without a standby primary. 3 segments folders already existing in both of ...
dbman's user avatar
  • 29
0 votes
1 answer
46 views

greenplum -> greenplum data pumping

I got a one-time task to upload ~50 datatables (about 1 TB in total) from 1 greenplum system to another. Administrators have already allowed a network connection between the systems. Also i have link ...
Babo's user avatar
  • 19
0 votes
0 answers
27 views

Greenplum database,postgresql

How to find the list of temporary tables which have been utilizing in the functions in greenplum database I am trying to find the list of functions only by using the below query select pn.nspname as ...
Diddi Swetha's user avatar
0 votes
1 answer
42 views

How to pass params in function at for in select loop end loop

I have a function with 2 char params. I tried pass it by order $1 $2, by name with and without a colon and via alias. it doesn't work - I get an empty result. When passing values instead of parameters,...
Babo's user avatar
  • 19
0 votes
1 answer
36 views

know where compression applied in greenplum postgresql table

I have a order table which has 50 columns in my greenplum postgres database. Which has billions of data in the table but when I run \dt+ order I am getting just 27MB size and I have distributed on ...
msr's user avatar
  • 11
1 vote
0 answers
52 views

Logical replication from Postgresql to Greenplum

We have a Postgresql database to which we are only adding data (we don't use UPDATE or DELETE operations). We need to perform analytical queries on the data that we received a few minutes ago. We ...
Vladimir Shadrin's user avatar
0 votes
0 answers
110 views

Connect to Postgres from Python, without password

Good day, We have the following Python code that works from our production environment: try: conn = psycopg2.connect(host=db_ip, port=db_port, database=db_name, user=db_user) cur = conn....
JacquesB's user avatar
0 votes
1 answer
79 views

Best way to copy data between databases with Greenplum without losing data

My database relies on Greenplum copy functions to copy data from source to target databases. At the moment, I have a process that copies data from a PostgreSQL source using the following copy ...
ESports's user avatar
0 votes
0 answers
13 views

Page size for AO Table in Greenplum

Can you please tell me how the division into pages occurs when loading data into AO tables? Heap knows that pagination occurs when 32k is reached, but what about AO tables? Found that the size of the ...
AlexeyDS's user avatar
0 votes
1 answer
91 views

function return setof text

I'm newby to PG/GP. I need write function returning a full Greenplum table definition (like in dbeaver DDL tab). In my system functions get_table_def, catalog.pg_gettabledef does not exist, or ...
Babo's user avatar
  • 19
0 votes
1 answer
207 views

Greenplum Installation on centos 7

I am totally new in database administration, i have 3 virtual servers on conetos 7 2 cpu 4 ram 50 gb hdd, i tried several times to install greenplum, but it was not successful, plsease share some ...
Numonjon's user avatar
0 votes
0 answers
21 views

How i can override an external table in GPFDist

I work with Informatica Power Center and GreenPlum - they are interconnected by a connector that works on the basis of gpfdist in the gloader wrapper. Can I somehow override the place where the ...
Niexes's user avatar
  • 1
0 votes
1 answer
109 views

how to set time out in greenplum?

when i execute greenplum sql : alter table dw_crm_reports.dwd_agg_prodsalesinfo set with (reorganize=true); After 1800 seconds, the following error is returned: [Pivotal][Greenplum JDBC Driver]...
Min Zhu's user avatar
0 votes
0 answers
40 views

Greenplum Transpose rows into columns

I need to tranform this table: dt user_name call_type call_start call_end 2023-01-01 Bob in 2023-01-01 10:00:00.000 2023-01-01 10:05:00.000 2023-01-01 Bob in 2023-01-01 11:00:00.000 2023-01-01 11:...
Ramzes's user avatar
  • 91
0 votes
1 answer
79 views

Is it possible for postgresdb (greenplum) to publish messages whenever the data inside to DB is updated?

I'm trying to sync the cache (gemfire) to be the same as the greenplum database. The database receives data updates from external sources. I thought of using the database to send a trigger whenever ...
bulbasarous's user avatar
0 votes
0 answers
139 views

How to effectively optimize queries in Presto?

Testing Presto technology and looking for really useful ways to improve Presto query performance. While unsuccessfully, the methods described in the documentation do not bring any result at all. All ...
Vasily Kashper's user avatar
0 votes
0 answers
93 views

Error "type character varying is not composite" when sending query from SAS to Greenplum

Good day! When sending a query from SAS script to our Greenplum database, I sometimes get an error like this: create table new as select contact_id from connection to gp ( select c6.contact_id ...
Senya Zaitsev's user avatar
0 votes
0 answers
54 views

create extension for anonymize failing

I'm interested in trying to 'anonymize' a field using static masking in Postgres Greenplum using code from this site: https://postgresql-anonymizer.readthedocs.io/en/latest/static_masking/ The code I'...
Ben999's user avatar
  • 1
0 votes
0 answers
89 views

Greenplum - how do I use SERIAL column and generate in the order of the data inserted

When trying to insert multiple records from an ordered query into a Greenplum table which includes a SERIAL column, the generated values are not in the order of the selected data. If, however, the ...
Pat Buxton's user avatar
0 votes
0 answers
43 views

Pentaho query on Greenplum stays in 'idle in transaction'

In my Pentaho transformation, I use (amongst others) the following steps: Execute SQL script - to drop and recreate a table on an Oracle DB (destination stage table, used in partition swap later) ...
JacquesB's user avatar
0 votes
0 answers
20 views

Maximum number of columns for greenplum,can i modify this value?

There will be more than 2000 columns in the same table, how do I achieve it? WITH (appendonly=true, orientation=column),I try to use this parameter to create the table, But it doesn't fulfill my ...
Lt_try's user avatar
  • 1
0 votes
1 answer
73 views

How, in PostgreSQL, can I iterate through table A, and use a column from table A as a limit for a join to table B to populate table C

Working with Greenplum 6 (based on PostgreSQL 9.4.), I have these sample tables: Table SAMPLE_A: | uniqueId | SampleSz | | -------- | -------- | | 1 | 25 | | 2 | 50450 | | 3 ...
S Ayo's user avatar
  • 13
0 votes
1 answer
434 views

How can I use greenplum pxf foreign table to insert data to the sql server?

When I try to insert data by using pxf foreign table, I got this problem postgres=# insert into test values(1); psql: ERROR: remote component error (500) from '127.0.0.1:5888': Type Exception ...
cousin's user avatar
  • 1
0 votes
0 answers
90 views

How can I work with greenplum data using spark?

I have a project in witch I read data from hadoop and make some calculations. Everything is done using spark. It's very important to not save data anywhere when I don't need that. That's why spark ...
alenar's user avatar
  • 1
0 votes
0 answers
44 views

Postgresql: make partition by last symbol in column

I want to make partition by last symbol in column. For example create table check_part ( id int, inn text) partition by list (right(inn, 1)) (partition inn_1 values ('1'), partition inn_2 ...
Иван Лебедев's user avatar
0 votes
2 answers
156 views

Greenplum COUNT(DISTINCT) produces different results for identical iterations of a query on a static dataset

I am using a Greenplum db (v 6.22.1) running PSQL (v 9.4.26) on a small linux server. I am analyzing ~36 million rows of data distributed among 6 segments. I want to count the unique number of users ...
nutrition_officer's user avatar
0 votes
0 answers
59 views

CONVERT_TIMEZONE issue in Greenplum

I have a query in Snowflake which I need to represent in Greenplum So I am facing with that problem. These date functions don't exist in Greenplum: TO_TIMESTAMP_NTZ(CONVERT_TIMEZONE('UTC', ...
Denis's user avatar
  • 13
0 votes
1 answer
89 views

GPDB distribution key should be same order?

create table schema.table1 ( col1 text, col2 text, ..., coln ) distributed by (col1, col2); create table schema.table2 ( col1 text, col2 text, ..., colm ) distributed ...
Lee Keun Woo's user avatar
0 votes
0 answers
37 views

Greenplum does not execute the query

We are facing an issue with a query when we try to run it. Any idea on why Greenplum would not pick a query ? The query for reference : WITH crmp AS ( SELECT json_data FROM ( SELECT ...
Iok's user avatar
  • 1
0 votes
0 answers
88 views

greenplum spark-connector server.hostEnv not working in k8s

I am trying to load/write greenplum table via spark-connector, deployed in kubernates; val gscWriteOptionMap = Map( "url" -> "jdbc:postgresql://192.168.95.153:5432/xxx", &...
user1484819's user avatar
1 vote
1 answer
152 views

GreenPlum choosing a bad query plan in join query

Please forgive my poor English I have two tables in greenplum(version is: PostgreSQL 9.4.20 (Greenplum Database 6.0.0-beta.3) ) one table is : cookie_session CREATE TABLE "ods_overall_cookie"...
linxiao yu's user avatar
0 votes
0 answers
495 views

incorrect display of data type in dbeaver

So, I convert dataframe with float64 columns to sql and get "text" column type a:text 1.11 0 4 123.43 [NULL] 2 But i can use this "text" as numbers, for example, i can SELECT sum(...
anon.for's user avatar
0 votes
1 answer
106 views

Informatica PowerCenter Greenplum Connector

We have just installed Informatica PowerCenter server on Unix, In order to test the Load into Greenplum DB, I didn't found the greenplum relational browser in workflow manager Connection Menu, as ...
MohaMed's user avatar
  • 84
0 votes
1 answer
118 views

How to output ddl of procedure using PostgreSQL

How to write sql query that will output DDL of sql procedure(using PostgreSQL). For example i have procedure with DDL: CREATE OR REPLACE FUNCTION entertainment.test_proc() RETURNS void ...
nex_lex's user avatar
1 vote
1 answer
53 views

Appending postfix string to result of select query in Greenplum database

I have a table like the following in Greenplum Name Marks George_Henry_CLASS_3 94 Jhon 72 Michael 59 David_Warner_CLASS_4 88 I want to append CLASS_5 string to each of the name in this table. If ...
Shankar's user avatar
  • 113
1 vote
1 answer
344 views

From postgres to greenplum via pxf UUID and INET types aint' supported?

So I am creating external table in greenplum based on the table i have in postgres. And When I create field field_name uuid I am getting an error "Field type UNSUPPORTED_TYPE" Same goes to ...
Vlad Vlad's user avatar
0 votes
1 answer
84 views

backup a greenplum instance: custom script

We have a greenplum 6.x instance. About 40 segment servers. We have to backup the instance. I know there are two main methods to backup greenplum instance gpbackup for parallel backup. The main ...
Gregor76's user avatar
0 votes
1 answer
215 views

Trying to connect to Greenplum database from PySpark getting an error

I'm trying to connect to Greenplum database using PySpark, but getting and error when executing code below. spark = SparkSession \ .builder \ .appName("Python Spark SQL basic example"...
condexter's user avatar
1 vote
1 answer
232 views

aggregate all keys(deep) of json

i have a table like this (9,000,000row/day)(2,000,000row/country) partition by data_date->country(sub_partition) (markdown has a problem,i can't submit this table,so->image) i want to aggregate ...
495088732qqcom's user avatar
0 votes
1 answer
398 views

Exception has occurred: TypeError 'NaTType' object is not callable

I use a python dataframe to transfer the data from the data lake to GP envt. I have a column with the data type "DateTime". import psycopg2 import pandas as pds from sqlalchemy import ...
kashif ashraf's user avatar
1 vote
1 answer
69 views

SSIS Runs perfectly on a remote server(Greenplum) Datalake but takes 8+ hours

SSIS Package performs the ETL on a remote server (Greenplum envt). It runs fine but takes 8+ hours to complete. Data on the Remote server's interaction tables are massive (~ 1 Billion rows each). Is ...
kashif ashraf's user avatar
-1 votes
1 answer
154 views

How to extract table names and column names from plpgsql

On the same line as the @Dylan Hogg (user:249597) you mentioned the sql-app.infocruncher.com hosted library is there one for plpgsql? Would highly help GP migration tasks. Basically I have the GP ...
Laszlo Winter's user avatar
0 votes
1 answer
264 views

SQL REGEXP_REPLACE() function

I have a table with names that has the values like this: Customer marco rossi .paolo esposito jimmi montana **Luke skywalker marinella abc - ÚDRST MARK -úgo srl What i wanted was to delete ...
Lusi Saliai's user avatar
0 votes
1 answer
766 views

Greenplum pxf - select from external table - invalid configuration

I have a greenplum database up and running and parquet files stored in hdfs at /user/hadoopuser/raw/ I installed and launched pxf and created external table with: create external table requests(id ...
Bogdan Goncharenko's user avatar
2 votes
0 answers
147 views

Greenplum Operator on kubernetes zapr error

I am trying to deploy Greenplum Operator on kubernetes and I get the following error: kubectl describe pod greenplum-operator-87d989b4d-ldft6: Name: greenplum-operator-87d989b4d-ldft6 ...
Oktay Alizada's user avatar

1
2 3 4 5
16