377
questions
0
votes
0
answers
99
views
Cloudera Enterprise (Community Edition) for RHEL 8
We are running a mini DWH platform with Cloudera Enterprise community version. Underlying Operating system is RHEL7
Version: Cloudera Express 6.0.1 (#610811 built by jenkins on 20181002-0044 git: ...
0
votes
1
answer
263
views
monitoring and observability over my Hadoop cluster
I'm trying to create a monitoring and observability infrastructure over my Hadoop cluster.
my cluster is managed via cloudera manager, because of that I have some questions that maybe some of you ...
1
vote
0
answers
34
views
Failed to configure cloudera manager agent
Hi I am new to bigdata and I am installing cloudera manager 7.4.4 on RHEL 8.0. While setting up the cluster I am facing the error like "failed to configure clouder manager agent" Can anyone ...
0
votes
0
answers
133
views
Guava jar giving continuous error while deployment
We are using guava-15.0.jar as part of cloudera-manager-api dependency version 6.3.0 in build.gradle file of cloudera-manager client module.
Gradle-file
But while deploying it is giving the below ...
1
vote
0
answers
333
views
Unable to Download Cloudera and CDH Repository
I am trying to download CM5 and CDH repository from "http://archive.cloudera.com/" but it is asking for credential. I have created my account in Cloudera site but that credential is not ...
1
vote
2
answers
524
views
How to do YARN role graceful shutdown on a Cloudera Manager datanode CDH 6.3.2
Can not find answer on this question.
How to gracefully stop YARN role on a data node and wait till all running jobs on a datanode will finish with status success.
I know that in ClouderaManager you ...
-1
votes
1
answer
44
views
cloudera - how to allocate resources for different users
I am using cloudera 6.3 and trying to achieve following things.
all the users who are running interactive queries should not get more than 20% of resources
Functional id which is used for getting ...
0
votes
1
answer
163
views
How to disable cloudera parcels from automatically distributing to all hosts or is there a way to setup a repo for all hosts?
I'm using Cloudera Manager 6.3.1 and have noticed that when I download parcels, they are automatically distributed to all hosts even though I do not need them in some all hosts.
So, the question is, ...
0
votes
1
answer
43
views
Adding new service type in Cloudera Manager
I'm following official docs to add service to a cluster in Cloudera Manager.
However it's custom service developed in-house and there's no service type shown.
How to add new service type in Cloudera ...
0
votes
1
answer
443
views
Cloudera CDP Private Cloud - Installation failed on hosts
I get an installation failed on hosts error while usng Cloudera Manager to install CDP 7.1.4 runtime on a trial basis. For this purpose I have spun up two VMs( Ubuntu 18), which use a NatNetwork to ...
1
vote
0
answers
2k
views
How to get query id for impala queries executed via sqlalchemy
I am querying impala using sqlalchemy which internally uses impyla.
from sqlalchemy import create_engine
from sqlalchemy.orm import sessionmaker
engine = create_engine("impala://{host}:{port}/{...
0
votes
1
answer
163
views
How to set Data Granularity with cm_api api.query_timeseries
I am trying to get files_total and dfs_capacity_used metrics for last 1 week with code shared in https://cloudera.github.io/cm_api/docs/python-client/
import time
import datetime
from_time = datetime....
1
vote
1
answer
234
views
Errno 14 PYCURL ERROR 6 ; Couldn't resolve host in Cloudera Manager 7.x upgrade
I am doing an upgrade from Cloudera CM 5.16 to CM 7.1.2. There is an instruction to enter userid:password in the url in the /etc/yum.repos.d/cloudera-manager.repo file when using the Cloudera public ...
0
votes
1
answer
984
views
What's the latest version of Cloudera Manager and CDH?
I'm currently running on cloudera Manager 5.14.3 and CDH 5.14.2
and want to upgrade to a higher and more stable version. Which version is the most stable and advisable to upgrade to? Version 6 or ...
1
vote
0
answers
762
views
Not able to run scm_prepare_database.sh script
I am installing Cloudera Manager and CDH 6.3.x and I'm using PostgreSQL for the Cloudera Manager Server and other services that use databases. I'm using a RHEL 7.4 Azure VM and following the official ...
0
votes
1
answer
84
views
Configuration file for Cloudera Management Service
Is the a configuration file for Cloudera Management Service?
I'd like to have the service roles' configuration stored in repository. This way, service configuration can be shared between environments ...
0
votes
1
answer
597
views
Cloudera namenode web UI is not launching
I recently installed the CDH distribution of Cloudera 6.1 to create a two node cluster. From the Cloudera Manager UI, all services are running fine.
However the namenode (and datanode) web UI alone is ...
1
vote
0
answers
284
views
Does "YARN Container increment in size due to round up" add up to spark overhead memory or spark executor memory?
Based on my understanding, when YARN allocates containers based on spark configuration ask, YARN automatically rounds up the container size in multiples of 'yarn.scheduler.minimum-allocation-mb'.
For ...
2
votes
2
answers
2k
views
Not able to download Cloudera
I am trying to find a link to download cloudera zip file on VMWare , but unable to get any.
Tried searching on google , on cloudera website , but in vain.
Can somebody share some views on it.
5
votes
2
answers
2k
views
Is there any alternative for Cloudera Manager? (CDH) [closed]
As Cloudera official blog said, there is no free version of CDH from 6.3.3, they would make the Cloudera Manager to open source, but not yet.
Is there any other project like Cloudera Manager? which ...
0
votes
1
answer
1k
views
Cloudera manager agent fails to install - nothing provides MySQL-python, python, python-psycopg2 needed by cloudera-manager-agent
Hello,
I have a CentOS-8 linux cluster and I am trying to install Cloudera 6.2.1 on it. As you can see in the attached picture is failing on cloudera-manager-agent installation due to 3 conflicting ...
1
vote
0
answers
107
views
Is there a way to clone services configurations in a cluster?
I need to clone services configuration (hue, spark, etc.) from a cluster to another one. Both of cluster are managed by Cloudera Manager (i need to clone cloudera manager configuration too).
1
vote
0
answers
535
views
Zookeeper Maximum Latency Monitoring Thresholds
A red-flagged error message appeared suddenly in the Zookeeper section of my Cloudera Manager Interface
"Bad: Maximum request latency: 102,477 ms. Maximum client-negotiable session timeout: 50,000 ms....
0
votes
1
answer
37
views
Cloudera Metric Template Location or Create Custom
I am trying to create custom metric template to reflect on chart builder. Also i need to know the configuration files where i can make changes for metrics. Is this possible or Cloudera metric ...
3
votes
0
answers
528
views
Cannot monitor impala queries on Cloudera Manager
I got installed a new cloudera cluster with versions CM-6.3.1 and CDH-6.3.2 and now facing a problem never had with previous cloudera distributions,
Cloudera Management Services (including Cloudera ...
0
votes
1
answer
1k
views
yarn application accepted but not running cloudera despite resource allocation
I am using a Cloudera quickstart VM 5.13.0.0 to run Spark applications in yarn-client mode. I have allocated 10GB and 3 cores to my Cloudera VM. When I submit the application, the application is ...
0
votes
2
answers
2k
views
How to set JAVA_HOME Cloudera quickstart for Kafka and Zookeeper
I have added Kafka service to my Cloudera cluster and when i try to start it it fails with the following error
Exception in thread "main" java.lang.UnsupportedClassVersionError: org/apache/kafka/...
1
vote
0
answers
42
views
Cloudera Manager Metric - Login Failure metric
I am trying to create a dashboard in Cloudera Manager using Chart Builder. I want to show metrics related to Login Failure rate (login_failure_rate). However, it doesn't reflect the actual status. Is ...
0
votes
1
answer
82
views
Connecting Cloudera Manager (6.3) to Oracle ATP on OCI using an Oracle Wallet
I am trying to set up a Cloudera Cluster (Cloudera 6.3) on OCI and want to use an ATP (also running on OCI) as the DB for the Cloudera Manager (I am using these docs).
In order to connect to the ATP ...
2
votes
2
answers
717
views
what is the difference between fsimage and snapshot in hadoop?
I am new to hadoop. I want to know the difference between snapshot and fsimage used for file system state in hadoop. I heard that both do the same work. then what makes the difference between them?
1
vote
0
answers
93
views
Access granted to groups and roles in Hue has no effect
When I give Grant to groups and roles in hue, nothing happens to the groups and no access is applied!
CREATE ROLE admin_role
GRANT ALL ON SERVER server1 TO ROLE admin_role
GRANT ROLE admin_role TO ...
1
vote
1
answer
221
views
Zookeeper fails to start after Native Library and Intel MKL Parcel Activation in CDH 6.0.0
I have 7 Node cluster managed by Cloudera Manager and CDH 6.0.0. I am trying to run matrix multiplication in Spark using a native library which uses BLAS. That is why I have downloaded parcels 1. ...
0
votes
1
answer
1k
views
Cloudera Manager - Service Monitor is not running
It seems there is something wrong with connection issues.But I don't know what lead to this problem.Could anyone help me?What connection issue am I facing?
(9 skipped) Error sending messages to ...
0
votes
1
answer
309
views
Spark - Worker doesn't have sufficient resource
I am new to Apache Spark and Cloudera Manager.I met some problem running my first spark application.
There are two Virtual Machines in my cluster with RAM and Cores:
13.4G /4 Cores as Master Node ,...
0
votes
1
answer
702
views
How to detect in Hadoop cluster if any Datanode drive (Storage) failed
I am trying to detect the drive failure in Datanode in a Hadoop Cluster. Cloudera Manager API don't have any specific API for that. CM API are only related to Name node or restart services. Are there ...
0
votes
0
answers
262
views
How to set LIVY_CONF_DIR in cloudera
I have installed livy server in cloudera in /usr/share. I want to change set the LIVY_CONF_DIR so that i can manage the config files like log4j.properties.
Cloudera says this is possible but i could ...
0
votes
0
answers
1k
views
FAILED: Execution Error, return code -101 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask. com/yammer/metrics/core/MetricsRegistry
We facing some issue in beeline while we connecting via beeline to hbase table. We have two hiveserver2, one of the node we got this error like:
INFO : Query ID = hive_20190719154444_babd2ce5-4d41-...
0
votes
0
answers
53
views
Hue not starting after cloudera installation
After installation of Cloudera 5.16, I started Hue service but it fails to start. The error is shown in the screenshot. Any suggestions are welcome.
1
vote
0
answers
614
views
The user hdfs is missing in its own group
I recently installed Cloudera and after doing installation, I ran the host inspector. But I saw some messages in it (screenshot attached). Please let me know how to get rid of them. Also, is the ...
0
votes
1
answer
729
views
How to stop a 'hive on spark' job after execute a hivesql in hue query
I'm using Cloudera Manager 6.1.1 and HUE. My hive engine is spark. When I execute a hivesql in hue query, there always will start a hive on spark job, and it won't stop.
0
votes
2
answers
31
views
How to install CM over an existing non CDH Cluster
Is it possible to install CM over an existing non CDH cluster?
For example, I have manually installed Hadoop and other services to my VMs.
Can I install CM and force it to manage my cluster?
1
vote
2
answers
6k
views
Beeline - No current connection - Default hs2 connection config nout found
We are facing an issue with respect to beeline CLI in one of our cloudera cluster. We are trying to connect and execute hql files which are alter statements using beeline CLI as like below and it is ...
1
vote
1
answer
2k
views
Cloudera Manager isn't opening
I have an VM: cloudera-quickstart-vm-5.13.0-0-virtualbox, run now.
But the Cloudera Manager's Page isn't being shown.
The message: 'Attempting to connect to Cloudera Manager...'
is being shown the all ...
0
votes
1
answer
586
views
Download Kafka or confluent platform in package distributed CDH 5.16
I have installed CDH 5.16 Express using packages in a RHEL server. I am trying to install Kafka now and i observed that it can be installed only if CDH is installed as parcels.
1) Is it possible to ...
1
vote
1
answer
945
views
CDH 6.2 - add new host error: dpkg-query: no packages found matching cloudera-manager-agent
I am tring to add a new host.
but it fails with this message at the end "dpkg-query: no packages found matching cloudera-manager-agent"
The following is the "/tmp/scm_prepare_node.vQZe0yDf/...
1
vote
1
answer
125
views
Cloudera Execution Problem: Problem:Initial job has not accepted any resources
I'm trying to fetch some data from Cloudera's Quick Start Hadoop distribution (a Linux VM for us) on our SAP HANA database using SAP Spark Controller. Every time I trigger the job in HANA, it gets ...
2
votes
1
answer
337
views
Cloudera manager not running
I am trying to install Cloudera using below docker image on GCP :
https://www.cloudera.com/documentation/enterprise/5-6-x/topics/quickstart_docker_container.html
Once the process is completed i run ...
1
vote
1
answer
3k
views
cloudera swap space reached to max threshold
I'm getting this alarm on Cloudera, is there any way to increase the swap space capacity?
-2
votes
2
answers
568
views
Cloudera CDH 5.13 - is it possible to run spark 2.x with Yarn mode?
Team,
Installed CDH 5.13 version on my local computer and doing upgrade from spark 1.6 to spark 2.0. is it possible to do run spark application using yarn mode. Please confirm . or it will work as ...
0
votes
1
answer
794
views
hive doesn't support merge function
trying to update the value from table to another table, both of these tables have the same field name but different values, the query must be work fine on any normal DB but here it returns
Error ...