Skip to main content
Planned maintenance impacting Stack Overflow and all Stack Exchange sites is scheduled for Monday, September 16, 2024, 5:00 PM-10:00 PM EDT (Monday, September 16, 21:00 UTC- Tuesday, September 17, 2:00 UTC). The email/password authentication method will be unavailable for logging in and registering. Read more here
Filter by
Sorted by
Tagged with
0 votes
0 answers
99 views

Cloudera Enterprise (Community Edition) for RHEL 8

We are running a mini DWH platform with Cloudera Enterprise community version. Underlying Operating system is RHEL7 Version: Cloudera Express 6.0.1 (#610811 built by jenkins on 20181002-0044 git: ...
Ashu Rawat's user avatar
0 votes
1 answer
263 views

monitoring and observability over my Hadoop cluster

I'm trying to create a monitoring and observability infrastructure over my Hadoop cluster. my cluster is managed via cloudera manager, because of that I have some questions that maybe some of you ...
Liran Eliyahu's user avatar
1 vote
0 answers
34 views

Failed to configure cloudera manager agent

Hi I am new to bigdata and I am installing cloudera manager 7.4.4 on RHEL 8.0. While setting up the cluster I am facing the error like "failed to configure clouder manager agent" Can anyone ...
Arjun AM's user avatar
0 votes
0 answers
133 views

Guava jar giving continuous error while deployment

We are using guava-15.0.jar as part of cloudera-manager-api dependency version 6.3.0 in build.gradle file of cloudera-manager client module. Gradle-file But while deploying it is giving the below ...
Jessica Jindal's user avatar
1 vote
0 answers
333 views

Unable to Download Cloudera and CDH Repository

I am trying to download CM5 and CDH repository from "http://archive.cloudera.com/" but it is asking for credential. I have created my account in Cloudera site but that credential is not ...
Shobhit's user avatar
  • 13
1 vote
2 answers
524 views

How to do YARN role graceful shutdown on a Cloudera Manager datanode CDH 6.3.2

Can not find answer on this question. How to gracefully stop YARN role on a data node and wait till all running jobs on a datanode will finish with status success. I know that in ClouderaManager you ...
user2784340's user avatar
-1 votes
1 answer
44 views

cloudera - how to allocate resources for different users

I am using cloudera 6.3 and trying to achieve following things. all the users who are running interactive queries should not get more than 20% of resources Functional id which is used for getting ...
Gaurang Shah's user avatar
  • 12.7k
0 votes
1 answer
163 views

How to disable cloudera parcels from automatically distributing to all hosts or is there a way to setup a repo for all hosts?

I'm using Cloudera Manager 6.3.1 and have noticed that when I download parcels, they are automatically distributed to all hosts even though I do not need them in some all hosts. So, the question is, ...
Alexander Gnu's user avatar
0 votes
1 answer
43 views

Adding new service type in Cloudera Manager

I'm following official docs to add service to a cluster in Cloudera Manager. However it's custom service developed in-house and there's no service type shown. How to add new service type in Cloudera ...
rokpoto.com's user avatar
  • 10.5k
0 votes
1 answer
443 views

Cloudera CDP Private Cloud - Installation failed on hosts

I get an installation failed on hosts error while usng Cloudera Manager to install CDP 7.1.4 runtime on a trial basis. For this purpose I have spun up two VMs( Ubuntu 18), which use a NatNetwork to ...
Aleksandar Milosevic's user avatar
1 vote
0 answers
2k views

How to get query id for impala queries executed via sqlalchemy

I am querying impala using sqlalchemy which internally uses impyla. from sqlalchemy import create_engine from sqlalchemy.orm import sessionmaker engine = create_engine("impala://{host}:{port}/{...
Sandeep Roy's user avatar
0 votes
1 answer
163 views

How to set Data Granularity with cm_api api.query_timeseries

I am trying to get files_total and dfs_capacity_used metrics for last 1 week with code shared in https://cloudera.github.io/cm_api/docs/python-client/ import time import datetime from_time = datetime....
Nirmal Ram's user avatar
  • 1,190
1 vote
1 answer
234 views

Errno 14 PYCURL ERROR 6 ; Couldn't resolve host in Cloudera Manager 7.x upgrade

I am doing an upgrade from Cloudera CM 5.16 to CM 7.1.2. There is an instruction to enter userid:password in the url in the /etc/yum.repos.d/cloudera-manager.repo file when using the Cloudera public ...
ebeb's user avatar
  • 499
0 votes
1 answer
984 views

What's the latest version of Cloudera Manager and CDH?

I'm currently running on cloudera Manager 5.14.3 and CDH 5.14.2 and want to upgrade to a higher and more stable version. Which version is the most stable and advisable to upgrade to? Version 6 or ...
Oye's user avatar
  • 67
1 vote
0 answers
762 views

Not able to run scm_prepare_database.sh script

I am installing Cloudera Manager and CDH 6.3.x and I'm using PostgreSQL for the Cloudera Manager Server and other services that use databases. I'm using a RHEL 7.4 Azure VM and following the official ...
Tanishq Singh's user avatar
0 votes
1 answer
84 views

Configuration file for Cloudera Management Service

Is the a configuration file for Cloudera Management Service? I'd like to have the service roles' configuration stored in repository. This way, service configuration can be shared between environments ...
rokpoto.com's user avatar
  • 10.5k
0 votes
1 answer
597 views

Cloudera namenode web UI is not launching

I recently installed the CDH distribution of Cloudera 6.1 to create a two node cluster. From the Cloudera Manager UI, all services are running fine. However the namenode (and datanode) web UI alone is ...
ursd's user avatar
  • 45
1 vote
0 answers
284 views

Does "YARN Container increment in size due to round up" add up to spark overhead memory or spark executor memory?

Based on my understanding, when YARN allocates containers based on spark configuration ask, YARN automatically rounds up the container size in multiples of 'yarn.scheduler.minimum-allocation-mb'. For ...
Naresh Krishnamoorthy's user avatar
2 votes
2 answers
2k views

Not able to download Cloudera

I am trying to find a link to download cloudera zip file on VMWare , but unable to get any. Tried searching on google , on cloudera website , but in vain. Can somebody share some views on it.
Manoj's user avatar
  • 21
5 votes
2 answers
2k views

Is there any alternative for Cloudera Manager? (CDH) [closed]

As Cloudera official blog said, there is no free version of CDH from 6.3.3, they would make the Cloudera Manager to open source, but not yet. Is there any other project like Cloudera Manager? which ...
York Huang's user avatar
0 votes
1 answer
1k views

Cloudera manager agent fails to install - nothing provides MySQL-python, python, python-psycopg2 needed by cloudera-manager-agent

Hello, I have a CentOS-8 linux cluster and I am trying to install Cloudera 6.2.1 on it. As you can see in the attached picture is failing on cloudera-manager-agent installation due to 3 conflicting ...
Alin 's user avatar
  • 21
1 vote
0 answers
107 views

Is there a way to clone services configurations in a cluster?

I need to clone services configuration (hue, spark, etc.) from a cluster to another one. Both of cluster are managed by Cloudera Manager (i need to clone cloudera manager configuration too).
C1ngh10's user avatar
  • 13
1 vote
0 answers
535 views

Zookeeper Maximum Latency Monitoring Thresholds

A red-flagged error message appeared suddenly in the Zookeeper section of my Cloudera Manager Interface "Bad: Maximum request latency: 102,477 ms. Maximum client-negotiable session timeout: 50,000 ms....
Bilal's user avatar
  • 122
0 votes
1 answer
37 views

Cloudera Metric Template Location or Create Custom

I am trying to create custom metric template to reflect on chart builder. Also i need to know the configuration files where i can make changes for metrics. Is this possible or Cloudera metric ...
Faraz Ahmed's user avatar
3 votes
0 answers
528 views

Cannot monitor impala queries on Cloudera Manager

I got installed a new cloudera cluster with versions CM-6.3.1 and CDH-6.3.2 and now facing a problem never had with previous cloudera distributions, Cloudera Management Services (including Cloudera ...
belce's user avatar
  • 223
0 votes
1 answer
1k views

yarn application accepted but not running cloudera despite resource allocation

I am using a Cloudera quickstart VM 5.13.0.0 to run Spark applications in yarn-client mode. I have allocated 10GB and 3 cores to my Cloudera VM. When I submit the application, the application is ...
Sheel Pancholi's user avatar
0 votes
2 answers
2k views

How to set JAVA_HOME Cloudera quickstart for Kafka and Zookeeper

I have added Kafka service to my Cloudera cluster and when i try to start it it fails with the following error Exception in thread "main" java.lang.UnsupportedClassVersionError: org/apache/kafka/...
Justin Syrus's user avatar
1 vote
0 answers
42 views

Cloudera Manager Metric - Login Failure metric

I am trying to create a dashboard in Cloudera Manager using Chart Builder. I want to show metrics related to Login Failure rate (login_failure_rate). However, it doesn't reflect the actual status. Is ...
Faraz Ahmed's user avatar
0 votes
1 answer
82 views

Connecting Cloudera Manager (6.3) to Oracle ATP on OCI using an Oracle Wallet

I am trying to set up a Cloudera Cluster (Cloudera 6.3) on OCI and want to use an ATP (also running on OCI) as the DB for the Cloudera Manager (I am using these docs). In order to connect to the ATP ...
Nilo's user avatar
  • 1
2 votes
2 answers
717 views

what is the difference between fsimage and snapshot in hadoop?

I am new to hadoop. I want to know the difference between snapshot and fsimage used for file system state in hadoop. I heard that both do the same work. then what makes the difference between them?
Pavan Sai Aravala's user avatar
1 vote
0 answers
93 views

Access granted to groups and roles in Hue has no effect

When I give Grant to groups and roles in hue, nothing happens to the groups and no access is applied! CREATE ROLE admin_role GRANT ALL ON SERVER server1 TO ROLE admin_role GRANT ROLE admin_role TO ...
Arta Yaqin's user avatar
1 vote
1 answer
221 views

Zookeeper fails to start after Native Library and Intel MKL Parcel Activation in CDH 6.0.0

I have 7 Node cluster managed by Cloudera Manager and CDH 6.0.0. I am trying to run matrix multiplication in Spark using a native library which uses BLAS. That is why I have downloaded parcels 1. ...
Chandan's user avatar
  • 764
0 votes
1 answer
1k views

Cloudera Manager - Service Monitor is not running

It seems there is something wrong with connection issues.But I don't know what lead to this problem.Could anyone help me?What connection issue am I facing? (9 skipped) Error sending messages to ...
Shengxin Huang's user avatar
0 votes
1 answer
309 views

Spark - Worker doesn't have sufficient resource

I am new to Apache Spark and Cloudera Manager.I met some problem running my first spark application. There are two Virtual Machines in my cluster with RAM and Cores: 13.4G /4 Cores as Master Node ,...
Shengxin Huang's user avatar
0 votes
1 answer
702 views

How to detect in Hadoop cluster if any Datanode drive (Storage) failed

I am trying to detect the drive failure in Datanode in a Hadoop Cluster. Cloudera Manager API don't have any specific API for that. CM API are only related to Name node or restart services. Are there ...
Dine the learner's user avatar
0 votes
0 answers
262 views

How to set LIVY_CONF_DIR in cloudera

I have installed livy server in cloudera in /usr/share. I want to change set the LIVY_CONF_DIR so that i can manage the config files like log4j.properties. Cloudera says this is possible but i could ...
Rakesh Bharadwaj's user avatar
0 votes
0 answers
1k views

FAILED: Execution Error, return code -101 from org.apache.hadoop.hive.ql.exec.mr.MapRedTask. com/yammer/metrics/core/MetricsRegistry

We facing some issue in beeline while we connecting via beeline to hbase table. We have two hiveserver2, one of the node we got this error like: INFO : Query ID = hive_20190719154444_babd2ce5-4d41-...
Praveen Prakasan's user avatar
0 votes
0 answers
53 views

Hue not starting after cloudera installation

After installation of Cloudera 5.16, I started Hue service but it fails to start. The error is shown in the screenshot. Any suggestions are welcome.
Prashant's user avatar
  • 762
1 vote
0 answers
614 views

The user hdfs is missing in its own group

I recently installed Cloudera and after doing installation, I ran the host inspector. But I saw some messages in it (screenshot attached). Please let me know how to get rid of them. Also, is the ...
Prashant's user avatar
  • 762
0 votes
1 answer
729 views

How to stop a 'hive on spark' job after execute a hivesql in hue query

I'm using Cloudera Manager 6.1.1 and HUE. My hive engine is spark. When I execute a hivesql in hue query, there always will start a hive on spark job, and it won't stop.
A.Swayer's user avatar
0 votes
2 answers
31 views

How to install CM over an existing non CDH Cluster

Is it possible to install CM over an existing non CDH cluster? For example, I have manually installed Hadoop and other services to my VMs. Can I install CM and force it to manage my cluster?
Markiza's user avatar
  • 444
1 vote
2 answers
6k views

Beeline - No current connection - Default hs2 connection config nout found

We are facing an issue with respect to beeline CLI in one of our cloudera cluster. We are trying to connect and execute hql files which are alter statements using beeline CLI as like below and it is ...
Basavaraju B K's user avatar
1 vote
1 answer
2k views

Cloudera Manager isn't opening

I have an VM: cloudera-quickstart-vm-5.13.0-0-virtualbox, run now. But the Cloudera Manager's Page isn't being shown. The message: 'Attempting to connect to Cloudera Manager...' is being shown the all ...
user avatar
0 votes
1 answer
586 views

Download Kafka or confluent platform in package distributed CDH 5.16

I have installed CDH 5.16 Express using packages in a RHEL server. I am trying to install Kafka now and i observed that it can be installed only if CDH is installed as parcels. 1) Is it possible to ...
Vaishak's user avatar
  • 617
1 vote
1 answer
945 views

CDH 6.2 - add new host error: dpkg-query: no packages found matching cloudera-manager-agent

I am tring to add a new host. but it fails with this message at the end "dpkg-query: no packages found matching cloudera-manager-agent" The following is the "/tmp/scm_prepare_node.vQZe0yDf/...
Anis's user avatar
  • 51
1 vote
1 answer
125 views

Cloudera Execution Problem: Problem:Initial job has not accepted any resources

I'm trying to fetch some data from Cloudera's Quick Start Hadoop distribution (a Linux VM for us) on our SAP HANA database using SAP Spark Controller. Every time I trigger the job in HANA, it gets ...
ribarcheto94's user avatar
2 votes
1 answer
337 views

Cloudera manager not running

I am trying to install Cloudera using below docker image on GCP : https://www.cloudera.com/documentation/enterprise/5-6-x/topics/quickstart_docker_container.html Once the process is completed i run ...
kushagra mittal's user avatar
1 vote
1 answer
3k views

cloudera swap space reached to max threshold

I'm getting this alarm on Cloudera, is there any way to increase the swap space capacity?
Mahmoud Odeh's user avatar
-2 votes
2 answers
568 views

Cloudera CDH 5.13 - is it possible to run spark 2.x with Yarn mode?

Team, Installed CDH 5.13 version on my local computer and doing upgrade from spark 1.6 to spark 2.0. is it possible to do run spark application using yarn mode. Please confirm . or it will work as ...
Learn Hadoop's user avatar
  • 2,942
0 votes
1 answer
794 views

hive doesn't support merge function

trying to update the value from table to another table, both of these tables have the same field name but different values, the query must be work fine on any normal DB but here it returns Error ...
Nikolan Asad's user avatar

1
2 3 4 5
8