0
点赞
收藏
分享

微信扫一扫

在线安装CM集群

琛彤麻麻 2022-06-20 阅读 78
javaidecloudera虚拟化云计算

​​https://www.cloudera.com/documentation/manager/5-0-x/Cloudera-Manager-Installation-Guide/cm5ig_install_path_B.html​​

前期准备工作不多说了

先给每个节点配置镜像源，我这里以节点2为例

在线安装CM集群_cloudera

 

[cloudera-manager]
# Packages for Cloudera Manager, Version 5, on RedHat or CentOS 6 x86_64                 
name=Cloudera Manager
baseurl=https://archive.cloudera.com/cm5/redhat/6/x86_64/cm/5.13.0/
gpgkey =https://archive.cloudera.com/cm5/redhat/6/x86_64/cm/RPM-GPG-KEY-cloudera    
gpgcheck =1

 

 卸载centos6.5自带的jdk后就安装jdk,也是3个节点都安装

在线安装CM集群_ide_02

 

 在线安装CM集群_ide_03

 

 

 在节点1安装server

sudo yum install cloudera-manager-daemons cloudera-manager-server

在线安装CM集群_ide_04

在线安装CM集群_ide_05

 

 

 在每个节点都安装agent

sudo yum install cloudera-manager-agent cloudera-manager-daemons

在线安装CM集群_java_06

在线安装CM集群_cloudera_07

 

 在每个节点 vim /etc/cloudera-scm-agent/config.ini

在线安装CM集群_ide_08

 

 

下载rpm包到电脑上

在线安装CM集群_cloudera_09

 

 上传到cm1节点

在线安装CM集群_cloudera_10

 

sudo yum --nogpgcheck localinstall cloudera-cdh-5-0.x86_64.rpm

在线安装CM集群_java_11

在线安装CM集群_ide_12

 

 

 在线安装CM集群_ide_13

sudo rpm --import http://archive.cloudera.com/cdh5/redhat/6/x86_64/cdh/RPM-GPG-KEY-cloudera

 

在线安装CM集群_cloudera_14

 

 在线安装CM集群_ide_15

sudo yum install avro-tools crunch flume-ng hadoop-hdfs-fuse hadoop-hdfs-nfs3 hadoop-httpfs 
hbase-solr hive-hbase hive-webhcat hue-beeswax hue-hbase hue-impala hue-pig hue-plugins hue-rdbms 
hue-search hue-spark hue-sqoop hue-zookeeper impala impala-shell kite llama mahout oozie pig pig-udf-datafu search sentry solr-mapreduce spark-python sqoop sqoop2 whirr

 

 

 在线安装CM集群_java_16

 

安装完之后，在cm1节点启动server服务

在线安装CM集群_cloudera_17

 

 在3个节点都启动agent服务

在线安装CM集群_ide_18

 

 在线安装CM集群_cloudera_19

 

 在线安装CM集群_ide_20

 

但是没有能打开

在线安装CM集群_cloudera_21

查看日志

in org.springframework.beans.factory.support.DefaultListableBeanFactory@1fe903d5: defining beans [commandLineConfigurationBean,entityManagerFactoryBean,com.cloudera.server.cmf.TrialState,com.cloudera.server.cmf.TrialManager,com.cloudera.cmf.crypto.LicenseLoader]; root of factory hierarchy
2018-04-11 20:19:50,074 ERROR main:com.cloudera.server.cmf.Main: Server failed.
org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'com.cloudera.server.cmf.TrialState': Cannot resolve reference to bean 'entityManagerFactoryBean' while setting constructor argument; nested exception is org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'entityManagerFactoryBean': FactoryBean threw exception on object creation; nested exception is javax.persistence.PersistenceException: [PersistenceUnit: cmf.server] Unable to build EntityManagerFactory
    at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:328)
    at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveValueIfNecessary(BeanDefinitionValueResolver.java:106)
    at org.springframework.beans.factory.support.ConstructorResolver.resolveConstructorArguments(ConstructorResolver.java:616)
    at org.springframework.beans.factory.support.ConstructorResolver.autowireConstructor(ConstructorResolver.java:148)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.autowireConstructor(AbstractAutowireCapableBeanFactory.java:1003)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBeanInstance(AbstractAutowireCapableBeanFactory.java:907)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.doCreateBean(AbstractAutowireCapableBeanFactory.java:485)
    at org.springframework.beans.factory.support.AbstractAutowireCapableBeanFactory.createBean(AbstractAutowireCapableBeanFactory.java:456)
    at org.springframework.beans.factory.support.AbstractBeanFactory$1.getObject(AbstractBeanFactory.java:293)
    at org.springframework.beans.factory.support.DefaultSingletonBeanRegistry.getSingleton(DefaultSingletonBeanRegistry.java:222)
    at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:290)
    at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:192)
    at org.springframework.beans.factory.support.DefaultListableBeanFactory.preInstantiateSingletons(DefaultListableBeanFactory.java:585)
    at org.springframework.context.support.AbstractApplicationContext.finishBeanFactoryInitialization(AbstractApplicationContext.java:895)
    at org.springframework.context.support.AbstractApplicationContext.refresh(AbstractApplicationContext.java:425)
    at com.cloudera.server.cmf.Main.bootstrapSpringContext(Main.java:392)
    at com.cloudera.server.cmf.Main.<init>(Main.java:242)
    at com.cloudera.server.cmf.Main.main(Main.java:216)
Caused by: org.springframework.beans.factory.BeanCreationException: Error creating bean with name 'entityManagerFactoryBean': FactoryBean threw exception on object creation; nested exception is javax.persistence.PersistenceException: [PersistenceUnit: cmf.server] Unable to build EntityManagerFactory
    at org.springframework.beans.factory.support.FactoryBeanRegistrySupport.doGetObjectFromFactoryBean(FactoryBeanRegistrySupport.java:149)
    at org.springframework.beans.factory.support.FactoryBeanRegistrySupport.getObjectFromFactoryBean(FactoryBeanRegistrySupport.java:102)
    at org.springframework.beans.factory.support.AbstractBeanFactory.getObjectForBeanInstance(AbstractBeanFactory.java:1440)
    at org.springframework.beans.factory.support.AbstractBeanFactory.doGetBean(AbstractBeanFactory.java:247)
    at org.springframework.beans.factory.support.AbstractBeanFactory.getBean(AbstractBeanFactory.java:192)
    at org.springframework.beans.factory.support.BeanDefinitionValueResolver.resolveReference(BeanDefinitionValueResolver.java:322)
    ... 17 more
Caused by: javax.persistence.PersistenceException: [PersistenceUnit: cmf.server] Unable to build EntityManagerFactory
    at org.hibernate.ejb.Ejb3Configuration.buildEntityManagerFactory(Ejb3Configuration.java:924)
    at org.hibernate.ejb.Ejb3Configuration.buildEntityManagerFactory(Ejb3Configuration.java:899)
    at org.hibernate.ejb.HibernatePersistence.createEntityManagerFactory(HibernatePersistence.java:59)
    at javax.persistence.Persistence.createEntityManagerFactory(Persistence.java:63)
    at com.cloudera.enterprise.CommonMain.setupHibernate(CommonMain.java:183)
    at com.cloudera.server.cmf.bootstrap.EntityManagerFactoryBean.getObject(EntityManagerFactoryBean.java:114)
    at com.cloudera.server.cmf.bootstrap.EntityManagerFactoryBean.getObject(EntityManagerFactoryBean.java:65)
    at org.springframework.beans.factory.support.FactoryBeanRegistrySupport.doGetObjectFromFactoryBean(FactoryBeanRegistrySupport.java:142)
    ... 22 more
Caused by: org.hibernate.service.classloading.spi.ClassLoadingException: HHH010003: JDBC Driver class not found: com.mysql.jdbc.Driver
    at org.hibernate.service.jdbc.connections.internal.C3P0ConnectionProvider.configure(C3P0ConnectionProvider.java:142)
    at org.hibernate.service.internal.StandardServiceRegistryImpl.configureService(StandardServiceRegistryImpl.java:75)
    at org.hibernate.service.internal.AbstractServiceRegistryImpl.initializeService(AbstractServiceRegistryImpl.java:159)
    at org.hibernate.service.internal.AbstractServiceRegistryImpl.getService(AbstractServiceRegistryImpl.java:131)
    at org.hibernate.engine.jdbc.internal.JdbcServicesImpl.buildJdbcConnectionAccess(JdbcServicesImpl.java:223)
    at org.hibernate.engine.jdbc.internal.JdbcServicesImpl.configure(JdbcServicesImpl.java:89)
    at org.hibernate.service.internal.StandardServiceRegistryImpl.configureService(StandardServiceRegistryImpl.java:75)
    at org.hibernate.service.internal.AbstractServiceRegistryImpl.initializeService(AbstractServiceRegistryImpl.java:159)
    at org.hibernate.service.internal.AbstractServiceRegistryImpl.getService(AbstractServiceRegistryImpl.java:131)
    at org.hibernate.cfg.Configuration.buildTypeRegistrations(Configuration.java:1797)
    at org.hibernate.cfg.Configuration.buildSessionFactory(Configuration.java:1755)
    at org.hibernate.ejb.EntityManagerFactoryImpl.<init>(EntityManagerFactoryImpl.java:96)
    at org.hibernate.ejb.Ejb3Configuration.buildEntityManagerFactory(Ejb3Configuration.java:914)
    ... 29 more
Caused by: org.hibernate.service.classloading.spi.ClassLoadingException: Unable to load class [com.mysql.jdbc.Driver]
    at org.hibernate.service.classloading.internal.ClassLoaderServiceImpl.classForName(ClassLoaderServiceImpl.java:149)
    at org.hibernate.service.jdbc.connections.internal.C3P0ConnectionProvider.configure(C3P0ConnectionProvider.java:139)
    ... 41 more
Caused by: java.lang.ClassNotFoundException: Could not load requested class : com.mysql.jdbc.Driver
    at org.hibernate.service.classloading.internal.ClassLoaderServiceImpl$AggregatedClassLoader.findClass(ClassLoaderServiceImpl.java:296)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Class.java:247)
    at org.hibernate.service.classloading.internal.ClassLoaderServiceImpl.classForName(ClassLoaderServiceImpl.java:146)
    ... 42 more
[root@cm1 cloudera-scm-server]# pwd
/var/log/cloudera-scm-server
[root@cm1 cloudera-scm-server]# cat cloudera-scm-server.log

 

 

没有安装数据库的驱动

sudo yum install mysql-server

在线安装CM集群_cloudera_22

在线安装CM集群_ide_23

 在线安装CM集群_ide_24

 

 在线安装CM集群_cloudera_25

 在线安装CM集群_ide_26

 

 我们登录进mysql

create database amon DEFAULT CHARACTER SET utf8;
grant all on amon.* TO 'amon'@'%' IDENTIFIED BY 'amon_password';
grant all on *.* TO 'amon'@'cm1' IDENTIFIED BY 'amon_password';
grant all on amon.* TO 'amon'@'localhost' IDENTIFIED BY 'amon_password';


create database rman DEFAULT CHARACTER SET utf8;
grant all on rman.* TO 'rman'@'%' IDENTIFIED BY 'rman_password';
grant all on *.* TO 'rman'@'cm1' IDENTIFIED BY 'rman_password';
grant all on rman.* TO 'rman'@'localhost' IDENTIFIED BY 'rman_password';

create database nav DEFAULT CHARACTER SET utf8;
grant all on nav.* TO 'nav'@'%' IDENTIFIED BY 'nav_password';
grant all on *.* TO 'nav'@'cm1' IDENTIFIED BY 'nav_password';
grant all on nav.* TO 'nav'@'localhost' IDENTIFIED BY 'nav_password';

create database hive DEFAULT CHARACTER SET utf8;
grant all on hive.* TO 'hive'@'%' IDENTIFIED BY 'hive_password';
grant all on *.* TO 'hive'@'cm1' IDENTIFIED BY 'hive_password';
grant all on hive.* TO 'hive'@'localhost' IDENTIFIED BY 'hive_password';

create database scm DEFAULT CHARACTER SET utf8;
grant all on scm.* TO 'scm'@'%' IDENTIFIED BY 'scm_password';
grant all on *.* TO 'scm'@'cm1' IDENTIFIED BY 'scm_password';
grant all on scm.* TO 'scm'@'localhost' IDENTIFIED BY 'scm_password';

 

create database oozie DEFAULT CHARACTER SET utf8;
grant all on oozie.* TO 'oozie'@'localhost' IDENTIFIED BY 'oozie_password';
grant all on *.* TO 'oozie'@'cm1' IDENTIFIED BY 'oozie_password';
grant all on oozie.* TO 'oozie'@'%' IDENTIFIED BY 'oozie_password';

create database hue DEFAULT CHARACTER SET utf8;
grant all on hue.* TO 'hue'@'localhost' IDENTIFIED BY 'hue_password';
grant all on *.* TO 'hue'@'cm1' IDENTIFIED BY 'hue_password';
grant all on hue.* TO 'hue'@'%' IDENTIFIED BY 'hue_password';
flush privileges;

flush privileges;

 

在线安装CM集群_cloudera_27

mysql> create database amon DEFAULT CHARACTER SET utf8;
Query OK, 1 row affected (0.00 sec)

mysql> grant all on amon.* TO 'amon'@'%' IDENTIFIED BY 'amon_password';
Query OK, 0 rows affected (0.00 sec)

mysql> grant all on *.* TO 'amon'@'cm1' IDENTIFIED BY 'amon_password';
Query OK, 0 rows affected (0.00 sec)

mysql> grant all on amon.* TO 'amon'@'localhost' IDENTIFIED BY 'amon_password';
Query OK, 0 rows affected (0.00 sec)

mysql> create database rman DEFAULT CHARACTER SET utf8;
Query OK, 1 row affected (0.00 sec)

mysql> grant all on rman.* TO 'rman'@'%' IDENTIFIED BY 'rman_password';
Query OK, 0 rows affected (0.00 sec)

mysql> grant all on *.* TO 'rman'@'cm1' IDENTIFIED BY 'rman_password';
Query OK, 0 rows affected (0.00 sec)

mysql> grant all on rman.* TO 'rman'@'localhost' IDENTIFIED BY 'rman_password';
Query OK, 0 rows affected (0.00 sec)

mysql> create database nav DEFAULT CHARACTER SET utf8;
Query OK, 1 row affected (0.00 sec)

mysql> grant all on nav.* TO 'nav'@'%' IDENTIFIED BY 'nav_password';
Query OK, 0 rows affected (0.00 sec)

mysql> grant all on *.* TO 'nav'@'cm1' IDENTIFIED BY 'nav_password';
Query OK, 0 rows affected (0.00 sec)

mysql> grant all on nav.* TO 'nav'@'localhost' IDENTIFIED BY 'nav_password';
Query OK, 0 rows affected (0.00 sec)

mysql> create database metastore DEFAULT CHARACTER SET utf8;
Query OK, 1 row affected (0.00 sec)

mysql> grant all on hive.* TO 'hive'@'%' IDENTIFIED BY 'hive_password';
Query OK, 0 rows affected (0.00 sec)

mysql> grant all on *.* TO 'hive'@'cm1' IDENTIFIED BY 'hive_password';
Query OK, 0 rows affected (0.00 sec)

mysql> grant all on *.* TO 'hive'@'cm1' IDENTIFIED BY 'hive_password';
Query OK, 0 rows affected (0.00 sec)

mysql>flush privileges;

 

 在节点1执行

sudo /usr/share/cmf/schema/scm_prepare_database.sh mysql scm scm scm_password

 

把服务重启一下server (节点1)  agent（3个节点）

 

打开这个地址http://192.168.86.141:7180/

 在线安装CM集群_java_28

 

 在线安装CM集群_ide_29

 

在线安装CM集群_java_30

 

 

 在线安装CM集群_ide_31

在线安装CM集群_java_32

在线安装CM集群_ide_33

 

 在线安装CM集群_ide_34

 

 

在线安装CM集群_cloudera_35

 

 

 在线安装CM集群_java_36

 

 

 在线安装CM集群_java_37

 

 在线安装CM集群_cloudera_38

 

 

 在线安装CM集群_ide_39

 

 

下一步如果安装失败了

而且出现这情况

在线安装CM集群_java_40

 

 就这样解决

在线安装CM集群_java_41

 

 如果是出现cloudemanager安装时出现8475 MainThread agent ERROR Heartbeating to 出门cm1:7180 failed这样的问题

 就这样解决

在线安装CM集群_java_42

 

 

在线安装CM集群_java_43

 

 在线安装CM集群_ide_44

 

 

在线安装CM集群_ide_45

在线安装CM集群_ide_46

 

 

在线安装CM集群_java_47

 

 遇到这情况就重新运行一下

在线安装CM集群_ide_48

 

 在线安装CM集群_java_49

 

用find / -name cm_guid查找 cm_guid文件

然后把他删除了（3个节点都这样）

 

 

 

 

遇到这种问题

 在线安装CM集群_cloudera_50

 在线安装CM集群_java_51

在线安装CM集群_cloudera_52

 

查看agent日志

在线安装CM集群_ide_53

 

 Failed to connect to previous supervisor在线安装CM集群_java_54

 

举报

相关推荐

openGauss多主机主备集群安装及CM体验

centos华为数据库openGaussCM数据库

大数据技术之CM安装

clouderahadoopmysqlHadoop大数据

kubeasz在线安装K8S集群单master集群（kubeasz安装之二）

docker架构eureka

k8s多master集群在线安装

dockerkubernetes

CM部署CDH安装组件到scm时报错： Cause:Table ‘scm.CM_VERSION‘ doesn‘t exist

hivemysql数据库hadoop

熟能生巧丨MogDB数据库 CM VIP两节点集群升级

数据库MogDB云和恩墨Oracle

大数据物流项目中CM的安装与运用

big data分布式hadoop大数据cloudera系统/运维

在线安装docker

docker镜像源重启Linux系统/运维

Terminal capability "cm" required

环境变量配置文件双引号Linux系统/运维yyds干货盘点

CDH集群升级JDK8后CM服务的JDK版本指定分析

javacloudera启动脚本虚拟化云计算
0 条评论