Azkaban是什么?（一）
Hadoop工作流引擎之Azkaban与Oozie对比（四）
不多说，直接上干货！
http://www.cnblogs.com/zlslch/category/938837.html
准备这四个
Azkaban 2.5安装
系统时区设置
安装和配置mysql
Azkaban Web Server 安装
Azkaban Executor Server安装
启动验证
Azkaban web server插件安装
Azkaban Executor Server 插件安装
一、系统时区配置
1.查看时区
[hadoop@master azkaban-web-2.5.]$ more /etc/sysconfig/clock
ZONE="Asia/Shanghai"
UTC=true
ARC=false
[hadoop@master ~]$ more /etc/sysconfig/clock
# The time zone of the system is defined by the contents of /etc/localtime.
# This file is only for evaluation by system-config-date, do not rely on its
# contents elsewhere.
ZONE="Asia/Shanghai"
[hadoop@master ~]$ su root
Password:
[root@master hadoop]# vim /etc/sysconfig/clock
[root@master hadoop]# more /etc/sysconfig/clock
# The time zone of the system is defined by the contents of /etc/localtime.
# This file is only for evaluation by system-config-date, do not rely on its
# contents elsewhere.
ZONE="Asia/Shanghai"
UTC=true
ARC=false
[root@master hadoop]#
2.修改时区
时区文件都在/usr/share/zoneinfo，复制相应时区覆盖/etc/localtime即可
[hadoop@master ~]$ ll /usr/share/zoneinfo
cp /usr/share/zoneinfo/Asia/Shanghai /etc/localtime
修改web server 和excutor server 都需要配置时区，必须和系统时区一致（注意，这一步可以到最后才来修改）
default.timezone.id=Asia/Shanghai
安装mysql
这个很简单。不多赘述，大家可以去看我的博客
Hive环境的安装部署（完美安装）（集群内或集群外都适用）（含卸载自带mysql安装指定版本）
[hadoop@master app]$ pwd
/home/hadoop/app
[hadoop@master app]$ ll
total
drwxrwxr-x hadoop hadoop Apr : elasticsearch-2.4.
drwxrwxr-x hadoop hadoop Apr : elasticsearch-2.4.
lrwxrwxrwx hadoop hadoop Apr : es -> elasticsearch-2.4./
lrwxrwxrwx hadoop hadoop Apr : flume -> flume-1.6.
drwxrwxr-x hadoop hadoop Apr : flume-1.6.
drwxrwxr-x hadoop hadoop Apr : flume-1.7.
lrwxrwxrwx. hadoop hadoop Apr : hadoop -> hadoop-2.6.
drwxr-xr-x. hadoop hadoop Apr : hadoop-2.6.
lrwxrwxrwx. hadoop hadoop Apr : hbase -> hbase-0.98.
drwxrwxr-x. hadoop hadoop Apr : hbase-0.98.
lrwxrwxrwx. hadoop hadoop Apr : hive -> hive-1.0.
drwxrwxr-x. hadoop hadoop Apr : hive-1.0.
lrwxrwxrwx. hadoop hadoop Apr : jdk -> jdk1..0_79
drwxr-xr-x. hadoop hadoop Apr jdk1..0_79
drwxr-xr-x. hadoop hadoop Aug jdk1..0_60
lrwxrwxrwx hadoop hadoop Apr : kibana -> kibana-4.6.-linux-x86_64/
drwxrwxr-x hadoop hadoop Nov : kibana-4.6.-linux-x86_64
lrwxrwxrwx. hadoop hadoop Apr : sqoop -> sqoop-1.4.
drwxr-xr-x. hadoop hadoop Apr sqoop-1.4.
lrwxrwxrwx. hadoop hadoop Apr : zookeeper -> zookeeper-3.4.
drwxr-xr-x. hadoop hadoop Apr : zookeeper-3.4.
[hadoop@master app]$ mkdir azkaban
[hadoop@master app]$ ll
total
drwxrwxr-x hadoop hadoop May : azkaban
drwxrwxr-x hadoop hadoop Apr : elasticsearch-2.4.
drwxrwxr-x hadoop hadoop Apr : elasticsearch-2.4.
lrwxrwxrwx hadoop hadoop Apr : es -> elasticsearch-2.4./
lrwxrwxrwx hadoop hadoop Apr : flume -> flume-1.6.
drwxrwxr-x hadoop hadoop Apr : flume-1.6.
drwxrwxr-x hadoop hadoop Apr : flume-1.7.
lrwxrwxrwx. hadoop hadoop Apr : hadoop -> hadoop-2.6.
drwxr-xr-x. hadoop hadoop Apr : hadoop-2.6.
lrwxrwxrwx. hadoop hadoop Apr : hbase -> hbase-0.98.
drwxrwxr-x. hadoop hadoop Apr : hbase-0.98.
lrwxrwxrwx. hadoop hadoop Apr : hive -> hive-1.0.
drwxrwxr-x. hadoop hadoop Apr : hive-1.0.
lrwxrwxrwx. hadoop hadoop Apr : jdk -> jdk1..0_79
drwxr-xr-x. hadoop hadoop Apr jdk1..0_79
drwxr-xr-x. hadoop hadoop Aug jdk1..0_60
lrwxrwxrwx hadoop hadoop Apr : kibana -> kibana-4.6.-linux-x86_64/
drwxrwxr-x hadoop hadoop Nov : kibana-4.6.-linux-x86_64
lrwxrwxrwx. hadoop hadoop Apr : sqoop -> sqoop-1.4.
drwxr-xr-x. hadoop hadoop Apr sqoop-1.4.
lrwxrwxrwx. hadoop hadoop Apr : zookeeper -> zookeeper-3.4.
drwxr-xr-x. hadoop hadoop Apr : zookeeper-3.4.
[hadoop@master app]$
二、配置mysql
下载mysql数据脚本
wget https://s3.amazonaws.com/azkaban2/azkaban2/2.5.0/azkaban-sql-script-2.5.0.tar.gz
tar -zxvf azkaban-sql-script-2.5.0.tar.gz –C ~/app/azkaban/
我下载的是离线，待会上传。
[hadoop@master azkaban]$ pwd
/home/hadoop/app/azkaban
[hadoop@master azkaban]$ ll
total
[hadoop@master azkaban]$ rz [hadoop@master azkaban]$ ll
total
-rw-r--r-- hadoop hadoop May : azkaban-sql-script-2.5..tar.gz
[hadoop@master azkaban]$
[hadoop@master azkaban]$ pwd
/home/hadoop/app/azkaban
[hadoop@master azkaban]$ ll
total
-rw-r--r-- hadoop hadoop May : azkaban-sql-script-2.5..tar.gz
[hadoop@master azkaban]$ tar -zxvf azkaban-sql-script-2.5..tar.gz
[hadoop@master azkaban]$ ll
total
drwxrwxr-x hadoop hadoop May : azkaban-2.5.
-rw-r--r-- hadoop hadoop May : azkaban-sql-script-2.5..tar.gz
[hadoop@master azkaban]$ rm azkaban-sql-script-2.5..tar.gz
[hadoop@master azkaban]$ ll
total
drwxrwxr-x hadoop hadoop May : azkaban-2.5.
[hadoop@master azkaban]$
创建用户、分配权限并执行脚本
mysql –uroot –pxxxx
创建数据库: CREATE DATABASE azkaban;
创建用户名：CREATE USER 'azkaban'@'%' IDENTIFIED BY 'azkaban'
分配权限：GRANT SELECT,INSERT,UPDATE,DELETE,CREATE,INDEX ON `azkaban`.* TO 'azkaban'@'%' WITH GRANT OPTION;
flush privileges；
quit;
通过azkaban账号登录mysql：mysql –uazkaban –pazkaban
Use azkaban;
source ~/azkaban/azkaban-2.5./create-all-sql-2.5..sql
先开启mysql服务进程
[root@master azkaban]# service mysqld start
Starting mysqld: [ OK ]
[root@master azkaban]# su hadoop
[hadoop@master azkaban]$
[hadoop@master azkaban]$ mysql -uroot -prootroot
Welcome to the MySQL monitor. Commands end with ; or \g.
Your MySQL connection id is
Server version: 5.1. Source distribution Copyright (c) , , Oracle and/or its affiliates. All rights reserved. Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners. Type 'help;' or '\h' for help. Type '\c' to clear the current input statement. mysql> CREATE DATABASE azkaban;
Query OK, row affected (0.00 sec) mysql> CREATE USER 'azkaban'@'%' IDENTIFIED BY 'azkaban';
Query OK, rows affected (0.00 sec) mysql> GRANT SELECT,INSERT,UPDATE,DELETE,CREATE,INDEX ON 'azkaban'.* TO 'azkaban'@'%' WITH GRANT OPTION;
ERROR (): You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ''azkaban'.* TO 'azkaban'@'%' WITH GRANT OPTION' at line
mysql> GRANT SELECT,INSERT,UPDATE,DELETE,CREATE,INDEX ON `azkaban`.* TO 'azkaban'@'%' WITH GRANT OPTION;
Query OK, rows affected (0.00 sec) mysql> flush privileges;
Query OK, rows affected (0.00 sec) mysql> quit;
Bye
[hadoop@master azkaban]$
通过azkaban账号登录mysql
mysql –uazkaban –pazkaban
use azkaban;
source ~/app/azkaban/azkaban-2.5./create-all-sql-2.5..sql
则，再次执行
[hadoop@master azkaban]$ mysql -uazkaban -pazkaban
ERROR (): Access denied for user 'azkaban'@'localhost' (using password: YES)
[hadoop@master azkaban]$ mysql -uroot -prootroot
Welcome to the MySQL monitor. Commands end with ; or \g.
Your MySQL connection id is
Server version: 5.1. Source distribution Copyright (c) , , Oracle and/or its affiliates. All rights reserved. Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners. Type 'help;' or '\h' for help. Type '\c' to clear the current input statement. mysql> GRANT ALL PRIVILEGES ON *.* to 'azkaban'@'%' IDENTIFIED BY 'azkaban' WITH GRANT OPTION;
Query OK, rows affected (0.00 sec) mysql> GRANT ALL PRIVILEGES ON *.* to 'azkaban'@'master' IDENTIFIED BY 'azkaban' WITH GRANT OPTION;
Query OK, rows affected (0.00 sec) mysql> GRANT ALL PRIVILEGES ON *.* to 'azkaban'@'localhost' IDENTIFIED BY 'azkaban' WITH GRANT OPTION;
Query OK, rows affected (0.00 sec) mysql> flush privileges;
Query OK, rows affected (0.00 sec) mysql> select user,host,password from mysql.user;
+---------+-----------+-------------------------------------------+
| user | host | password |
+---------+-----------+-------------------------------------------+
| root | localhost | *6C362347EBEAA7DF44F6D34884615A35095E80EB |
| root | master | |
| root | 127.0.0.1 | |
| | localhost | |
| | master | |
| hive | % | *4DF1D66463C18D44E3B001A8FB1BBFBEA13E27FC |
| hive | master | *4DF1D66463C18D44E3B001A8FB1BBFBEA13E27FC |
| hive | localhost | *4DF1D66463C18D44E3B001A8FB1BBFBEA13E27FC |
| azkaban | % | *8E02B7AE57F9A19E165EB45CD3F705BF66985B85 |
| azkaban | master | *8E02B7AE57F9A19E165EB45CD3F705BF66985B85 |
| azkaban | localhost | *8E02B7AE57F9A19E165EB45CD3F705BF66985B85 |
+---------+-----------+-------------------------------------------+
rows in set (0.01 sec) mysql> exit;
Bye
[hadoop@master azkaban]$
然后，此刻就可以通过azkaban账号登录mysql了。
mysql –uazkaban –pazkaban
use azkaban;
source ~/app/azkaban/azkaban-2.5./create-all-sql-2.5..sql
因为，
[hadoop@master azkaban]$ pwd
/home/hadoop/app/azkaban
[hadoop@master azkaban]$ ll
total
drwxrwxr-x hadoop hadoop May : azkaban-2.5.
[hadoop@master azkaban]$ cd azkaban-2.5./
[hadoop@master azkaban-2.5.]$ pwd
/home/hadoop/app/azkaban/azkaban-2.5.
[hadoop@master azkaban-2.5.]$ ll
total
-rwxr-xr-x hadoop hadoop Apr create.active_executing_flows.sql
-rwxr-xr-x hadoop hadoop Apr create.active_sla.sql
-rwxr-xr-x hadoop hadoop Apr create-all-sql-2.5..sql
-rwxr-xr-x hadoop hadoop Apr create.execution_flows.sql
-rwxr-xr-x hadoop hadoop Apr create.execution_jobs.sql
-rwxr-xr-x hadoop hadoop Apr create.execution_logs.sql
-rwxr-xr-x hadoop hadoop Apr create.project_events.sql
-rwxr-xr-x hadoop hadoop Apr create.project_files.sql
-rwxr-xr-x hadoop hadoop Apr create.project_flows.sql
-rwxr-xr-x hadoop hadoop Apr create.project_permissions.sql
-rwxr-xr-x hadoop hadoop Apr create.project_properties.sql
-rwxr-xr-x hadoop hadoop Apr create.projects.sql
-rwxr-xr-x hadoop hadoop Apr create.project_versions.sql
-rwxr-xr-x hadoop hadoop Apr create.properties.sql
-rwxr-xr-x hadoop hadoop Apr create.schedules.sql
-rwxr-xr-x hadoop hadoop Apr create.triggers.sql
-rwxr-xr-x hadoop hadoop Apr database.properties
-rwxr-xr-x hadoop hadoop Apr update-all-sql-2.1.sql
-rwxr-xr-x hadoop hadoop Apr update-all-sql-2.2.sql
-rwxr-xr-x hadoop hadoop Apr update.execution_logs.2.1.sql
-rwxr-xr-x hadoop hadoop Apr update.project_properties.2.1.sql
[hadoop@master azkaban-2.5.]$
所以，才执行如下
[hadoop@master azkaban]$ mysql -uazkaban -pazkaban
Welcome to the MySQL monitor. Commands end with ; or \g.
Your MySQL connection id is
Server version: 5.1. Source distribution Copyright (c) , , Oracle and/or its affiliates. All rights reserved. Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners. Type 'help;' or '\h' for help. Type '\c' to clear the current input statement. mysql> use azkaban;
Database changed
mysql> source /home/hadoop/app/azkaban/azkaban-2.5.0/create-all-sql-2.5.0.sql
Query OK, rows affected (0.03 sec) Query OK, rows affected (0.03 sec) Query OK, rows affected (0.01 sec) Query OK, rows affected (0.04 sec)
Records: Duplicates: Warnings: Query OK, rows affected (0.01 sec)
Records: Duplicates: Warnings: Query OK, rows affected (0.01 sec)
Records: Duplicates: Warnings: Query OK, rows affected (0.01 sec)
Records: Duplicates: Warnings: Query OK, rows affected (0.02 sec) Query OK, rows affected (0.01 sec)
Records: Duplicates: Warnings: Query OK, rows affected (0.01 sec)
Records: Duplicates: Warnings: Query OK, rows affected (0.03 sec)
Records: Duplicates: Warnings: Query OK, rows affected (0.02 sec) Query OK, rows affected (0.01 sec)
Records: Duplicates: Warnings: Query OK, rows affected (0.01 sec)
Records: Duplicates: Warnings: Query OK, rows affected (0.01 sec) Query OK, rows affected (0.00 sec)
Records: Duplicates: Warnings: Query OK, rows affected (0.02 sec) Query OK, rows affected (0.00 sec)
Records: Duplicates: Warnings: Query OK, rows affected (0.02 sec) Query OK, rows affected (0.00 sec)
Records: Duplicates: Warnings: Query OK, rows affected (0.01 sec) Query OK, rows affected (0.01 sec)
Records: Duplicates: Warnings: Query OK, rows affected (0.01 sec) Query OK, rows affected (0.01 sec)
Records: Duplicates: Warnings: Query OK, rows affected (0.01 sec) Query OK, rows affected (0.00 sec)
Records: Duplicates: Warnings: Query OK, rows affected (0.02 sec) Query OK, rows affected (0.01 sec)
Records: Duplicates: Warnings: Query OK, rows affected (0.01 sec) Query OK, rows affected (0.01 sec) Query OK, rows affected (0.01 sec)
Records: Duplicates: Warnings: Query OK, rows affected (0.02 sec)
mysql> exit;
Bye
[hadoop@master azkaban]$
三、Azkaban Web Server 安装
1.下载安装包
wget https://s3.amazonaws.com/azkaban2/azkaban2/2.5.0/azkaban-web-server-2.5.0.tar.gz
tar –zxvf azkaban-web-server-2.5..tar.gz –C ~/app/azkaban/
我这里，选择离线上传的方式，之前已经下载好了。
[hadoop@master azkaban]$ pwd
/home/hadoop/app/azkaban
[hadoop@master azkaban]$ ll
total
drwxrwxr-x hadoop hadoop May : azkaban-2.5.
[hadoop@master azkaban]$ rz [hadoop@master azkaban]$ ll
total
drwxrwxr-x hadoop hadoop May : azkaban-2.5.
-rw-r--r-- hadoop hadoop May : azkaban-web-server-2.5..tar.gz
[hadoop@master azkaban]$
解压缩
[hadoop@master azkaban]$ pwd
/home/hadoop/app/azkaban
[hadoop@master azkaban]$ ll
total
drwxrwxr-x hadoop hadoop May : azkaban-2.5.
-rw-r--r-- hadoop hadoop May : azkaban-web-server-2.5..tar.gz
[hadoop@master azkaban]$ tar -zxvf azkaban-web-server-2.5..tar.gz
[hadoop@master azkaban]$ pwd
/home/hadoop/app/azkaban
[hadoop@master azkaban]$ ll
total
drwxrwxr-x hadoop hadoop May : azkaban-2.5.
drwxrwxr-x hadoop hadoop May : azkaban-web-2.5.
-rw-r--r-- hadoop hadoop May : azkaban-web-server-2.5..tar.gz
[hadoop@master azkaban]$ rm azkaban-web-server-2.5..tar.gz
[hadoop@master azkaban]$ ll
total
drwxrwxr-x hadoop hadoop May : azkaban-2.5.
drwxrwxr-x hadoop hadoop May : azkaban-web-2.5.
[hadoop@master azkaban]$
2.上传依赖包
上传mysql驱动包至 ~/app/azkaban/azkaban-web-2.5.0/extlib/
[hadoop@master extlib]$ pwd
/home/hadoop/app/azkaban/azkaban-web-2.5./extlib
[hadoop@master extlib]$ ll
total
[hadoop@master extlib]$ rz
[hadoop@master extlib]$ ll
total
-rw-r--r-- hadoop hadoop Nov : mysql-connector-java-5.1..jar
[hadoop@master extlib]$
3.生成jetty ssl所需密钥文件
keytool -keystore keystore -alias jetty -genkey -keyalg RSA
Enter keystore password: mysteel
What is your first and last name?
[Unknown]: mysteel
What is the name of your organizational unit?
[Unknown]: mysteel
What is the name of your organization?
[Unknown]: mysteel
What is the name of your City or Locality?
[Unknown]:SH
What is the name of your State or Province?
[Unknown]:SH
What is the two-letter country code for this unit?
[Unknown]:CN
Is CN=mysteel, OU= mysteel, O= mysteel, L=SH, ST=SH, C=CN correct?
[no]: yes
Enter key password for < mysteel >
(RETURN if same as keystore password): mysteel
[hadoop@master extlib]$ pwd
/home/hadoop/app/azkaban/azkaban-web-2.5./extlib
[hadoop@master extlib]$ keytool -keystore keystore -alias jetty -genkey -keyalg RSA
Enter keystore password:（密码是mysteel）
Re-enter new password: （密码是mysteel）
What is your first and last name?
[Unknown]: mysteel
What is the name of your organizational unit?
[Unknown]: mysteel
What is the name of your organization?
[Unknown]: mysteel
What is the name of your City or Locality?
[Unknown]: SH
What is the name of your State or Province?
[Unknown]: SH
What is the two-letter country code for this unit?
[Unknown]: CN
Is CN=mysteel, OU=mysteel, O=mysteel, L=SH, ST=SH, C=CN correct?
[no]: yes Enter key password for <jetty>
(RETURN if same as keystore password):
Re-enter new password: （密码是mysteel）
[hadoop@master extlib]$
注意：这里keystore的密码为mysteel,key的密码为mysteel可自行修改 最后将生成的keystore文件放到 Azkaban安装目录中~/app/azkaban/azkaban-web-2.5.0/ （也可通过修改配置文件改变其默认存放地址）。
[hadoop@master extlib]$ pwd
/home/hadoop/app/azkaban/azkaban-web-2.5./extlib
[hadoop@master extlib]$ ll
total
-rw-rw-r-- hadoop hadoop May : keystore
-rw-r--r-- hadoop hadoop Nov : mysql-connector-java-5.1..jar
[hadoop@master extlib]$ mv keystore /home/hadoop/app/azkaban/azkaban-web-2.5./
[hadoop@master extlib]$ cd /home/hadoop/app/azkaban/azkaban-web-2.5./
[hadoop@master azkaban-web-2.5.]$ pwd
/home/hadoop/app/azkaban/azkaban-web-2.5.
[hadoop@master azkaban-web-2.5.]$ ll
total
-rw-r--r-- hadoop hadoop Apr azkaban.version
drwxr-xr-x hadoop hadoop Apr bin
drwxr-xr-x hadoop hadoop May : conf
drwxr-xr-x hadoop hadoop May : extlib
-rw-rw-r-- hadoop hadoop May : keystore
drwxr-xr-x hadoop hadoop May : lib
drwxr-xr-x hadoop hadoop Apr plugins
drwxr-xr-x hadoop hadoop May : web
[hadoop@master azkaban-web-2.5.]$
4.修改配置文件 (conf/azkaban.propreties)
修改首页样式及时区信息
azkaban.name=Job Tasks
azkaban.label=mysteel workflow
azkaban.color=#FF3601
azkaban.default.servlet.path=/index
web.resource.dir=web/
default.timezone.id=Asia/Shanghai
#Azkaban Personalization Settings
azkaban.name=Test
azkaban.label=My Local Azkaban
azkaban.color=#FF3601
azkaban.default.servlet.path=/index
web.resource.dir=web/
default.timezone.id=America/Los_Angeles 改为
#Azkaban Personalization Settings
azkaban.name=Job Tasks
azkaban.label=mysteel workflow
azkaban.color=#FF3601
azkaban.default.servlet.path=/index
web.resource.dir=web/
default.timezone.id=Asia/Shanghai
修改mysql连接,可自行修改
database.type=mysql
mysql.port=
mysql.host=192.168.80.145
mysql.database=azkaban
mysql.user=azkaban
mysql.password=azkaban
mysql.numconnections=
database.type=mysql
mysql.port=
mysql.host=localhost
mysql.database=azkaban
mysql.user=azkaban
mysql.password=azkaban
mysql.numconnections= 改为 database.type=mysql
mysql.port=
mysql.host=192.168.80.145
mysql.database=azkaban
mysql.user=azkaban
mysql.password=azkaban
mysql.numconnections=
修改 Jetty 服务器属性，包括 keystore 的相关配置
jetty.maxThreads=
jetty.ssl.port=
jetty.port=
jetty.keystore=keystore
jetty.password=mysteel
jetty.keypassword= mysteel
jetty.truststore=keystore
jetty.trustpassword= mysteel
# Azkaban Jetty server properties.
jetty.maxThreads=
jetty.ssl.port=
jetty.port=
jetty.keystore=keystore
jetty.password=password
jetty.keypassword=password
jetty.truststore=keystore
jetty.trustpassword=password 改成 # Azkaban Jetty server properties.
jetty.maxThreads=
jetty.ssl.port=
jetty.port=
jetty.keystore=keystore
jetty.password=mysteel
jetty.keypassword=mysteel
jetty.truststore=keystore
jetty.trustpassword=mysteel
修改邮件设置（可选）
mail.sender=xxxxxxx@mysteel.com
mail.host=smtp..com
mail.user= xxxxxxx@mysteel.com
mail.password=xxx (注:发送邮箱的密码)
5.用户及权限配置
进入 azkaban web 服务器 conf 目录，修改 azkaban-users.xml ，增加管理员用户：
< azkaban-users>
< user username="azkaban" password="azkaban" roles="admin" groups="azkaban" />
< user username="metrics" password="metrics" roles="metrics"/>
< user username="admin" password="admin" roles="admin,metrics" />
< role name="admin" permissions="ADMIN" />
< role name="metrics" permissions="METRICS"/>
< /azkaban-users>
<azkaban-users>
<user username="azkaban" password="azkaban" roles="admin" groups="azkaban" />
<user username="metrics" password="metrics" roles="metrics"/>
<role name="admin" permissions="ADMIN" />
<role name="metrics" permissions="METRICS"/>
</azkaban-users> 改为 <azkaban-users>
<user username="azkaban" password="azkaban" roles="admin" groups="azkaban" />
<user username="metrics" password="metrics" roles="metrics"/>
<user username="admin" password="admin" roles="admin,metrics"/>
<role name="admin" permissions="ADMIN" />
<role name="metrics" permissions="METRICS"/>
</azkaban-users>
四、Azkaban Executor Server安装
1、下载安装包
wget https://s3.amazonaws.com/azkaban2/azkaban2/2.5.0/azkaban-executor-server-2.5.0.tar.gz
tar –zxvf azkaban-executor-server-2.5..tar.gz –C ~/app/azkaban/
我这里，选择的是离线，再上传的方式
[hadoop@master azkaban]$ pwd
/home/hadoop/app/azkaban
[hadoop@master azkaban]$ ll
total
drwxrwxr-x hadoop hadoop May : azkaban-2.5.
drwxrwxr-x hadoop hadoop May : azkaban-web-2.5.
[hadoop@master azkaban]$ rz [hadoop@master azkaban]$ ll
total
drwxrwxr-x hadoop hadoop May : azkaban-2.5.
-rw-r--r-- hadoop hadoop May : azkaban-executor-server-2.5..tar.gz
drwxrwxr-x hadoop hadoop May : azkaban-web-2.5.
[hadoop@master azkaban]$ clear
[hadoop@master azkaban]$
解压缩
[hadoop@master azkaban]$ pwd
/home/hadoop/app/azkaban
[hadoop@master azkaban]$ ll
total
drwxrwxr-x hadoop hadoop May : azkaban-2.5.
-rw-r--r-- hadoop hadoop May : azkaban-executor-server-2.5..tar.gz
drwxrwxr-x hadoop hadoop May : azkaban-web-2.5.
[hadoop@master azkaban]$ tar -zxvf azkaban-executor-server-2.5..tar.gz
[hadoop@master azkaban]$ ll
total
drwxrwxr-x hadoop hadoop May : azkaban-2.5.
drwxrwxr-x hadoop hadoop May : azkaban-executor-2.5.
-rw-r--r-- hadoop hadoop May : azkaban-executor-server-2.5..tar.gz
drwxrwxr-x hadoop hadoop May : azkaban-web-2.5.
[hadoop@master azkaban]$ rm azkaban-executor-server-2.5..tar.gz
[hadoop@master azkaban]$
2.修改配置文件 (conf/azkaban.propreties)
修改时区信息
default.timezone.id=Asia/Shanghai
[hadoop@master conf]$ pwd
/home/hadoop/app/azkaban/azkaban-executor-2.5./conf
[hadoop@master conf]$ ll
total
-rw-r--r-- hadoop hadoop Apr azkaban.private.properties
-rw-r--r-- hadoop hadoop Apr azkaban.properties
-rw-r--r-- hadoop hadoop Apr global.properties
[hadoop@master conf]$ vim azkaban.properties
#Azkaban
default.timezone.id=America/Los_Angeles 改为 #Azkaban
default.timezone.id=Asia/Shanghai
修改mysql连接,可自行修改
database.type=mysql
mysql.port=
mysql.host=192.168.80.145
mysql.database=azkaban
mysql.user=azkaban
mysql.password=azkaban
mysql.numconnections=
database.type=mysql
mysql.port=
mysql.host=localhost
mysql.database=azkaban2
mysql.user=azkaban
mysql.password=azkaban
mysql.numconnections= 改为 database.type=mysql
mysql.port=
mysql.host=192.168.80.145
mysql.database=azkaban
mysql.user=azkaban
mysql.password=azkaban
mysql.numconnections=
配置端口，默认就好
executor.maxThreads=
executor.port=
executor.flow.threads=
在web server 的azkaban.properties配置executor的连接，特别注意，如果两个server不是在一台主机上，web server 需要配置executor.host
# Azkaban Executor settings
executor.port=
executor.host=ip/hostname
我这里，仅仅是都安装在单节点master即同一台机器上，所以上述这一小步骤省略。
五、启动验证
启动web server
~/app/azkaban/azkaban-web-2.5./bin/azkaban-web-start.sh（azkaban-web-shutdown.sh停止）
访问 https://master:8443 出现界面安装成功
或
访问 https://192.168.80.145:8443 出现界面安装成功
[hadoop@master azkaban-web-2.5.]$ pwd
/home/hadoop/app/azkaban/azkaban-web-2.5.
[hadoop@master azkaban-web-2.5.]$ ll
total
-rw-r--r-- hadoop hadoop Apr azkaban.version
drwxr-xr-x hadoop hadoop Apr bin
drwxr-xr-x hadoop hadoop May : conf
drwxr-xr-x hadoop hadoop May : extlib
-rw-rw-r-- hadoop hadoop May : keystore
drwxr-xr-x hadoop hadoop May : lib
drwxr-xr-x hadoop hadoop Apr plugins
drwxr-xr-x hadoop hadoop May : web
[hadoop@master azkaban-web-2.5.]$ bin/azkaban-web-start.sh
Using Hadoop from /home/hadoop/app/hadoop-2.6.
Using Hive from /home/hadoop/app/hive
bin/..
/home/hadoop/app/jdk/lib:.:/home/hadoop/app/jdk/lib:/home/hadoop/app/jdk/jre/lib:bin/../lib/azkaban-2.5..jar:bin/../lib/commons-collections-3.2..jar:bin/../lib/commons-configuration-1.8.jar:bin/../lib/commons-dbcp-1.4.jar:bin/../lib/commons-dbutils-1.5.jar:bin/../lib/commons-email-1.2.jar:bin/../lib/commons-fileupload-1.2..jar:bin/../lib/commons-io-2.4.jar:bin/../lib/commons-jexl-2.1..jar:bin/../lib/commons-lang-2.6.jar:bin/../lib/commons-logging-1.1..jar:bin/../lib/commons-pool-1.6.jar:bin/../lib/guava-13.0..jar:bin/../lib/h2-1.3..jar:bin/../lib/httpclient-4.2..jar:bin/../lib/httpcore-4.2..jar:bin/../lib/jackson-core-asl-1.9..jar:bin/../lib/jackson-mapper-asl-1.9..jar:bin/../lib/jetty-6.1..jar:bin/../lib/jetty-util-6.1..jar:bin/../lib/joda-time-2.0.jar:bin/../lib/jopt-simple-4.3.jar:bin/../lib/junit-4.8.jar:bin/../lib/log4j-1.2..jar:bin/../lib/mail-1.4..jar:bin/../lib/mysql-connector-java-5.1..jar:bin/../lib/servlet-api-2.5.jar:bin/../lib/slf4j-api-1.6..jar:bin/../lib/slf4j-log4j12-1.6..jar:bin/../lib/velocity-1.7.jar:bin/../lib/velocity-tools-2.0.jar:bin/../extlib/mysql-connector-java-5.1..jar:bin/../plugins/*/*.jar:/home/hadoop/app/hadoop-2.6.0/conf:/home/hadoop/app/hadoop-2.6.0/*:/home/hadoop/app/hive/conf:/home/hadoop/app/hive/lib/*
[hadoop@master azkaban-web-2.5.0]$ 2017/05/01 15:35:30.167 +0800 ERROR [AzkabanWebServer] [Azkaban] Starting Jetty Azkaban Executor...
2017/05/01 15:35:30.278 +0800 INFO [AzkabanServer] [Azkaban] Loading azkaban settings file from bin/../conf
2017/05/01 15:35:30.280 +0800 INFO [AzkabanServer] [Azkaban] Loading azkaban properties file
2017/05/01 15:35:30.338 +0800 INFO [AzkabanWebServer] [Azkaban] Setting up Jetty Https Server with port:8443 and numThreads:25
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/hadoop/app/azkaban/azkaban-web-2.5.0/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/hadoop/app/hive-1.0.0/lib/hive-jdbc-1.0.0-standalone.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2017/05/01 15:35:30.532 +0800 INFO [log] [Azkaban] Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2017/05/01 15:35:30.897 +0800 INFO [AzkabanWebServer] [Azkaban] Loading user manager class azkaban.user.XmlUserManager
2017/05/01 15:35:31.352 +0800 INFO [XmlUserManager] [Azkaban] Loading user azkaban
2017/05/01 15:35:31.359 +0800 INFO [XmlUserManager] [Azkaban] Loading user metrics
2017/05/01 15:35:31.360 +0800 INFO [XmlUserManager] [Azkaban] Loading user admin
2017/05/01 15:35:33.429 +0800 INFO [AzkabanWebServer] [Azkaban] Loading JDBC for project management
2017/05/01 15:35:33.450 +0800 INFO [ExecutorManager] [Azkaban] Cleaning old logs from execution_logs
2017/05/01 15:35:33.480 +0800 INFO [ProjectManager] [Azkaban] Project version retention is set to 3
2017/05/01 15:35:34.233 +0800 INFO [ExecutorManager] [Azkaban] Cleaning old log files before 2017-02-06T15:35:33.601+08:00
2017/05/01 15:35:34.283 +0800 INFO [ExecutorManager] [Azkaban] Cleaned up 0 log entries.
2017/05/01 15:35:34.483 +0800 INFO [TriggerManager] [Azkaban] TriggerManager loaded.
2017/05/01 15:35:34.484 +0800 INFO [AzkabanWebServer] [Azkaban] Loading built-in checker and action types
2017/05/01 15:35:34.533 +0800 INFO [CheckerTypeLoader] [Azkaban] Registering checker BasicTimeChecker
2017/05/01 15:35:34.533 +0800 INFO [CheckerTypeLoader] [Azkaban] Registering checker SlaChecker
2017/05/01 15:35:34.534 +0800 INFO [CheckerTypeLoader] [Azkaban] Registering checker ExecutionChecker
2017/05/01 15:35:34.534 +0800 INFO [ActionTypeLoader] [Azkaban] Registering action ExecuteFlowAction
2017/05/01 15:35:34.535 +0800 INFO [ActionTypeLoader] [Azkaban] Registering action KillExecutionAction
2017/05/01 15:35:34.550 +0800 INFO [ActionTypeLoader] [Azkaban] Registering action AlertAction
2017/05/01 15:35:34.566 +0800 INFO [ActionTypeLoader] [Azkaban] Registering action CreateTriggerAction
2017/05/01 15:35:34.582 +0800 INFO [AzkabanWebServer] [Azkaban] Loading trigger based scheduler
2017/05/01 15:35:34.620 +0800 INFO [AzkabanWebServer] [Azkaban] Loading plug-in checker and action types
2017/05/01 15:35:34.621 +0800 ERROR [AzkabanWebServer] [Azkaban] plugin path plugins/triggers doesn't exist!
2017/05/01 15:35:34.623 +0800 INFO [AzkabanWebServer] [Azkaban] Setting timezone to Asia/Shanghai
2017/05/01 15:35:34.627 +0800 INFO [AzkabanWebServer] [Azkaban] Registering MBeans...
2017/05/01 15:35:34.747 +0800 INFO [AzkabanWebServer] [Azkaban] Bean azkaban.jmx.JmxJettyServer registered.
2017/05/01 15:35:34.755 +0800 INFO [AzkabanWebServer] [Azkaban] Bean azkaban.jmx.JmxTriggerManager registered.
2017/05/01 15:35:34.765 +0800 INFO [AzkabanWebServer] [Azkaban] Bean azkaban.jmx.JmxExecutorManager registered.
2017/05/01 15:35:34.770 +0800 INFO [AzkabanWebServer] [Azkaban] Setting up web resource dir web/
2017/05/01 15:35:34.952 +0800 INFO [JdbcTriggerLoader] [Azkaban] Loading all triggers from db.
2017/05/01 15:35:35.047 +0800 INFO [JdbcTriggerLoader] [Azkaban] Loaded 0 triggers.
2017/05/01 15:35:35.048 +0800 INFO [log] [Azkaban] jetty-6.1.26
2017/05/01 15:35:36.445 +0800 INFO [log] [Azkaban] Started SslSocketConnector@0.0.0.0:8443
2017/05/01 15:35:36.446 +0800 INFO [AzkabanWebServer] [Azkaban] Server running on ssl port 8443.
这里的用户名好密码都是我们在配置文件里，设置的azkaban
启动 executor server
~/app/azkaban/azkaban-executor-2.5./bin/azkaban-executor-start.sh(azkaban-executor-shutdown.sh 停止
[hadoop@master azkaban-executor-2.5.]$ pwd
/home/hadoop/app/azkaban/azkaban-executor-2.5.
[hadoop@master azkaban-executor-2.5.]$ ll
total
-rw-r--r-- hadoop hadoop Apr azkaban.version
drwxr-xr-x hadoop hadoop Apr bin
drwxr-xr-x hadoop hadoop May : conf
drwxr-xr-x hadoop hadoop Apr extlib
drwxr-xr-x hadoop hadoop May : lib
drwxr-xr-x hadoop hadoop Apr plugins
[hadoop@master azkaban-executor-2.5.]$ bin/azkaban-executor-start.sh
Using Hadoop from /home/hadoop/app/hadoop-2.6.
Using Hive from /home/hadoop/app/hive
bin/..
/home/hadoop/app/jdk/lib:.:/home/hadoop/app/jdk/lib:/home/hadoop/app/jdk/jre/lib:bin/../lib/azkaban-2.5..jar:bin/../lib/commons-collections-3.2..jar:bin/../lib/commons-configuration-1.8.jar:bin/../lib/commons-dbcp-1.4.jar:bin/../lib/commons-dbutils-1.5.jar:bin/../lib/commons-email-1.2.jar:bin/../lib/commons-fileupload-1.2..jar:bin/../lib/commons-io-2.4.jar:bin/../lib/commons-jexl-2.1..jar:bin/../lib/commons-lang-2.6.jar:bin/../lib/commons-logging-1.1..jar:bin/../lib/commons-pool-1.6.jar:bin/../lib/guava-13.0..jar:bin/../lib/h2-1.3..jar:bin/../lib/httpclient-4.2..jar:bin/../lib/httpcore-4.2..jar:bin/../lib/jackson-core-asl-1.9..jar:bin/../lib/jackson-mapper-asl-1.9..jar:bin/../lib/jetty-6.1..jar:bin/../lib/jetty-util-6.1..jar:bin/../lib/joda-time-2.0.jar:bin/../lib/jopt-simple-4.3.jar:bin/../lib/junit-4.8.jar:bin/../lib/log4j-1.2..jar:bin/../lib/mail-1.4..jar:bin/../lib/mysql-connector-java-5.1..jar:bin/../lib/servlet-api-2.5.jar:bin/../lib/slf4j-api-1.6..jar:bin/../lib/slf4j-log4j12-1.6..jar:bin/../lib/velocity-1.7.jar:bin/../lib/velocity-tools-2.0.jar:bin/../extlib/*.jar:bin/../plugins/*/*.jar:/home/hadoop/app/hadoop-2.6./conf:/home/hadoop/app/hadoop-2.6./*:/home/hadoop/app/hive/conf:/home/hadoop/app/hive/lib/*
Starting AzkabanExecutorServer on port 12321 ...
[hadoop@master azkaban-executor-2.5.0]$ 2017/05/01 15:43:52.101 +0800 ERROR [AzkabanExecutorServer] [Azkaban] Starting Jetty Azkaban Executor...
2017/05/01 15:43:52.180 +0800 INFO [AzkabanServer] [Azkaban] Loading azkaban settings file from bin/../conf
2017/05/01 15:43:52.182 +0800 INFO [AzkabanServer] [Azkaban] Loading azkaban private properties file
2017/05/01 15:43:52.187 +0800 INFO [AzkabanServer] [Azkaban] Loading azkaban properties file
2017/05/01 15:43:52.285 +0800 INFO [AzkabanExecutorServer] [Azkaban] Setting timezone to Asia/Shanghai
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/hadoop/app/azkaban/azkaban-executor-2.5.0/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/hadoop/app/hive-1.0.0/lib/hive-jdbc-1.0.0-standalone.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2017/05/01 15:43:52.430 +0800 INFO [log] [Azkaban] Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2017/05/01 15:43:53.334 +0800 INFO [FlowRunnerManager] [Azkaban] Execution dir retention set to 86400000 ms
2017/05/01 15:43:53.388 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2017/05/01 15:43:53.389 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning old projects
2017/05/01 15:43:53.390 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning old execution dirs
2017/05/01 15:43:53.431 +0800 INFO [AzkabanExecutorServer] [Azkaban] Registering MBeans...
2017/05/01 15:43:53.610 +0800 INFO [AzkabanExecutorServer] [Azkaban] Bean azkaban.jmx.JmxJettyServer registered.
2017/05/01 15:43:53.639 +0800 INFO [AzkabanExecutorServer] [Azkaban] Bean azkaban.jmx.JmxFlowRunnerManager registered.
2017/05/01 15:43:53.640 +0800 INFO [log] [Azkaban] jetty-6.1.26
2017/05/01 15:43:53.861 +0800 INFO [log] [Azkaban] Started SocketConnector@0.0.0.0:12321
2017/05/01 15:43:53.862 +0800 INFO [AzkabanExecutorServer] [Azkaban] Azkaban Executor Server started on port 12321
如何停止
[hadoop@master azkaban-web-2.5.]$ pwd
/home/hadoop/app/azkaban/azkaban-web-2.5.
[hadoop@master azkaban-web-2.5.]$ jps
AzkabanWebServer
AzkabanExecutorServer
Jps
[hadoop@master azkaban-executor-2.5.]$ pwd
/home/hadoop/app/azkaban/azkaban-executor-2.5.
[hadoop@master azkaban-executor-2.5.]$ ll
total
-rw-rw-r-- hadoop hadoop May : azkaban-access.log
-rw-r--r-- hadoop hadoop Apr azkaban.version
-rw-rw-r-- hadoop hadoop May : azkaban-webserver.log
drwxr-xr-x hadoop hadoop Apr bin
drwxr-xr-x hadoop hadoop May : conf
-rw-rw-r-- hadoop hadoop May : currentpid
drwxrwxr-x hadoop hadoop May : executions
drwxr-xr-x hadoop hadoop Apr extlib
drwxr-xr-x hadoop hadoop May : lib
drwxr-xr-x hadoop hadoop Apr plugins
drwxrwxr-x hadoop hadoop May : projects
drwxrwxr-x hadoop hadoop May : temp
[hadoop@master azkaban-executor-2.5.]$ bin/azkaban-executor-shutdown.sh [hadoop@master azkaban-executor-2.5.]$ jps
AzkabanWebServer
Jps
[hadoop@master azkaban-executor-2.5.]$
[hadoop@master azkaban-web-2.5.]$ pwd
/home/hadoop/app/azkaban/azkaban-web-2.5.
[hadoop@master azkaban-web-2.5.]$ jps
AzkabanWebServer
Jps
[hadoop@master azkaban-web-2.5.]$ bin/azkaban-web-shutdown.sh
或kill掉
[hadoop@master azkaban-web-2.5.]$ jps
Jps
AzkabanWebServer
[hadoop@master azkaban-web-2.5.]$ kill -
[hadoop@master azkaban-web-2.5.]$ jps
Jps
[hadoop@master azkaban-web-2.5.]$
这里不多赘述了。
六、Azkaban web server插件安装（暂时没用上，不先写了）
为了后边插件的安装，需要在${AZKABAN_WEB_SERVER}/plugins/目录下创建viewer目录，用来安装各种viewer插件。当安装好一个插件后需要重启服务，让插件生效。
安装HDFS Viewer插件
1.解压插件
解压插件 在viewer目录中解压azkaban-hdfs-viewer-2.5.0.tar.gz，得到azkaban-hdfs-viewer-2.5.0目录，将其更名为hdfs。最终，这个插件的目录路径是：${AZKABAN_WEB_SERVER}/plugins/viewer/hdfs。
安装Job Summary插件
安装Reportal插件
七、Azkaban Executor Server 插件安装（暂时没用上，不先写了）
进入${AZKABAN_EXECUTOR_SERVER}/plugins目录，在该目录下解压azkaban-jobtype-2.5.0.tar.gz得到目录：azkaban-jobtype-2.5.0。将该目录更名为jobtypes。这个目录用来存放之后安装的所有插件，与Web Server中的viewer目录类似。每次插件的安装配置需要重启Executor Server。
安装Reportalhive插件
参考
http://www.cnblogs.com/qiaoyihang/p/6237810.html
欢迎大家，加入我的微信公众号：大数据躺过的坑 人工智能躺过的坑
同时，大家可以关注我的个人博客：
http://www.cnblogs.com/zlslch/ 和 http://www.cnblogs.com/lchzls/ http://www.cnblogs.com/sunnyDream/
详情请见：http://www.cnblogs.com/zlslch/p/7473861.html
人生苦短，我愿分享。本公众号将秉持活到老学到老学习无休止的交流分享开源精神，汇聚于互联网和个人学习工作的精华干货知识，一切来于互联网，反馈回互联网。
目前研究领域：大数据、机器学习、深度学习、人工智能、数据挖掘、数据分析。 语言涉及：Java、Scala、Python、Shell、Linux等 。同时还涉及平常所使用的手机、电脑和互联网上的使用技巧、问题和实用软件。 只要你一直关注和呆在群里，每天必须有收获
对应本平台的讨论和答疑QQ群：大数据和人工智能躺过的坑（总群）（161156071）