htw

Pheonix query server plug in to hbase.

Pull the file from

  • http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.3.0/HDP-2.6.3.0-centos7-rpm.tar.gz
  • http://public-repo-1.hortonworks.com/ambari/centos7/2.x/updates/2.6.0.0/ambari-2.6.0.0-centos7.tar.gz
  • http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos7/HDP-UTILS-1.1.0.21-centos7.tar.gz

172.28.11.1

Copy the file into the Master node

  • Install Apache

    • yum insall httpd
  • Create 4 Folders in the /var/www/htdocs folder

    • rhel_7
    • hdp_26
    • ambari_26

Now we copy the HDP Repo

And we edit the file

  #VERSION_NUMBER=2.6.3.0-235
[HDP-2.6.3.0]
name=HDP Version - HDP-2.6.3.0
baseurl=http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.3.0
gpgcheck=0
gpgkey=http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.3.0/RPM-
GPG-KEY/RPM-GPG-KEY-Jenkins
enabled=1
priority=1


[HDP-UTILS-1.1.0.21]
name=HDP-UTILS Version - HDP-UTILS-1.1.0.21
baseurl=http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.21/repos/centos7
gpgcheck=0
gpgkey=http://public-repo-1.hortonworks.com/HDP/centos7/2.x/updates/2.6.3.0/RPM-
GPG-KEY/RPM-GPG-KEY-Jenkins
enabled=1
priority=1

Repeat for the other REPOS

pdsh

Get a list of nodes then export a Variable

 export PDSH_RCMD_TYPE=ssh
 export WCOLL=<HOSTS_FILE_FULL_PATH>


 pdsh date

Java JCE

We should also have Java Encryption Packages installed and available.

These need to match.

Createrepo

 mkdir jdk
 cp ORACLE:jdk_1_2_3.rpm .
 cd ..
 createreport jdk

Now create a file in /etc/yum.repo.d/

 Change the [Key] and Name

Point the file to the Repo (which should be hosted on the Web Server).

Ambari

username ambari password ambari

Installed on Master01

Then as ambari

psql
create database
create user

phm01.eq.com:8080

admin
admin

RabbitMQ vs Kafka

We could look at Kafka instead of RMQ.

PHEONIX TESTING

To run up pheonix-client

/usr/hdp/current/phoenix-client/bin/sqlline.py phm01.eq.com:2181
drop table big_test_salt_bulk ;

Date Time Querying

This works

select TO_DATE(BIRTHDATE,'yyyy-MM-dd', 'GMT+1') as bday from big_test_salt_bulk where TO_DATE(BIRTHDATE,'yyyy-MM-dd', 'GMT+1')  < TO_DATE('1980-01-02','yyyy-MM-dd', 'GMT+1') limit 10;