StarRocks部署

Step 1：安裝JDK

1.1上傳JDK安裝包文件
/usr/local/src/ jdk-8u162-linux-x64.tar.gz

1.2.解壓JDK安裝包文件

tar -zxvf  jdk-8u162-linux-x64.tar.gz

1.3.配置Java環(huán)境變量

[root@master jdk1.8.0_162]# vim /root/.bash_profile

JAVA_HOME=/usr/local/src/jdk1.8.0_162
export JAVA_HOME
PATH=$JAVA_HOME/bin:$JAVA_HOME/sbin:$PATH
export PATH

1.4.測試JDK是否安裝成功

[root@master jdk1.8.0_162]# java -version
java version "1.8.0_162"
Java(TM) SE Runtime Environment (build 1.8.0_162-b12)
Java HotSpot(TM) 64-Bit Server VM (build 25.162-b12, mixed mode)

Step 2：安裝MySQL

2.1安裝mysql客戶端： [root@bigdata ~]# yum -y install mysql

2.2安裝mysql服務(wù)器端： [root@bigdata ~]# yum -y install mysql-server

如果安裝mysql-server時提示“沒有可用包”，解決辦法：

2.2.1.下載mysql的repo源：

[root@localhost ~]# wget http://repo.mysql.com/mysql-community-release-el7-5.noarch.rpm

2.2.2.安裝mysql的repo源

[root@localhost ~]# rpm -ivh mysql-community-release-el7-5.noarch.rpm

2.2.3.查看找到的mysql安裝源

[root@localhost ~]# ls -1 /etc/yum.repos.d/mysql-community*
/etc/yum.repos.d/mysql-community.repo
/etc/yum.repos.d/mysql-community-source.repo

2.2.4.重新安裝mysql-server

[root@master ~]# yum install -y mysql-server

2.3啟動mysql服務(wù)器：

[root@bigdata ~]# service mysqld start

Redirecting to /bin/systemctl start mysqld.service

根據(jù)提示也可以使用命令：systemctl start mysqld.service

2.4設(shè)置mysql管理員密碼：

[root@master~]# mysqladmin -uroot password 123456
Warning: Using a password on the command line interface can be insecure.

2.5測試登錄是否成功：
[root@bigdata ~]# mysql -uroot -p123456
Warning: Using a password on the command line interface can be insecure.
Welcome to the MySQL monitor. Commands end with ; or \g.
Your MySQL connection id is 3
Server version: 5.6.39 MySQL Community Server (GPL)

Copyright (c) 2000, 2018, Oracle and/or its affiliates. All rights reserved.

Oracle is a registered trademark of Oracle Corporation and/or its affiliates. 
Other names may be trademarks of their respective owners.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

mysql>

2.6授權(quán)root用戶：
mysql> grant all privileges on *.* to root@'%' identified by '123456' with grant option; 
Query OK, 0 rows affected (0.06 sec) 
mysql> grant all privileges on *.* to root@'主機(jī)名' identified by '123456' with grant option; 
Query OK, 0 rows affected (0.06 sec) 
mysql> grant all privileges on *.* to root@'localhost' identified by '123456' with grant option; 
Query OK, 0 rows affected (0.06 sec) 
mysql> flush privileges;
Query OK, 0 rows affected (0.00 sec)

*.*：指的是所有數(shù)據(jù)庫

Step 3：StarRocks部署

1）下載安裝包,并重命名

wget https://www.starrocks.com/zh-CN/download/request-download/4
mv 4 StarRocks-1.19.1.tar.gz

2）解壓tar包

tar -zxvf StarRocks-1.19.1.tar.gz -C /usr/local/

3）部署FE，修改配置文件，添加jvm參數(shù)

cd /usr/local/StarRocks-1.19.1/fe/conf/
]# vim fe.conf 
JAVA_OPTS = "-Xmx800m -XX:+UseMembar -XX:SurvivorRatio=8 -XX:MaxTenuringThreshold=7 -XX:+PrintGCDateStamps -XX:+PrintGCDetails -XX:+UseConcMarkSweepGC -XX:+UseParNewGC -XX:+CMSClassUnloadingEnabled -XX:-CMSParallelRemarkEnabled -XX:CMSInitiatingOccupancyFraction=80 -XX:SoftRefLRUPolicyMSPerMB=0 -Xloggc:$STARROCKS_HOME/log/fe.gc.log"

4）創(chuàng)建元數(shù)據(jù)目錄

]# cd ..
]# mkdir -p meta

5）分發(fā)給slave1,slave2

]#  scp -P 9528 -rp StarRocks-1.19.1 root@172.16.0.6:/usr/local/
]#  scp -P 9528 -rp StarRocks-1.19.1 root@172.16.0.7:/usr/local/

6）啟動172.16.0.5 FE節(jié)點

]# bin/start_fe.sh --daemon

7）啟動mysql客戶端，訪問FE，查看FE狀況

]# mysql -h hadoop101 -uroot -P9030
mysql> SHOW PROC '/frontends'\G
*************************** 1\. row ***************************
             Name: 172.16.0.5_9010_1644289106240
               IP: 172.16.0.5
         HostName: iZbp1etb69sqxcvg7mwz7tZ
      EditLogPort: 9010
         HttpPort: 8030
        QueryPort: 9030
          RpcPort: 9020
             Role: FOLLOWER
         IsMaster: true
        ClusterId: 844004438
             Join: true
            Alive: true
ReplayedJournalId: 4451
    LastHeartbeat: 2022-02-08 15:05:46
         IsHelper: true
           ErrMsg:
1 row in set (0.05 sec)

8）添加其他FE節(jié)點，角色也分為FOLLOWER,OBSERVER

mysql> alter system add follower "bigdata102:9010";
Query OK, 0 rows affected (0.02 sec)

mysql>alter system add observer "bigdata103:9010";
Query OK, 0 rows affected (0.01 sec)

9）啟動172.16.0.6,172.16.0.7 FE節(jié)點，第一次啟動需指定--helper參數(shù)，后續(xù)再啟動無需指定此參數(shù)

]# ./bin/start_fe.sh --helper bigdata101:9010 --daemon
]# ./bin/start_fe.sh --helper bigdata101:9010 --daemon

10）全部啟動完畢后，再使用mysql客戶端查看FE的狀況,alive全顯示true則無問題

mysql> show proc '/frontends'\G
*************************** 1\. row ***************************
             Name: 172.16.0.5_9010_1644289106240
               IP: 172.16.0.5
         HostName: iZbp1etb69sqxcvg7mwz7tZ
      EditLogPort: 9010
         HttpPort: 8030
        QueryPort: 9030
          RpcPort: 9020
             Role: FOLLOWER
         IsMaster: true
        ClusterId: 844004438
             Join: true
            Alive: true
ReplayedJournalId: 4530
    LastHeartbeat: 2022-02-08 15:10:02
         IsHelper: true
           ErrMsg:
*************************** 2\. row ***************************
             Name: 172.16.0.7_9010_1644304020469
               IP: 172.16.0.7
         HostName: 172.16.0.7
      EditLogPort: 9010
         HttpPort: 8030
        QueryPort: 9030
          RpcPort: 9020
             Role: OBSERVER
         IsMaster: false
        ClusterId: 844004438
             Join: true
            Alive: true
ReplayedJournalId: 4529
    LastHeartbeat: 2022-02-08 15:10:02
         IsHelper: false
           ErrMsg:
*************************** 3\. row ***************************
             Name: 172.16.0.6_9010_1644304006306
               IP: 172.16.0.6
         HostName: 172.16.0.6
      EditLogPort: 9010
         HttpPort: 8030
        QueryPort: 9030
          RpcPort: 9020
             Role: FOLLOWER
         IsMaster: false
        ClusterId: 844004438
             Join: true
            Alive: true
ReplayedJournalId: 4529
    LastHeartbeat: 2022-02-08 15:10:02
         IsHelper: true
           ErrMsg:
3 rows in set (0.05 sec)

11） 部署B(yǎng)E，用戶可以使用命令直接將BE添加到集群中，一般至少布置3個BE，每個BE實例添加步驟相同

]# cd ../be/
[root@HZ-2H0-BI-DEV-5 be]# mkdir -p storage

12）使用mysql客戶端添加172.16.0.5對應(yīng)be節(jié)點

mysql> ALTER SYSTEM ADD BACKEND "bigdata101:9050";

13）添加完畢后，啟動172.16.0.5 BE節(jié)點

]# bin/start_be.sh --daemon

14）查看BE狀況,也是同樣alive為true是正常運(yùn)行

mysql> show proc '/backends'\G
*************************** 1\. row ***************************
            BackendId: 10003
              Cluster: default_cluster
                   IP: 172.16.0.5
             HostName: iZbp1etb69sqxcvg7mwz7tZ
        HeartbeatPort: 9050
               BePort: 9060
             HttpPort: 8040
             BrpcPort: 8060
        LastStartTime: 2022-02-08 15:16:43
        LastHeartbeat: 2022-02-08 15:17:48
                Alive: true
 SystemDecommissioned: false
ClusterDecommissioned: false
            TabletNum: 10
     DataUsedCapacity: .000
        AvailCapacity: 50.842 GB
        TotalCapacity: 58.933 GB
              UsedPct: 13.73 %
       MaxDiskUsedPct: 13.73 %
               ErrMsg:
              Version: 1.19.1-65e87c3
               Status: {"lastSuccessReportTabletsTime":"2022-02-08 15:17:43"}
    DataTotalCapacity: 50.842 GB
          DataUsedPct: 0.00 %
1 row in set (0.00 sec)

15）同樣步驟在hadoop102,hadoop103部署B(yǎng)E，并添加節(jié)點

]# mkdir -p storage
]# mkdir -p storage

mysql> alter system add backend "bigdata102:9050";
Query OK, 0 rows affected (0.00 sec)

mysql>  alter system add backend "bigdata103:9050";
Query OK, 0 rows affected (0.01 sec)

6 be]# ./bin/start_be.sh --daemon

7 be]# ./bin/start_be.sh --daemon</pre>

16）部署B(yǎng)roker,此角色主要用于后續(xù)Broker load使用,啟動安裝目錄的Broker服務(wù)

]# cd apache_hdfs_broker/
]# ./bin/start_broker.sh --daemon

]# cd apache_hdfs_broker/
]# ./bin/start_broker.sh --daemon

]# cd apache_hdfs_broker/
]# ./bin/start_broker.sh --daemon

17）使用mysql添加對應(yīng)節(jié)點

mysql> alter system add broker broker1 "172.16.0.5:8000";
Query OK, 0 rows affected (0.01 sec)

mysql> alter system add broker broker2 "172.16.0.6:8000";
Query OK, 0 rows affected (0.01 sec)

mysql> alter system add broker broker3 "172.16.0.7:8000";
Query OK, 0 rows affected (0.01 sec)

18）查看狀態(tài)

mysql> SHOW PROC "/brokers"\G
*************************** 1\. row ***************************
          Name: broker2
            IP: 172.16.0.6
          Port: 8000
         Alive: true
 LastStartTime: 2022-02-08 16:02:15
LastUpdateTime: 2022-02-08 16:04:10
        ErrMsg:
*************************** 2\. row ***************************
          Name: broker1
            IP: 172.16.0.5
          Port: 8000
         Alive: true
 LastStartTime: 2022-02-08 16:01:24
LastUpdateTime: 2022-02-08 16:04:10
        ErrMsg:
*************************** 3\. row ***************************
          Name: broker3
            IP: 172.16.0.7
          Port: 8000
         Alive: true
 LastStartTime: 2022-02-08 16:02:35
LastUpdateTime: 2022-02-08 16:04:10
        ErrMsg:
3 rows in set (0.00 sec)

雖然是alive正常狀態(tài)，但是有時候創(chuàng)建表出現(xiàn)問題，如下圖：


從圖中可以看出102和103節(jié)點內(nèi)存都是0，檢查前端節(jié)點，發(fā)現(xiàn)101的節(jié)點ip并沒有顯示101，而是顯示122，如下圖：


這個是因為在虛擬化中有使用到libvirtd服務(wù)生成的，IP可以查看：



去掉方法：
1.查看網(wǎng)橋

[root@bigdata102 fe]#   brctl show
bridge name     bridge id               STP enabled     interfaces
virbr0          8000.5254007155ea       yes             virbr0-nic

2.刪除網(wǎng)橋

[root@bigdata102 fe]# ifconfig virbr0 down
[root@bigdata102 fe]# brctl delbr virbr0

3.禁用開機(jī)服務(wù)

[root@bigdata102 fe]# systemctl disable libvirtd.service
Removed symlink /etc/systemd/system/multi-user.target.wants/libvirtd.service.
Removed symlink /etc/systemd/system/sockets.target.wants/virtlockd.socket.
Removed symlink /etc/systemd/system/sockets.target.wants/virtlogd.socket.
[root@bigdata102 fe]# systemctl mask libvirtd.service
Created symlink from /etc/systemd/system/libvirtd.service to /dev/null.

4.驗證

[root@bigdata102 fe]# ifconfig
eth0: flags=4163<UP,BROADCAST,RUNNING,MULTICAST>  mtu 1500
        inet 192.168.52.102  netmask 255.255.255.0  broadcast 192.168.52.255
        inet6 fe80::20c:29ff:fe0c:70c3  prefixlen 64  scopeid 0x20<link>
        ether 00:0c:29:0c:70:c3  txqueuelen 1000  (Ethernet)
        RX packets 3537713  bytes 2882108615 (2.6 GiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 2324374  bytes 539845246 (514.8 MiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

lo: flags=73<UP,LOOPBACK,RUNNING>  mtu 65536
        inet 127.0.0.1  netmask 255.0.0.0
        inet6 ::1  prefixlen 128  scopeid 0x10<host>
        loop  txqueuelen 1  (Local Loopback)
        RX packets 146302  bytes 11556762 (11.0 MiB)
        RX errors 0  dropped 0  overruns 0  frame 0
        TX packets 146302  bytes 11556762 (11.0 MiB)
        TX errors 0  dropped 0 overruns 0  carrier 0  collisions 0

再次重新部署B(yǎng)E節(jié)點，后查看前端節(jié)點IP顯示正常，后端節(jié)點內(nèi)存也不是0了：



建表也成功了：

mysql> use test;
Database changed
mysql> create table student_test(
    ->   name varchar(10),
    ->   age int
    -> )ENGINE=OLAP
    -> DISTRIBUTED BY HASH(`age`) BUCKETS 3
    -> ;
Query OK, 0 rows affected (0.09 sec)
最后編輯于 ：
?著作權(quán)歸作者所有,轉(zhuǎn)載或內(nèi)容合作請聯(lián)系作者
【社區(qū)內(nèi)容提示】社區(qū)部分內(nèi)容疑似由AI輔助生成，瀏覽時請結(jié)合常識與多方信息審慎甄別。
平臺聲明：文章內(nèi)容（如有圖片或視頻亦包括在內(nèi)）由作者上傳并發(fā)布，文章內(nèi)容僅代表作者本人觀點，簡書系信息發(fā)布平臺，僅提供信息存儲服務(wù)。

相關(guān)閱讀更多精彩內(nèi)容

友情鏈接更多精彩內(nèi)容