成人99黄色,黄色亲热激情四射av

openshiftcalico

Openshift網(wǎng)絡(luò)方案選擇

大家都知道K8S在網(wǎng)絡(luò)插件選擇上有很多種，默認(rèn)的是Flannel，但是它的性能一般，互聯(lián)網(wǎng)中使用最多的是Calico BGP，因?yàn)樗男阅芊浅：谩?/li>
而對(duì)于Openshift，官方只支持ovs一種網(wǎng)絡(luò)方案，同時(shí)RedHat也表示ovs在Openshift平臺(tái)上運(yùn)行是最合適的。但是ovs的網(wǎng)絡(luò)性能怎樣呢？因?yàn)閛vs方案對(duì)數(shù)據(jù)需要進(jìn)行加包，解包的過(guò)程，性能肯定是會(huì)受影響的。同時(shí)經(jīng)過(guò)實(shí)測(cè)，在萬(wàn)兆網(wǎng)絡(luò)中的損耗近50%，雖然在絕大部分場(chǎng)景下ovs已經(jīng)夠用了，但是但是跟幾乎無(wú)損耗的Calico BGP比起來(lái)還是遜色不少。
很慶幸，Openshift雖然官方不作Calico網(wǎng)絡(luò)方案的支持，但還是很體貼地把它加入到了Openshift的安裝腳本中，從而讓大家都能方便地使用Calico網(wǎng)絡(luò)方案，包括IPIP及BGP方案。

安裝步驟

在ansible hosts中設(shè)置關(guān)閉openshift默認(rèn)的sdn方案，開啟calico方案
/etc/ansible/hosts

[OSEv3:vars]
os_sdn_network_plugin_name=cni
openshift_use_calico=true
openshift_use_openshift_sdn=false

設(shè)置Calico網(wǎng)絡(luò)配置
openshift-ansible/roles/calico/defaults/main.yaml

calico_ip_autodetection_method: "first-found"
ip_pools:
  apiVersion: projectcalico.org/v3
  kind: IPPoolList
  items:
  - apiVersion: projectcalico.org/v3
    kind: IPPool
    metadata:
      name: default-ipv4-ippool
    spec:
      cidr: "{{ openshift_cluster_network_cidr }}"
      ipipMode: Always  #默認(rèn)是為Always，為IPIP模式
      natOutgoing: true
      nodeSelector: "all()"

配置說(shuō)明（正確開啟calico bgp網(wǎng)絡(luò)的關(guān)鍵）：
calico_ip_autodetection_method

calico_ip_autodetection_method: "interface=eth0"
# 默認(rèn)為“first-found”，如果各主機(jī)網(wǎng)絡(luò)設(shè)備名不一樣，可以使用正則
# calico_ip_autodetection_method: "interface=(eth0|eth1)"

spec.ipipMode

ipipMode: Always  #默認(rèn)是為Always，為IPIP模式；Never為開啟BGP模式

完整配置

---
cni_conf_dir: "/etc/cni/net.d/"
cni_bin_dir: "/opt/cni/bin/"

calico_url_policy_controller: "quay.io/calico/kube-controllers:v3.5.0"
calico_node_image: "quay.io/calico/node:v3.5.0"
calico_cni_image: "quay.io/calico/cni:v3.5.0"
calicoctl_image: "quay.io/calico/ctl:v3.5.0"
calico_upgrade_image: "quay.io/calico/upgrade:v1.0.5"
calico_ip_autodetection_method: "interface=eth0"
# 默認(rèn)為“first-found”，如果各主機(jī)網(wǎng)絡(luò)設(shè)備名不一樣，可以使用正則
# calico_ip_autodetection_method: "interface=(eth0|eth1)"
use_calico_etcd: False

# Configure the IP Pool(s) from which Pod IPs will be chosen.
ip_pools:
  apiVersion: projectcalico.org/v3
  kind: IPPoolList
  items:
  - apiVersion: projectcalico.org/v3
    kind: IPPool
    metadata:
      name: default-ipv4-ippool
    spec:
      cidr: "{{ openshift_cluster_network_cidr }}"
      ipipMode: Never #默認(rèn)是為Always，為IPIP模式；Never為開啟BGP模式
      natOutgoing: true
      nodeSelector: "all()"

# Options below are only valid for legacy Calico v2 installations,
# and have been superceded by options above for Calico v3.
calico_ipv4pool_ipip: "always"

正常執(zhí)行Openshift安裝腳本

$ ansible-playbook playbooks/prerequisites.yml
$ ansible-playbook playbooks/deploy_cluster.yml

查看網(wǎng)絡(luò)

[root@master1 ~]# ip a
1: lo: <LOOPBACK,UP,LOWER_UP> mtu 65536 qdisc noqueue state UNKNOWN qlen 1
    link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00
    inet 127.0.0.1/8 scope host lo
       valid_lft forever preferred_lft forever
    inet6 ::1/128 scope host 
       valid_lft forever preferred_lft forever
2: eth0: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc pfifo_fast state UP qlen 1000
    link/ether 52:54:fc:dd:fc:ed brd ff:ff:ff:ff:ff:ff
    inet 192.168.0.3/24 brd 192.168.0.255 scope global dynamic eth0
       valid_lft 86262sec preferred_lft 86262sec
    inet6 fe80::248:584e:2626:2269/64 scope link 
       valid_lft forever preferred_lft forever
3: docker0: <NO-CARRIER,BROADCAST,MULTICAST,UP> mtu 1500 qdisc noqueue state DOWN 
    link/ether 02:42:46:89:5d:d0 brd ff:ff:ff:ff:ff:ff
    inet 172.17.0.1/16 scope global docker0
       valid_lft forever preferred_lft forever
4: cali252a8913dc3@if3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP 
    link/ether ee:ee:ee:ee:ee:ee brd ff:ff:ff:ff:ff:ff link-netnsid 0
    inet6 fe80::ecee:eeff:feee:eeee/64 scope link 
       valid_lft forever preferred_lft forever
5: cali6d8bb449db0@if3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP 
    link/ether ee:ee:ee:ee:ee:ee brd ff:ff:ff:ff:ff:ff link-netnsid 1
    inet6 fe80::ecee:eeff:feee:eeee/64 scope link 
       valid_lft forever preferred_lft forever
6: cali9efe4d704f6@if3: <BROADCAST,MULTICAST,UP,LOWER_UP> mtu 1500 qdisc noqueue state UP 
    link/ether ee:ee:ee:ee:ee:ee brd ff:ff:ff:ff:ff:ff link-netnsid 2
    inet6 fe80::ecee:eeff:feee:eeee/64 scope link 
       valid_lft forever preferred_lft forever

[root@master1 ~]# ip route
default via 192.168.0.1 dev eth0 proto static metric 100 
10.128.113.64/26 via 192.168.0.7 dev eth0 proto bird 
10.128.141.128/26 via 192.168.0.4 dev eth0 proto bird 
10.129.8.0/26 via 192.168.0.9 dev eth0 proto bird 
10.129.182.192/26 via 192.168.0.8 dev eth0 proto bird 
10.129.200.0/26 via 192.168.0.6 dev eth0 proto bird 
10.130.193.128/26 via 192.168.0.10 dev eth0 proto bird 
blackhole 10.131.9.192/26 proto bird 
10.131.9.206 dev cali252a8913dc3 scope link 
10.131.9.207 dev cali6d8bb449db0 scope link 
10.131.9.208 dev cali9efe4d704f6 scope link 
10.131.42.192/26 via 192.168.0.11 dev eth0 proto bird 
10.131.148.0/26 via 192.168.0.5 dev eth0 proto bird 
172.17.0.0/16 dev docker0 proto kernel scope link src 172.17.0.1 
192.168.0.0/24 dev eth0 proto kernel scope link src 192.168.0.3 metric 100

說(shuō)明：如果要部署路由反射（RR）模式，可參考OpenShift支持Calico BGP 路由反射（RR）模式

網(wǎng)絡(luò)性能測(cè)試

測(cè)試環(huán)境為公有云平臺(tái)上的虛擬機(jī)

iperf測(cè)試Pod吞吐量

測(cè)試方法與步驟

部署iperf服務(wù)端

$ oc new-project test
$ oc run iperf-server --image=registry.dcs.cmbchina.cn:9443/tools/iperf3 -- -s
$ oc get pod -o wide
NAME                   READY     STATUS    RESTARTS   AGE       IP            NODE
iperf-server-1-r6z2x   1/1       Running   0          3m        10.131.2.76  node1

部署iperf客戶端

$ oc run iperf-client --image=registry.dcs.cmbchina.cn:9443/tools/iperf3 -n project-e --command -- sleep 10000
$ oc get pod -o wide | grep qperf
NAME                   READY     STATUS    RESTARTS   AGE       IP            NODE
iperf-client-3-gtr2l   1/1       Running   0          2h        10.130.0.70   node2
qperf-server-1-xxmhz   1/1       Running   0          4h        10.128.2.59    node1

iperf3客戶端測(cè)試iperf3(pod)吞吐量

$ oc rsh iperf-client-3-gtr2l
  $ iperf3 -c 10.131.2.76

測(cè)試結(jié)果

ovs網(wǎng)絡(luò)方案測(cè)試結(jié)果

Connecting to host 10.130.0.51, port 5201
[  4] local 10.129.0.50 port 42924 connected to 10.130.0.51 port 5201
[ ID] Interval           Transfer     Bandwidth       Retr  Cwnd
[  4]   0.00-1.00   sec   282 MBytes  2.36 Gbits/sec  1406    638 KBytes       
[  4]   1.00-2.00   sec   326 MBytes  2.74 Gbits/sec  2484    797 KBytes       
[  4]   2.00-3.00   sec   324 MBytes  2.71 Gbits/sec  2136    692 KBytes       
[  4]   3.00-4.00   sec   314 MBytes  2.63 Gbits/sec  3907    744 KBytes       
[  4]   4.00-5.00   sec   323 MBytes  2.71 Gbits/sec  1539    811 KBytes       
[  4]   5.00-6.00   sec   323 MBytes  2.71 Gbits/sec  1996    685 KBytes       
[  4]   6.00-7.00   sec   318 MBytes  2.67 Gbits/sec  1085    891 KBytes       
[  4]   7.00-8.00   sec   286 MBytes  2.40 Gbits/sec  2534    744 KBytes       
[  4]   8.00-9.00   sec   336 MBytes  2.82 Gbits/sec  1856    793 KBytes       
[  4]   9.00-10.00  sec   256 MBytes  2.14 Gbits/sec  2256    452 KBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec  3.01 GBytes  2.59 Gbits/sec  21199             sender
[  4]   0.00-10.00  sec  3.01 GBytes  2.59 Gbits/sec                  receiver

iperf Done.

calico bgp網(wǎng)絡(luò)方案測(cè)試結(jié)果

Connecting to host 10.129.8.3, port 5201
[  4] local 10.130.193.131 port 46222 connected to 10.129.8.3 port 5201
[ ID] Interval           Transfer     Bandwidth       Retr  Cwnd
[  4]   0.00-1.00   sec   735 MBytes  6.17 Gbits/sec  204    655 KBytes       
[  4]   1.00-2.00   sec   914 MBytes  7.67 Gbits/sec  353    818 KBytes       
[  4]   2.00-3.00   sec  1.01 GBytes  8.70 Gbits/sec    0   1.44 MBytes       
[  4]   3.00-4.00   sec  1.02 GBytes  8.76 Gbits/sec  465   1.87 MBytes       
[  4]   4.00-5.00   sec  1.02 GBytes  8.79 Gbits/sec  184   2.20 MBytes       
[  4]   5.00-6.00   sec  1.03 GBytes  8.81 Gbits/sec  596   1.33 MBytes       
[  4]   6.00-7.00   sec  1012 MBytes  8.49 Gbits/sec   17   1.28 MBytes       
[  4]   7.00-8.00   sec  1.02 GBytes  8.79 Gbits/sec   46   1.31 MBytes       
[  4]   8.00-9.00   sec  1.01 GBytes  8.69 Gbits/sec   87   1.26 MBytes       
[  4]   9.00-10.00  sec  1.02 GBytes  8.73 Gbits/sec  133   1.21 MBytes       
- - - - - - - - - - - - - - - - - - - - - - - - -
[ ID] Interval           Transfer     Bandwidth       Retr
[  4]   0.00-10.00  sec  9.73 GBytes  8.36 Gbits/sec  2085             sender
[  4]   0.00-10.00  sec  9.73 GBytes  8.36 Gbits/sec                  receiver

iperf Done.

網(wǎng)絡(luò)方案	傳輸數(shù)據(jù)量	傳輸速率
ovs方案	3.01 GB	2.59 Gb
calico bgp方案	9.73 GB	8.36 Gb

qperf測(cè)試網(wǎng)絡(luò)帶寬與延時(shí)

測(cè)試方法與步驟

部署qperf服務(wù)端

$ oc run qperf-server --image=registry.dcs.cmbchina.cn:9443/tools/qperf
$ oc get pod -o wide
NAME                   READY     STATUS    RESTARTS   AGE       IP            NODE
qperf-server-1-xxmhz   1/1       Running   0          4h        10.128.2.59    ?node1

部署qperf客戶端

$ oc run qperf-client --image=registry.dcs.cmbchina.cn:9443/tools/qperf --command -- sleep 10000
$ oc get pod -o wide -n project-e | grep qperf
NAME                   READY     STATUS    RESTARTS   AGE       IP            NODE
qperf-client-2-7jmvb   1/1       Running   0          4h        10.130.2.224   node2
qperf-server-1-xxmhz   1/1       Running   0          4h        10.128.2.59    node1

qperf客戶端測(cè)試qperf(pod)帶寬與延時(shí)

$ oc rsh qperf-client-2-7jmvb
  $ qperf 10.128.2.59 -t 10 -oo msg_size:8:256K:*2 tcp_bw tcp_lat

測(cè)試結(jié)果

ovs網(wǎng)絡(luò)方案qperf測(cè)試結(jié)果

tcp_bw:
    bw  =  15 MB/sec
tcp_bw:
    bw  =  26.4 MB/sec
tcp_bw:
    bw  =  40.7 MB/sec
tcp_bw:
    bw  =  59.5 MB/sec
tcp_bw:
    bw  =  76.1 MB/sec
tcp_bw:
    bw  =  194 MB/sec
tcp_bw:
    bw  =  239 MB/sec
tcp_bw:
    bw  =  256 MB/sec
tcp_bw:
    bw  =  258 MB/sec
tcp_bw:
    bw  =  262 MB/sec
tcp_bw:
    bw  =  259 MB/sec
tcp_bw:
    bw  =  250 MB/sec
tcp_bw:
    bw  =  272 MB/sec
tcp_bw:
    bw  =  291 MB/sec
tcp_bw:
    bw  =  272 MB/sec
tcp_bw:
    bw  =  282 MB/sec
tcp_lat:
    latency  =  34.2 us
tcp_lat:
    latency  =  34.3 us
tcp_lat:
    latency  =  33.9 us
tcp_lat:
    latency  =  33.4 us
tcp_lat:
    latency  =  34.1 us
tcp_lat:
    latency  =  34.1 us
tcp_lat:
    latency  =  34.2 us
tcp_lat:
    latency  =  34.8 us
tcp_lat:
    latency  =  46.3 us
tcp_lat:
    latency  =  56 us
tcp_lat:
    latency  =  86.5 us
tcp_lat:
    latency  =  133 us
tcp_lat:
    latency  =  219 us
tcp_lat:
    latency  =  435 us
tcp_lat:
    latency  =  733 us
tcp_lat:
    latency  =  1.27 ms

calico bgp網(wǎng)絡(luò)方案qperf測(cè)試結(jié)果

tcp_bw:
    bw  =  17 MB/sec
tcp_bw:
    bw  =  32.1 MB/sec
tcp_bw:
    bw  =  39.4 MB/sec
tcp_bw:
    bw  =  81.7 MB/sec
tcp_bw:
    bw  =  141 MB/sec
tcp_bw:
    bw  =  297 MB/sec
tcp_bw:
    bw  =  703 MB/sec
tcp_bw:
    bw  =  790 MB/sec
tcp_bw:
    bw  =  845 MB/sec
tcp_bw:
    bw  =  708 MB/sec
tcp_bw:
    bw  =  830 MB/sec
tcp_bw:
    bw  =  884 MB/sec
tcp_bw:
    bw  =  768 MB/sec
tcp_bw:
    bw  =  787 MB/sec
tcp_bw:
    bw  =  749 MB/sec
tcp_bw:
    bw  =  780 MB/sec
tcp_lat:
    latency  =  95.8 us
tcp_lat:
    latency  =  71.5 us
tcp_lat:
    latency  =  69.1 us
tcp_lat:
    latency  =  69.6 us
tcp_lat:
    latency  =  72.7 us
tcp_lat:
    latency  =  84 us
tcp_lat:
    latency  =  93.3 us
tcp_lat:
    latency  =  86.3 us
tcp_lat:
    latency  =  145 us
tcp_lat:
    latency  =  139 us
tcp_lat:
    latency  =  158 us
tcp_lat:
    latency  =  171 us
tcp_lat:
    latency  =  198 us
tcp_lat:
    latency  =  459 us
tcp_lat:
    latency  =  593 us
tcp_lat:
    latency  =  881 us

包大小	ovs方案帶寬	calico bgp方案帶寬	ovs方案時(shí)延	calico bgp方案時(shí)延
msg_size	ovs tcp_bw	calico bgp tcp_bw	ovs tcp_lat	calico bgp tcp_lat
8bytes	15 MB/sec	17 MB/sec	34.2 us	95.8 us
16bytes	26.4 MB/sec	32.1 MB/sec	34.4 us	71.5 us
32bytes	40.7 MB/sec	39.4 MB/sec	33.9 us	69.1 us
64bytes	59.5MB/sec	81.7 MB/sec	33.4 us	69.6 us
128bytes	76.1 MB/sec	141 MB/sec	34.1 us	72.7 us
256bytes	194 MB/sec	297 MB/sec	34.1 us	84 us
512bytes	239 MB/sec	703 MB/sec	34.2 us	93.3 us
1KiB	256 MB/sec	790 MB/sec	34.8 us	86.3 us
2KiB	258 MB/sec	845 MB/sec	46.3 us	145 us
4KiB	262 MB/sec	708 MB/sec	56 us	139 us
8KiB	259 MB/sec	830 MB/sec	86.5 us	158 us
16KiB	250 MB/sec	884 MB/sec	133 us	171 us
32KiB	272 MB/sec	768 MB/sec	219 us	198 us
64KiB	291 MB/sec	787 MB/sec	435 us	459 us
128KiB	272 MB/sec	749 MB/sec	733 us	593 us
256KiB	282 MB/sec	780 MB/sec	1.27 ms	881 us

結(jié)果總結(jié)

從測(cè)試的數(shù)據(jù)中可以看到對(duì)于小包傳輸，Calico BGP的優(yōu)勢(shì)并不明顯，同時(shí)它的網(wǎng)絡(luò)延時(shí)甚至?xí)?而對(duì)于大包傳輸，Calico BGP網(wǎng)絡(luò)方案明顯好于ovs方案。

歡迎關(guān)注

文章已結(jié)束，以下并沒有內(nèi)容了。

色偷偷精品伊人,欧洲久久精品,欧美综合婷婷骚逼,国产AV主播,国产最新探花在线,九色在线视频一区,伊人大交九欧美,1769亚洲,黄色成人av

Openshift開啟Calico BGP 與 OVS性能PK

Openshift開啟Calico BGP 與 OVS性能PK

Openshift網(wǎng)絡(luò)方案選擇

安裝步驟

網(wǎng)絡(luò)性能測(cè)試

iperf測(cè)試Pod吞吐量

測(cè)試方法與步驟

測(cè)試結(jié)果

qperf測(cè)試網(wǎng)絡(luò)帶寬與延時(shí)

測(cè)試方法與步驟

測(cè)試結(jié)果

結(jié)果總結(jié)

相關(guān)閱讀更多精彩內(nèi)容

友情鏈接更多精彩內(nèi)容

色偷偷精品伊人,欧洲久久精品,欧美综合婷婷骚逼,国产AV主播,国产最新探花在线,九色在线视频一区,伊人大交九 欧美,1769亚洲,黄色成人av

Openshift開啟Calico BGP 與 OVS性能PK

Openshift網(wǎng)絡(luò)方案選擇

安裝步驟

網(wǎng)絡(luò)性能測(cè)試

iperf測(cè)試Pod吞吐量

測(cè)試方法與步驟

測(cè)試結(jié)果

qperf測(cè)試網(wǎng)絡(luò)帶寬與延時(shí)

測(cè)試方法與步驟

測(cè)試結(jié)果

結(jié)果總結(jié)

相關(guān)閱讀更多精彩內(nèi)容

友情鏈接更多精彩內(nèi)容

色偷偷精品伊人,欧洲久久精品,欧美综合婷婷骚逼,国产AV主播,国产最新探花在线,九色在线视频一区,伊人大交九欧美,1769亚洲,黄色成人av