2017-12-08发表2024-08-29更新6 分钟读完 (大约965个字)

使用DaemonSet+Taint/Tolerations+NodeSelector部署Nginx ingress controller

使用DaemonSet+NodeSelector+Tolerations的方式定义Nginx Ingress Controller，给专门节点打上Label+Taint，使得这些专门节点只运行Nginx Ingress Controller，而不会调度和运行其他业务容器，只用来做代理节点。

在Kuberntes Cluster中准备N个节点，我们称之为代理节点。在这N个节点上只部署Nginx Ingress Controller（简称NIC）实例，不会跑其他业务容器。
给代理节点打上NoExecute Taint，防止业务容器调度或运行在这些节点。

kubectl taint nodes 10.8.8.234 LB=NIC:NoExecute
给代理节点打上Label，让NIC只部署在打了对应Lable的节点上。
kubectl label nodes 10.8.8.234 LB=NIC

修改calico-node配置，让calico可以在NoExecute节点上运行

    spec:
    ...
    spec:
      tolerations:
      - key: "LB"
        operator: "Exists"
        effect: "NoExecute"
    ```    

- 定义DaemonSet Yaml文件，注意加上Tolerations和Node Selector。(注意先创建serviceAccount、role等)

apiVersion: extensions/v1beta1
kind: DaemonSet
metadata:
annotations:

deployment.kubernetes.io/revision: "4"

labels:

k8s-app: nginx-ingress-controller

name: nginx-ingress-controller
namespace: kube-system
spec:
selector:

matchLabels:
k8s-app: nginx-ingress-controller

template:

metadata:
annotations:
    prometheus.io/port: "10254"
    prometheus.io/scrape: "true"
creationTimestamp: null
labels:
    k8s-app: nginx-ingress-controller
spec:
# 加上对应的Node Selector
nodeSelector:
    LB: NIC
# 加上对应的Tolerations
tolerations:
- key: "LB"
    operator: "Equal"
    value: "NIC"
    effect: "NoExecute"
containers:
- args:
    - /nginx-ingress-controller
    - --default-backend-service=$(POD_NAMESPACE)/default-http-backend
    - --tcp-services-configmap=$(POD_NAMESPACE)/nginx-tcp-ingress-configmap
    - --configmap=$(POD_NAMESPACE)/nginx-configuration
    env:
    - name: POD_NAME
    valueFrom:
        fieldRef:
        apiVersion: v1
        fieldPath: metadata.name
    - name: POD_NAMESPACE
    valueFrom:
        fieldRef:
        apiVersion: v1
        fieldPath: metadata.namespace
    image: dceph02.rmz.flamingo-inc.com:8888/mynginx/nginx-ingress-controller:0.9.0-beta.11
    imagePullPolicy: IfNotPresent
    livenessProbe:
    failureThreshold: 3
    httpGet:
        path: /healthz
        port: 10254
        scheme: HTTP
    initialDelaySeconds: 10
    periodSeconds: 10
    successThreshold: 1
    timeoutSeconds: 1
    name: nginx-ingress-controller
    ports:
    - containerPort: 80
    hostPort: 80
    protocol: TCP
    - containerPort: 443
    hostPort: 443
    protocol: TCP
    readinessProbe:
    failureThreshold: 3
    httpGet:
        path: /healthz
        port: 10254
        scheme: HTTP
    periodSeconds: 10
    successThreshold: 1
    timeoutSeconds: 1
    resources: {}
hostNetwork: true
serviceAccount: ingress
serviceAccountName: ingress
1
2
3
    
- 创建default backend服务

apiVersion: extensions/v1beta1
kind: Deployment
metadata:
name: default-http-backend
labels:

k8s-app: default-http-backend

namespace: kube-system
spec:
replicas: 1
template:

metadata:
labels:
    k8s-app: default-http-backend
spec:
terminationGracePeriodSeconds: 60
containers:
- name: default-http-backend
    # Any image is permissable as long as:
    # 1. It serves a 404 page at /
    # 2. It serves 200 on a /healthz endpoint
    image: gcr.io/google_containers/defaultbackend:1.0
    livenessProbe:
    httpGet:
        path: /healthz
        port: 8080
        scheme: HTTP
    initialDelaySeconds: 30
    timeoutSeconds: 5
    ports:
    - containerPort: 8080
    resources:
    limits:
        cpu: 10m
        memory: 20Mi
    requests:
        cpu: 10m
        memory: 20Mi

apiVersion: v1
kind: Service
metadata:
name: default-http-backend
namespace: kube-system
labels:

k8s-app: default-http-backend

spec:
ports:

port: 80
targetPort: 8080
selector:
k8s-app: default-http-backend

根据default-backend.yaml创建对应的Deployment和Service。 `kubectl create -f default-backend.yaml`

- 根据DaemonSet Yaml创建NIC DaemonSet，启动NIC。

    `kubectl create -f nginx-ingress-daemonset.yaml`

至此，NIC已经运行在代理节点上了，下面为测试内容。

- (选择性)确认NIC启动成功后，创建测试用的服务。

kubectl run echoheaders –image=gcr.io/google_containers/echoserver:1.8 –replicas=1 –port=8080
kubectl expose deployment echoheaders –port=80 –target-port=8080 –name=echoheaders-x
kubectl expose deployment echoheaders –port=80 –target-port=8080 –name=echoheaders-y

1 2	创建测试用的Ingress Object

apiVersion: extensions/v1beta1
kind: Ingress
metadata:
name: echomap
namespace: default
spec:
rules:

host: foo.bar.com
http:
paths:
- backend:
  serviceName: echoheaders-x
  servicePort: 80
  path: /foo
host: bar.baz.com
http:
paths:
- backend:
  serviceName: echoheaders-y
  servicePort: 80
  path: /bar
- backend:
  serviceName: echoheaders-x
  servicePort: 80
  path: /foo
  1
  2
  3
  
  - (选择性)查看ingress的代理地址
  [root@host ~]# kubectl describe ing echomap
  Name: echomap
  Namespace: default
  Address: 10.8.8.234
  Default backend: default-http-backend:80 (172.254.109.193:8080)
  Rules:
  Host Path Backends

foo.bar.com

/foo    echoheaders-x:80 (<none>)

bar.baz.com

/bar    echoheaders-y:80 (<none>)
/foo    echoheaders-x:80 (<none>)

Annotations:
Events:
FirstSeen LastSeen Count From SubObjectPath Type Reason Message

35m 35m 1 ingress-controller Normal CREATE Ingress default/echomap
35m 35m 1 ingress-controller Normal UPDATE Ingress default/echomap

1
2
3


- 测试

[root@host ~]# curl 10.8.8.234/foo -H ‘Host: foo.bar.com’

Hostname: echoheaders-1076692255-p1ndv
Pod Information:

-no pod information available-

Server values:

server_version=nginx: 1.13.3 - lua: 10008

Request Information:

client_address=172.254.246.192
method=GET
real path=/foo
query=
request_version=1.1
request_uri=http://foo.bar.com:8080/foo

Request Headers:

accept=*/*
connection=close
host=foo.bar.com
user-agent=curl/7.29.0
x-forwarded-for=10.8.8.234
x-forwarded-host=foo.bar.com
x-forwarded-port=80
x-forwarded-proto=http
x-original-uri=/foo
x-real-ip=10.8.8.234
x-scheme=http

Request Body:

-no body in request-

[root@dceph04 ~]# curl 10.8.8.234/foo -H ‘Host: bar.baz.com’

Hostname: echoheaders-1076692255-p1ndv
Pod Information:

-no pod information available-

Server values:

server_version=nginx: 1.13.3 - lua: 10008

Request Information:

client_address=172.254.246.192
method=GET
real path=/foo
query=
request_version=1.1
request_uri=http://bar.baz.com:8080/foo

Request Headers:

accept=*/*
connection=close
host=bar.baz.com
user-agent=curl/7.29.0
x-forwarded-for=10.8.8.234
x-forwarded-host=bar.baz.com
x-forwarded-port=80
x-forwarded-proto=http
x-original-uri=/foo
x-real-ip=10.8.8.234
x-scheme=http

Request Body:

-no body in request-

参考

https://my.oschina.net/jxcdwangtao/blog/1523812

2017-08-21发表2024-08-29更新Java / Python1 分钟读完 (大约185个字)

Java与Python安全转码链接

Java

String OriginUrl = "https://meijumao.cn/yunparse/index.php?url=//美剧/周一/GOT权游/S07/Online/02按时发达的十分.mp4~bdyun";
URL repoUrl = new URL(OriginUrl);
URI uri;
try {
    uri = new URI(repoUrl.getProtocol(), repoUrl.getUserInfo(), repoUrl.getHost(), repoUrl.getPort(), repoUrl.getPath(), repoUrl.getQuery(), repoUrl.getRef());
    System.out.println(uri.toASCIIString());
} catch (URISyntaxException e) {
}

Python

python3:

import string
import urllib.parse

url = "https://meijumao.cn/yunparse/index.php?url=//美剧/周一/GOT权游/S07/Online/02按时发达的十分.mp4~bdyun"
print(urllib.parse.quote(url,safe=string.printable))

python2:

import string
from urllib import quote

url = "https://meijumao.cn/yunparse/index.php?url=//美剧/周一/GOT权游/S07/Online/02按时发达的十分.mp4~bdyun"
print urllib.parse.quote(url,safe=string.printable)

结果 'https://meijumao.cn/yunparse/index.php?url=//%E7%BE%8E%E5%89%A7/%E5%91%A8%E4%B8%80/GOT%E6%9D%83%E6%B8%B8/S07/Online/02%E6%8C%89%E6%97%B6%E5%8F%91%E8%BE%BE%E7%9A%84%E5%8D%81%E5%88%86.mp4~bdyun

2017-06-02发表2024-08-29更新Java几秒读完 (大约55个字)

Java 解析json数组字符串为Java对象

套用罗锤子的话：这可能是最方便快捷的方式了

json字符串：

[{ "number" : "3",
  "title" : "hello_world"  
},
{ "number" : "2",
  "title" : "hello_world"  
}]

Java代码：

class Wrapper{
    int number;
    String title;       
}

Gson gson = new Gson();
Wrapper[] data = gson.fromJson(idcstring, Wrapper[].class);

2017-05-31发表2024-08-29更新几秒读完 (大约33个字)

awk 计算一列的和

awk '{sum += $10};END {print sum}'

例如想计算nginx日志中206下载总数据和，则用
cat xxx.access.log|grep " 206 " |awk '{sum += $10};END {print sum}'

2017-05-27发表2024-08-29更新1 分钟读完 (大约143个字)

Python一些模块安装方法记录

首先需要安装pip模块，如果yum中没有，则需要用 get-pip.py安装

sudo python get-pip.py 安装

web.py

sudo pip install web.py

mysql.connector

wget http://cdn.mysql.com/Downloads/Connector-Python/mysql-connector-python-1.0.11.zip 
unzip mysql-connector-python-1.0.11.zip 
cd mysql-connector-python-1.0.11  
sudo python setup.py install

pytds（连接mssql）

1 2	sudo pip install python-tds #sudo pip install bitarray

anjuke(中文转拼音)

sudo pip install pinyin4py

Python2.7安装

这样安装之后不会与之前的python2.6版本有冲突，3.x版本同理

wget https://www.python.org/ftp/python/2.7.8/Python-2.7.8.tgz
tar xf Python-2.7.8.tgz
cd Python-2.7.8
./configure --prefix=/usr/local
make && make install

2017-05-26发表2024-08-29更新1 分钟读完 (大约129个字)

安装RemixOS到PC

！一定要用UEFI方式启动，前提是64位的

下载镜像

https://www.fosshub.com/Remix-OS.html

刻录到U盘

解压之后有一个iso文件一个exe文件，推荐用ultraiso安装（用那个exe会把U盘分成三个区。。。有病吗？）

修改参数

U盘开机启动之后，选择”Resident/Guest mode”，按TAB键或e键，在命令最后添加”INSTALL=2”，删掉”USB_DATA_PARTITION=1”

接下来系统会安装到硬盘上。

2017-05-24发表2024-08-29更新几秒读完 (大约9个字)

随笔

我只是占个tag坑…😂

2017-05-24发表2024-08-29更新1 分钟读完 (大约221个字)

用Python抓取王垠的博客

直接上代码（由于他博客是异步的，所以我们要用mechanize）

#!/usr/bin/env python
# -*- coding: utf-8 -*-
'''
Created on 2017年5月24日

@author: BirdZhang
'''
from bs4 import BeautifulSoup
import mechanize
import cookielib
from wyblog import BLOG_URL

class NoHistory(object): 
    def add(self, *a, **k): pass 
    def clear(self): pass 

def getBrowers():
    br = mechanize.Browser(history=NoHistory())
    #options
    br.set_handle_equiv(True)
    #br.set_handle_gzip(True)
    br.set_handle_redirect(True)
    br.set_handle_referer(True)
    br.set_handle_robots(False)
    cj = cookielib.LWPCookieJar()  
    br.set_cookiejar(cj)##关联cookies  
    br.set_handle_refresh(mechanize._http.HTTPRefreshProcessor(), max_time=1)
    br.set_debug_http(False)
    br.set_debug_redirects(False)
    br.set_debug_responses(False)
    br.addheaders = [("User-agent","Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/55.0.2883.87 Safari/537.36")]
    return br


if __name__ == "__main__":
    br = getBrowers()
    r = br.open(BLOG_URL)
    html = r.read()
#     print html
    soup = BeautifulSoup(html,"html5lib")
    lis = soup.find_all(name='li',attrs={
                                               "class":"list-group-item title"
                                               })
    for i in lis:
        print i.a["href"]," ".join(i.a.contents)

剩下的自己该干嘛干嘛吧

后面干脆撸了一个旗鱼的客户端

https://github.com/0312birdzhang/harbour-blogofwy

2017-05-22发表2024-08-29更新几秒读完 (大约102个字)

最靠谱的Tomcat日志切割教程

强大的logrotate

更多logrotate的说明见 http://www.linuxcommand.org/man_pages/logrotate8.html

或者这里 https://linux.cn/article-4126-1.html

在/etc/logrotate.d/tomcat里写入下面的内容

/data/logs/logpath/catalina-daemon.out {
        daily
        rotate 3
        size 100M
        nocompress
        notifempty
        missingok
        copytruncate
        create 0600 root root
}

测试

logrotate --force /etc/logrotate.d/tomcat.conf

查看是否有一个/data/logs/logpath/catalina-daemon.out.1生成

为什么不用cronolog?

很简单，cronolog对jsvc启动的tomcat不友好

2017-05-19发表2024-08-29更新Irc几秒读完 (大约12个字)

irc 加回频道op

用以下命令：

/cs op #jolla-cn +o birdzhang