Skip to content

Latest commit

 

History

History
 
 

alvistack-ansible-collection-kubernetes

Folders and files

NameName
Last commit message
Last commit date

parent directory

..
PRODUCT.yaml
PRODUCT.yaml
 
 
README.md
README.md
 
 
e2e.log
e2e.log
 
 
junit_01.xml
junit_01.xml
 
 

README.md

AlviStack - Ansible Collection for Kubernetes

For running k8s conformance test we need 2 vagrant instances as master and 1 vagrant instance as node with following minimal system requirement, e.g.

  • host
    • libvirt
    • nested virtualization enabled
    • Ubuntu 24.04
    • 8 CPUs
    • 32GB RAM
  • kube01
    • kubernetes master, etcd
    • cri-o, flannel
    • Ubuntu 24.04
    • IP: 192.168.121.101/24
    • 2 CPUs
    • 8GB RAM
  • kube02
    • kubernetes master, etcd
    • cri-o, flannel
    • Ubuntu 24.04
    • IP: 192.168.121.102/24
    • 2 CPUs
    • 8GB RAM
  • kube03
    • kubernetes node, etcd
    • cri-o, flannel
    • Ubuntu 24.04
    • IP: 192.168.121.103/24
    • 2 CPUs
    • 8GB RAM

Bootstrap Host

Install some basic pacakges for host:

apt update
apt full-upgrade
apt install -y aptitude git linux-generic-hwe-24.04 openssh-server python3 pwgen rsync vim

Install Libvirt:

apt update
apt install -y binutils bridge-utils dnsmasq-base ebtables gcc libarchive-tools libguestfs-tools libvirt-clients libvirt-daemon-system libvirt-dev make qemu-system qemu-utils ruby-dev virt-manager

Install Vagrant:

echo "deb http:https://downloadcontent.opensuse.org/repositories/home:/alvistack/xUbuntu_24.04/ /" | tee /etc/apt/sources.list.d/home:alvistack.list
curl -fsSL https://downloadcontent.opensuse.org/repositories/home:alvistack/xUbuntu_24.04/Release.key | gpg --dearmor | tee /etc/apt/trusted.gpg.d/home_alvistack.gpg > /dev/null
apt-get update
apt-get install -y vagrant
vagrant plugin install vagrant-libvirt

Bootstrap Ansible

Install Ansible (see https://software.opensuse.org/download/package?package=ansible&project=home%3Aalvistack):

echo "deb http:https://downloadcontent.opensuse.org/repositories/home:/alvistack/xUbuntu_24.04/ /" | tee /etc/apt/sources.list.d/home:alvistack.list
curl -fsSL https://downloadcontent.opensuse.org/repositories/home:alvistack/xUbuntu_24.04/Release.key | gpg --dearmor | tee /etc/apt/trusted.gpg.d/home_alvistack.gpg > /dev/null
apt-get update
apt-get install -y ansible ansible-lint python3-docker python3-netaddr python3-vagrant

Install Molecule:

echo "deb http:https://downloadcontent.opensuse.org/repositories/home:/alvistack/xUbuntu_24.04/ /" | tee /etc/apt/sources.list.d/home:alvistack.list
curl -fsSL https://downloadcontent.opensuse.org/repositories/home:alvistack/xUbuntu_24.04/Release.key | gpg --dearmor | tee /etc/apt/trusted.gpg.d/home_alvistack.gpg > /dev/null
apt-get update
apt-get install -y python3-molecule python3-molecule-plugins

GIT clone Ansible Collection for Kubernetes (https://github.com/alvistack/ansible-collection-kubernetes):

mkdir -p /opt/ansible-collection-kubernetes
cd /opt/ansible-collection-kubernetes
git init
git remote add upstream https://github.com/alvistack/ansible-collection-kubernetes.git
git fetch --all --prune
git checkout upstream/develop -- .
git submodule sync --recursive
git submodule update --init --recursive

Deploy Kubernetes

Deploy kubernetes:

cd /opt/ansible-collection-kubernetes
export _MOLECULE_INSTANCE_NAME="$(pwgen -1AB 12)"
molecule converge -s ubuntu-24.04-libvirt -- -e 'kube_release=1.29'
molecule verify -s ubuntu-24.04-libvirt

All instances could be SSH and switch as root with sudo su -, e.g.

cd /opt/ansible-collection-kubernetes
molecule login -s ubuntu-24.04-libvirt -h $_MOLECULE_INSTANCE_NAME-1

Check result:

root@kube01:~# kubectl get node
NAME     STATUS   ROLES           AGE    VERSION
kube01   Ready    control-plane   179m   v1.29.4
kube02   Ready    control-plane   178m   v1.29.4
kube03   Ready    <none>          178m   v1.29.4

root@kube01:~# kubectl get pod --all-namespaces
NAMESPACE     NAME                             READY   STATUS    RESTARTS   AGE
kube-system   coredns-76f75df574-4529k         1/1     Running   1          3h
kube-system   coredns-76f75df574-kjr7r         1/1     Running   1          3h
kube-system   kube-addon-manager-kube01        1/1     Running   1          177m
kube-system   kube-addon-manager-kube02        1/1     Running   1          177m
kube-system   kube-apiserver-kube01            1/1     Running   1          3h
kube-system   kube-apiserver-kube02            1/1     Running   1          179m
kube-system   kube-controller-manager-kube01   1/1     Running   1          3h
kube-system   kube-controller-manager-kube02   1/1     Running   1          179m
kube-system   kube-flannel-ds-qldcz            1/1     Running   1          177m
kube-system   kube-flannel-ds-rlbz6            1/1     Running   0          58m
kube-system   kube-flannel-ds-znfxv            1/1     Running   1          177m
kube-system   kube-proxy-lh685                 1/1     Running   1          179m
kube-system   kube-proxy-q4vm6                 1/1     Running   1          179m
kube-system   kube-proxy-wp7g9                 1/1     Running   1          3h
kube-system   kube-scheduler-kube01            1/1     Running   1          3h
kube-system   kube-scheduler-kube02            1/1     Running   1          179m

Run Sonobuoy

Run sonobuoy for conformance test as official procedure (https://github.com/cncf/k8s-conformance/blob/master/instructions.md):

root@kube01:~# sonobuoy run --mode=certified-conformance --plugin-env=e2e.E2E_EXTRA_ARGS="--non-blocking-taints=node-role.kubernetes.io/controller --ginkgo.v"

root@kube01:~# sonobuoy status

root@kube01:~# sonobuoy retrieve