sakananote: 三大雲平台工具容器升級小記

三大雲平台工具容器升級小記 - ansible 2.10.3 與 Azure module

OS: container with openSUSE Leap 15.2

https://hub.docker.com/r/sakana/ansible_opensuse152

上次升級是 2020/11/14 , 這次會來升級的原因是

Ansible 在 2.10 以後的版本, 有很多 module 被移動到 Ansible Collections, 也就是說現在不是如同 Ansible 官網上面的 pip3 install ‘ansible[azure]’ 的安裝方式. 接下來就是透過 collection 方式來進行安裝

這樣也是好事, 之前也是因為這樣報了一個 issue

https://github.com/Azure/azure-cli/issues/13209#issuecomment-725803465

然後也同步紀錄一下目前 Azure CloudShell 上面的 Ansible 資訊

Ansible: 2.9.11 / python 2.7
但是目前已經出現 Python 2 is no longer support by the Python core team 訊息了

先整理結果

升級前

OS: openSUSE Leap 15.2

awscli: aws-cli/2.1.1 Python/3.7.3

gcloud: Google Cloud SDK 318.0.0

azure-cli: 2.14.2

ansible: 2.10.3

升級後

OS: openSUSE Leap 15.2

awscli: aws-cli/2.1.4 Python/3.7.3

gcloud: Google Cloud SDK 319.0.0

azure-cli: 2.15.1 (目前有 bug)

ansible: 2.10.3

AWS CLI v2 安裝文件

https://docs.aws.amazon.com/zh_tw/cli/latest/userguide/install-cliv2-linux.html

GCP Cloud SDK 版本

https://cloud.google.com/sdk/docs/downloads-versioned-archives?hl=zh-tw

這次的做法還是會透過 docker build 指令來進行

我有比較過 docker build 以及使用現有的 docker image 修改後再使用 docker commit 建立的 image 大小還是很有差異的

Dockerfile 的部分我是拿之前 openSUSE Leap 15.2 來修改

檔案在 Github 上面

https://github.com/sakanamax/SA_dockerReading/tree/master/Dockerfile/ansible

修改細節

Update time
修改 pip3 安裝 ansible
修改安裝 ansible azure module 方式, 使用 collection 方式安裝
Google SDK 版本還有下載的檔案路徑以及檔案名稱

列出 diff 的結果給大家參考

> diff opensuseLeap152_ansible_202001129_Dockerfile opensuseLeap151_ansible_20201114_Dockerfile

6c6

< # update: 20201129

---

> # update: 20201114

12c12

< # Install python3-pip, upgrade pip, ansible, boto, boto3

---

> # Install python3-pip, upgrade pip, ansible[azure], boto, boto3

15c15

< pip3 install ansible && \

---

> pip3 install ansible[azure] && \

43d42

< # 2020/11/29 Still have az login issue in Github https://github.com/Azure/azure-cli/issues/13209

49,58d47

< # Install Ansible azure module

< # After ansible 2.10, some module move to ansible collect, change install method

< RUN zypper install -y curl && \

< curl -O https://raw.githubusercontent.com/ansible-collections/azure/dev/requirements-azure.txt && \

< pip3 install -r requirements-azure.txt && \

< rm -f requirements-azure.txt && \

< ansible-galaxy collection install azure.azcollection

75c64

< # Install google cloud SDK 319.0.0

---

> # Install google cloud SDK 318.0.0

77,78c66,67

< RUN wget https://dl.google.com/dl/cloudsdk/channels/rapid/downloads/google-cloud-sdk-319.0.0-linux-x86_64.tar.gz && \

< tar zxvf google-cloud-sdk-319.0.0-linux-x86_64.tar.gz && \

---

> RUN wget https://dl.google.com/dl/cloudsdk/channels/rapid/downloads/google-cloud-sdk-318.0.0-linux-x86_64.tar.gz && \

Dockerfile 內容如下

我檔案的名稱取名爲 opensuseLeap152_ansible_20201129_Dockerfile
https://github.com/sakanamax/SA_dockerReading/blob/master/Dockerfile/ansible/opensuseLeap152_ansible_20201129_Dockerfile

# openSUSE Leap 15.2 with ansible, azure-cli, aws cli, gcloud

FROM opensuse/leap:15.2

# Author

# MAINTAINER 已經棄用, 之後要使用 LABEL 方式

# update: 20201129

LABEL maintainer="sakana@cycu.org.tw"

# Set LANG for UTF-8 - for Chinese

ENV LANG C.UTF-8

# Install python3-pip, upgrade pip, ansible, boto, boto3

RUN zypper install -y python3-pip && \

pip3 install --upgrade pip && \

pip3 install ansible && \

pip3 install boto boto3

# Install openssh, set ls alias

RUN zypper install -y openssh

RUN echo "alias ls='ls --color=tty'" >> /root/.bashrc

# Install wget, download azure_rm.py, set permission

RUN zypper install -y wget

# azure_rm.py no need to download

# Starting with Ansible 2.8, Ansible provides an Azure dynamic-inventory plug-in

# https://docs.ansible.com/ansible/latest/plugins/inventory/azure_rm.html

# old azure_rm.py URL https://raw.githubusercontent.com/ansible/ansible/devel/contrib/inventory/azure_rm.py

# Create working directory in /root

RUN mkdir /root/.azure && \

mkdir /root/.aws && \

mkdir /root/playbook && \

mkdir -p /root/.config/gcloud && \

wget https://raw.githubusercontent.com/sakanamax/LearnAnsible/master/template/ansible.cfg && \

mv /ansible.cfg /root && \

wget https://raw.githubusercontent.com/sakanamax/LearnAnsible/master/template/hosts && \

mv /hosts /root

#### Azure ####

# Install azure-cli

# 2020/11/29 Still have az login issue in Github https://github.com/Azure/azure-cli/issues/13209

RUN zypper install -y curl && \

rpm --import https://packages.microsoft.com/keys/microsoft.asc && \

zypper addrepo --name 'Azure CLI' --check https://packages.microsoft.com/yumrepos/azure-cli azure-cli && \

zypper install --from azure-cli -y azure-cli

# Install Ansible azure module

# After ansible 2.10, some module move to ansible collect, change install method

RUN zypper install -y curl && \

curl -O https://raw.githubusercontent.com/ansible-collections/azure/dev/requirements-azure.txt && \

pip3 install -r requirements-azure.txt && \

rm -f requirements-azure.txt && \

ansible-galaxy collection install azure.azcollection

#install vim tar gzip jq unzip less bind-utils iputils groff

RUN zypper install -y vim tar gzip jq unzip less bind-utils iputils groff

RUN echo "set encoding=utf8" > /root/.vimrc

#### AWS ####

# Install awscli v1

#RUN pip3 install awscli

#RUN echo "source /usr/bin/aws_bash_completer" >> /root/.bashrc

# Install awscli v2

RUN curl "https://awscli.amazonaws.com/awscli-exe-linux-x86_64.zip" -o "awscliv2.zip" && \

unzip awscliv2.zip && \

/aws/install

RUN echo "complete -C '/usr/local/bin/aws_completer' aws" >> /root/.bashrc

#### GCP ####

# Install google cloud SDK 319.0.0

ENV CLOUDSDK_CORE_DISABLE_PROMPTS 1

RUN wget https://dl.google.com/dl/cloudsdk/channels/rapid/downloads/google-cloud-sdk-319.0.0-linux-x86_64.tar.gz && \

tar zxvf google-cloud-sdk-319.0.0-linux-x86_64.tar.gz && \

/google-cloud-sdk/install.sh && \

echo "if [ -f '/google-cloud-sdk/path.bash.inc' ]; then . '/google-cloud-sdk/path.bash.inc'; fi" >> /root/.bashrc && \

echo "if [ -f '/google-cloud-sdk/completion.bash.inc' ]; then . '/google-cloud-sdk/completion.bash.inc'; fi" >> /root/.bashrc

使用 docker build 指令建立 image

> docker build -t sakana/ansible_opensuse152:20201129 -f ./opensuseLeap152_ansible_20201129_Dockerfile .

使用 -f 指定 Dockerfile 名稱
最後是 ” . “ 目前的目錄

測試 container image

> docker run -v ~/.aws:/root/.aws -v ~/.azure:/root/.azure -v ~/.config/gcloud:/root/.config/gcloud -it sakana/ansible_opensuse152:20201129 /bin/bash

測試結果 OK, 建立 tag

這邊目前因為 openSUSE Leap 15 使用舊的 azure cli 以及相依性, 所以現在 az 指令會有問題, 已經 update issue 以及花了很多時間調整, 目前還是要等 openSUSE and Azure 看是否會有後續更新

https://github.com/Azure/azure-cli/issues/13209

但是 ansible with azure 沒有問題, 所以目前 az 指令可能會暫時透過 Azure cloud shell

觀察資訊

> docker images

REPOSITORY TAG IMAGE ID CREATED SIZE

sakana/ansible_opensuse152 20201129 c69c2e1c6e9e 13 minutes ago 2.09GB

opensuse/leap 15.2 573008f769b5 20 hours ago 106MB

sakana/ansible_opensuse152 latest 9f8d6b777cc9 2 weeks ago 1.82GB

建立 tag

> docker tag c69c2e1c6e9e sakana/ansible_opensuse152:latest

登入 docker

> docker login

上傳 image

> docker push sakana/ansible_opensuse152:20201129

> docker push sakana/ansible_opensuse152:latest

完工, 以後使用就用

> docker run -v ~/.aws:/root/.aws -v ~/.azure:/root/.azure -v ~/.config/gcloud:/root/.config/gcloud -it sakana/ansible_opensuse152 /bin/bash

~ enjoy it

Reference:

sakananote

星期日, 11月 29, 2020

三大雲平台工具容器升級小記 - ansible 2.10.3 與 Azure module

沒有留言: