Things included are:

• Makefile

• Pytest

• pandas

• Pylint

• Dockerfile

• GitHub copilot

• jupyter and ipython

• Most common Python libraries for ML/DL and Hugging Face

• githubactions

The following examples test out the GPU

• run pytorch training test: python utils/quickstart_pytorch.py
• run pytorch CUDA test: python utils/verify_cuda_pytorch.py
• run tensorflow training test: python utils/quickstart_tf2.py
• run nvidia monitoring test: nvidia-smi -l 1 it should show a GPU
• run whisper transcribe test ./utils/transcribe-whisper.sh and verify GPU is working with nvidia-smi -l 1

Used as the base and customized in the following Duke MLOps and Applied Data Engineering Coursera Labs:

• MLOPs-C2-Lab1-CICD
• MLOps-C2-Lab2-PokerSimulator
• MLOps-C2-Final-HuggingFace
• Coursera-MLOps-C2-lab3-probability-simulations
• Coursera-MLOps-C2-lab4-greedy-optimization

• Building Cloud Computing Solutions at Scale Specialization
• Python, Bash and SQL Essentials for Data Engineering Specialization
• Coursera-Dockerfile