1. How to use this document
You will not read this end-to-end. Use it like a dictionary with a learning path on top.
- Day 1 of your co-op: skim sections 2–4 (Prerequisites, Suggested Path, the Practical 20 list).
- When you hit an unfamiliar term:
Cmd-Fthe term in section 5. - When you need the broader AI context or deployment tools: jump to the sister AI Models & Roboflow Quick Reference (link in the navbar).
2. Prerequisites
Prerequisite knowledge:
- Python: the vision ecosystem (PyTorch, Ultralytics, OpenCV) is Python. You need enough to run training scripts and process results.
- Basic ML: training vs. inference, overfitting, train/val/test splits, precision/recall.
- Command line:
pip install ultralytics,yolo train,yolo predict.
Hardware: a laptop CPU is fine for running YOLOv8n inference at 5–10 FPS. Training even small models benefits from a GPU (T4 or better, ~$0.50/hr on Colab or RunPod).
3. Suggested learning path (5 steps)
Focus on deploying vision models on edge devices. Each step adds capability.
Step 1 — Detect objects with YOLO on a laptop
Run YOLOv8 on a sample image and a webcam feed. Understand confidence thresholds, NMS, and output parsing.
Step 2 — Optimize for a Jetson or Raspberry Pi
Convert to TensorRT or TFLite. Profile inference speed. Use FP16 or INT8 quantization to gain 2× speed with minimal accuracy loss.
Step 3 — Add segmentation and classification
Run SAM for segmentation on detected regions. Use a classifier (ResNet / MobileNet) to refine detection labels. Chain models for multi-stage pipelines.
Step 4 — Deploy as a microservice
Wrap the model in a FastAPI or Flask endpoint. Use Redis or RabbitMQ for queueing. Deploy with Docker on the edge device.
Step 5 — Integrate with a camera system
Connect RTSP cameras to the inference pipeline. Add a web UI with live bounding boxes and detection logs. Use Roboflow for dataset management and model versioning.
4. The Practical 10 — read these first
If you only read 10 entries in this glossary, read these. They cover ~90% of what you'll see in your first month on a microcontroller project.
Each entry: a one-line definition, then a practical note in italics that says what it means on the bench. Entries marked 🔥 are the practical-10.
A
1 termB
1 termBounding Box
#(x_min, y_min, x_max, y_max) or (x_center, y_center, width, height) depending on the format. Practical: Most object detection models output bounding boxes in normalized coordinates (0.0–1.0 relative to image dimensions). You need to scale them back to pixel coordinates for drawing or cropping. The COCO format uses (x_min, y_min, width, height); YOLO uses (class, x_center, y_center, width, height) normalized. Bounding boxes are the output format for YOLO (You Only Look Once), Detection Transformer (DETR), and most Object Detection models. See also: Object Detection, YOLOv8 / YOLOv11, IoU (Intersection over Union).C
4 termsClassification (Image)
#CLIP (Contrastive Language-Image Pre-training)
#transformers: from transformers import CLIPProcessor, CLIPModel. The ViT-B/32 variant is a good speed/accuracy trade-off. See also: Embeddings, ViT (Vision Transformer), Foundation Model (Vision).CNN (Convolutional Neural Network)
#COCO (Common Objects in Context)
#D
3 termsDetection Transformer (DETR)
#Depth Estimation (Monocular)
#pip install depth_anything_v2 && depth_anything_v2 predict image.jpg. Depth maps enable: grasping (know how far the object is), navigation (detect obstacles), AR (place virtual objects correctly). Monocular depth is inherently ambiguous (a small near object can look like a large far object), but modern models are good enough for robotics. See also: Segmentation (Semantic / Instance / Panoptic), Object Detection, Foundation Model (Vision).Document AI (DocAI)
#F
1 termFoundation Model (Vision)
#I
1 termIoU (Intersection over Union)
#M
1 termmAP (Mean Average Precision)
#N
1 termNMS (Non-Maximum Suppression)
#O
4 termsObject Detection
#OCR (Optical Character Recognition)
#pip install pytesseract + preprocess image (grayscale, threshold, deskew). See also: Object Detection, Preprocessing / Augmentations, Segmentation (Semantic / Instance / Panoptic).OBB (Oriented Bounding Box)
#(x_center, y_center, width, height, angle). Practical: YOLOv8-OBB is the easiest entry point: yolo train model=yolov8n-obb.pt data=DOTAv1.5.yaml epochs=100 imgsz=1024. The DOTA dataset (1.7M instances, 18 classes) is the standard benchmark. OBB models require ~2× the resolution of axis-aligned detectors for comparable accuracy (same object, angled box needs more pixels to decide orientation). Use OBB only when the object's orientation matters (grasping, text reading, aerial analysis); for most ground-level robotics, axis-aligned boxes are fine. See also: YOLOv8 / YOLOv11, Object Detection, Bounding Box.ONNX / TensorRT / OpenVINO
#yolo export model=yolov8n.pt format=onnx (ONNX), format=engine (TensorRT), format=openvino (OpenVINO). For a local server running on any platform, use ONNX Runtime. For an NVIDIA GPU server, use TensorRT (INT8 precision gives 2× speedup with minimal accuracy loss). For a laptop with an Intel CPU, use OpenVINO — it runs YOLOv8n at 30+ FPS on a modern Intel Core. All three support batching: set batch=16 for server-side optimised throughput. See also: Self-Hosted Inference (Vision), YOLOv8 / YOLOv11, Object Detection.P
2 termsPose Estimation
#yolo predict model=yolov8n-pose.pt source=image.jpg. For multi-person pose, YOLO handles up to ~10 people in a frame. Use for: ergonomics analysis, gesture control, animal behaviour monitoring. Higher accuracy options: OpenPifPaf, MMPose. Keypoint definitions follow the COCO 17-keypoint skeleton for humans. See also: YOLOv8 / YOLOv11, Object Detection, COCO (Common Objects in Context).Preprocessing / Augmentations
#R
1 termResNet (Residual Network)
#torchvision.models.resnet50(weights='IMAGENET1K_V2') to get started. See also: CNN (Convolutional Neural Network), Classification (Image), Object Detection.S
3 termsSAM (Segment Anything Model)
#pip install segment-anything and the ViT-H model (2.5 GB). SAM runs at ~2 FPS on a GPU; the lightweight SAM variants (MobileSAM, FastSAM, EdgeSAM) run on CPU or edge devices. SAM is not a production detection model — use it for data annotation and generating Segmentation (Semantic / Instance / Panoptic) masks for training. See also: Foundation Model (Vision), Segmentation (Semantic / Instance / Panoptic), CLIP (Contrastive Language-Image Pre-training).Segmentation (Semantic / Instance / Panoptic)
#Self-Hosted Inference (Vision)
#yolo export model=yolov8n.pt format=onnx), wrap it with FastAPI (POST /predict receives an image, runs inference, returns boxes), deploy via Docker. For GPU acceleration, use the nvidia/cuda base image and nvidia-docker. Raspberry Pi 5 runs YOLOv8n at 15+ FPS with the CPU-only ONNX Runtime. Always benchmark your specific model + hardware before committing — throughput varies wildly (e.g. YOLOv8x on a Jetson Orin is 30× slower than YOLOv8n). See also: ONNX / TensorRT / OpenVINO, Roboflow Inference, YOLOv8 / YOLOv11.T
1 termTracking (SORT / DeepSORT / BoT-SORT)
#yolo track model=yolov8n.pt source=video.mp4. Tracking enables counting (people through a doorway), speed estimation, and trajectory analysis. For a multi-camera setup, you need cross-camera re-identification (DeepSORT embedding or foundation model features). The main failure mode is ID switching (same object gets a new ID after occlusion). See also: YOLOv8 / YOLOv11, Object Detection, Bounding Box.V
2 termsViT (Vision Transformer)
#transformers library: from transformers import ViTImageProcessor, ViTForImageClassification. ViT-base (86M params) needs ~2 GB VRAM for inference. See also: Transformer Architecture, CNN (Convolutional Neural Network), CLIP (Contrastive Language-Image Pre-training).Visual Question Answering (VQA)
#pip install llava && llava infer --image photo.jpg --question “What colour is the car?”. VQA replaces complex multi-model pipelines with a single model call. Use cases: quality assurance (“Is there a defect on the PCB?”), scene understanding (“Are there obstacles in the robot's path?”), data extraction (“What is the reading on the pressure gauge?”). For deterministic answers, set temperature = 0. See also: LLM (Large Language Model), Object Detection, OCR (Optical Character Recognition).Y
2 termsYOLO (You Only Look Once)
#pip install ultralytics && yolo predict model=yolov8n.pt source='https://ultralytics.com/images/bus.jpg'. YOLO models come in sizes: N (nano, ~3 MB), S (small, ~11 MB), M (medium, ~25 MB), L (large, ~44 MB), X (xlarge, ~68 MB). Nano runs on a Raspberry Pi 4 at 15+ FPS. Xlarge needs a GPU but is more accurate. YOLO also supports segmentation, pose, classification, and OBB (oriented bounding boxes). See also: YOLOv8 / YOLOv11, Object Detection, CNN (Convolutional Neural Network).YOLOv8 / YOLOv11
#from ultralytics import YOLO; model = YOLO('yolov8n.pt'); results = model('image.jpg'). Training: yolo train model=yolov8n.pt data=coco128.yaml epochs=100 imgsz=640. The Ultralytics HUB (ultralytics.com/hub) provides free cloud training for small datasets. See also: YOLO (You Only Look Once), Object Detection, Roboflow Inference.Z
1 termZero-Shot Detection (GroundingDINO / CLIP)
#pip install groundingdino-py && grounding_dino predict image.jpg --prompt “a yellow cone”. Accuracy is lower than a fine-tuned YOLO model (expect 20–40% mAP vs. 60–80% with fine-tuning), but it costs zero labelling effort. Use it to bootstrap a dataset: run GroundingDINO, correct the false positives, then fine-tune YOLO on the corrected labels. See also: CLIP (Contrastive Language-Image Pre-training), Object Detection, YOLO (You Only Look Once).No matches
Try a different term, or press Esc to clear the search.
6. Quick reference tables
6.1 Edge deployment options
| Device | Format | FPS (YOLOv8n) | Power |
|---|---|---|---|
| NVIDIA Jetson Orin Nano | TensorRT | ~200 | 7–15 W |
| Raspberry Pi 5 | TFLite / ONNX | ~10 | 5 W |
| Apple M-series Mac | Core ML | ~60 | 5–10 W |
| Intel NUC + Arc GPU | OpenVINO | ~120 | 15–25 W |
| Google Coral TPU | TFLite Edge TPU | ~30 | 2 W |
7. Further reading
- 🔥 Jetson inference docs — github.com/dusty-nv/jetson-inference
- 🔥 MediaPipe solutions — developers.google.com/mediapipe
- 📚 OpenCV with CUDA — opencv.org
- 📚 Roboflow Inference — roboflow.com/inference
Last updated: July 2026. Maintained as a living document — if a term on your co-op isn't here, add it.