Annexure 9: PyTorch Glossary of Key Terms (Beginner to Advanced)
Abstract: Below is the Annexure 9: PyTorch Glossary of Key Terms (Beginner to Advanced) — concise, complete, and ready to insert into the book. **Annexure 9 PyTorch Glossary of Key Terms (Beginner to Advanced)** This annexure compiles the most essential and frequently used PyTorch terms. It covers foundational concepts, intermediate constructs, and advanced components used in deep learning research and deployment. A. Beginner-Level Terms 1. Tensor A multi-dimensional array used for all computations in PyTorch. Analogous to NumPy arrays but with GPU support. 2. Tensor Rank The number of dimensions (e.g., 0D scalar, 1D vector, 2D matrix). 3. Autograd PyTorch’s automatic differentiation engine that computes gradients for tensors with requires_grad=True . 4. Computational Graph A directed graph representing operations performed on tensors. PyTorch builds it dynamically. 5. Gradient The derivative of a function with respect to its variables; essential for o...