An end-to-end differentiable pipeline is a system whose final objective can send derivative information backward through every trainable or tunable stage of computation....
| Section | Title |
|---|---|
| 1 | Chapter 15. Differentiable Systems Architecture |
| 2 | Differentiable Databases |
| 3 | Differentiable Rendering |
| 4 | Differentiable Physics Engines |
| 5 | Differentiable Search and Retrieval |
| 6 | Differentiable Compilers |
| 7 | Differentiable Operating Systems |
| 8 | Hybrid Symbolic-Numeric Systems |
| 9 | Summary |
Chapter 15. Differentiable Systems ArchitectureAn end-to-end differentiable pipeline is a system whose final objective can send derivative information backward through every trainable or tunable stage of computation....
Differentiable DatabasesA differentiable database is a data system whose operations participate in gradient-based optimization. Instead of treating storage and querying as external infrastructure,...
Differentiable RenderingDifferentiable rendering is the process of computing derivatives of rendered images with respect to scene parameters. A renderer becomes part of the computational graph rather...
Differentiable Physics EnginesA differentiable physics engine computes gradients of physical simulation outputs with respect to inputs, parameters, or control signals. Instead of treating simulation as a...
Differentiable Search and RetrievalDifferentiable search and retrieval systems integrate information access into gradient-based learning. Instead of treating retrieval as an external symbolic operation, the...
Differentiable CompilersA differentiable compiler is a compilation system that supports gradient propagation through compilation decisions, generated programs, or execution behavior. Instead of...
Differentiable Operating SystemsA differentiable operating system is an execution environment whose resource-management decisions can be optimized using gradients or gradient-like feedback. Instead of...
Hybrid Symbolic-Numeric SystemsA hybrid symbolic-numeric system combines discrete symbolic reasoning with continuous numerical computation. In the context of automatic differentiation, it means a pipeline...
SummaryDifferentiable systems architecture extends automatic differentiation beyond isolated functions and neural network layers. The central idea is to treat larger systems as...