Comment Comment by MikeBattaglia Sure, right here: https://github.com/pytorch/pytorch/blob/main/torch/autograd/...Here's the documentation: https://pytorch.org/tutorials/intermediate/forward_ad_usage....> When an input, which we call “primal”, is associated with a “direction” tensor, which we call “tangent”, the resultant new tensor object is called a “dual tensor” for its connection to dual numbers[0]. parent MikeBattaglia 2 years ago
Here's the documentation: https://pytorch.org/tutorials/intermediate/forward_ad_usage....
> When an input, which we call “primal”, is associated with a “direction” tensor, which we call “tangent”, the resultant new tensor object is called a “dual tensor” for its connection to dual numbers[0].