Comment Comment by wsmoses Hi all, another author here and happy to answer any questions!Some more relevant links for the curiousGithub: https://github.com/wsmoses/EnzymePaper: https://proceedings.neurips.cc/paper/2020/file/9332c513ef44b...Basically the long story short is that Enzyme has a couple of interesting contributions:1) Low-level Automatic Differentiation (AD) IS possible and can be high performance2) By working at LLVM we get cross-language and cross-platform AD3) Working at the LLVM level actually can give more speedups (since it's able to be performed after optimization)4) We made a plugin for PyTorch/TF that uses Enzyme to import foreign code into those frameworks with ease! parent wsmoses 5 years ago
Some more relevant links for the curious
Github: https://github.com/wsmoses/Enzyme
Paper: https://proceedings.neurips.cc/paper/2020/file/9332c513ef44b...
Basically the long story short is that Enzyme has a couple of interesting contributions:
1) Low-level Automatic Differentiation (AD) IS possible and can be high performance
2) By working at LLVM we get cross-language and cross-platform AD
3) Working at the LLVM level actually can give more speedups (since it's able to be performed after optimization)
4) We made a plugin for PyTorch/TF that uses Enzyme to import foreign code into those frameworks with ease!