Microsoft Researchers Propose PIT (Permutation Invariant Transformation): A Deep Learning Compiler for Dynamic Sparsity
Recently, deep learning has been marked by a surge in research aimed at optimizing models for dynamic sparsity. In this scenario, sparsity patterns only reveal themselves at runtime, posing a formidable challenge to efficient computation. Addressing this challenge head-on, a group of researchers proposed a novel solution called Permutation Invariant Transformation (PIT), showcased in…