Machine Learning Algorithm and Hardware Co-Design Towards Green and Ubiquitous AI on Both Edge and Cloud
First Place at ACM Student Research Competition (SRC) at ICCAD 2023 !
H. You*, Y. Lin
[Preprint] [First Place Award]

ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization
In NeurIPS 2024 (Acceptance rate: 26%)
H. You*, Y. Guo, Y. Fu, W. Zhou, H. Shi, X. Zhang, S. Kundu, A. Yazdanbakhsh, Y. Lin
[Paper] [Code]
In Collaboration with Intel, Google, and Google DeepMind

When Linear Attention Meets Autoregressive Decoding: Towards More Effective and Efficient Linearized Large Language Models
In ICML 2024 (Acceptance rate: 27%)
H. You*, Y. Fu, Z. Wang, A. Yazdanbakhsh, Y. Lin
[Paper] [Code]
In Collaboration with Google DeepMind

ShiftAddViT: Mixture of Multiplication Primitives Towards Efficient Vision Transformer
In NeurIPS 2023 (Acceptance rate: 26%)
H. You*, H. Shi*, Y. Guo*, Y. Lin
[Paper] [Code] [Slide] [Poster] [Talk@NeurIPS]

Castling-ViT: Compressing Self-Attention via Switching Towards Linear-Angular Attention During Vision Transformer Inference
In CVPR 2023 (Acceptance rate: 25%).
H. You*, Y. Xiong*, X. Dai, B. Wu, P. Zhang, H. Fan, P. Vajda, Y. Lin
[Paper] [Code] [Project] [Slide] [Poster] [Talk@CVPR]
Meta Internship Project

ViTCoD: Vision Transformer Acceleration via Dedicated Algorithm and Accelerator Co-Design
In HPCA 2023 (Acceptance rate: 25%)
H. You, Z. Sun, H. Shi, Z. Yu, Y. Zhao, Y. Zhang, C. Li, B. Li, Y. Lin
Selected as the Meta Faculty Research Award of 2022 !
[Paper] [Code] [Project] [Slide] [Poster] [Talk@GT] [Talk@HPCA]

SuperTickets: Drawing Task-Agnostic Lottery Tickets from Supernets via Jointly Architecture Searching and Parameter Pruning
In ECCV 2022 (Acceptance rate: 20%)
H. You, B. Li, Z. Sun, X. Ouyang, Y. Lin
[Paper] [Code] [Slide] [Poster] [Talk@ECCV]
Baidu Research Internship Project

ShiftAddNAS: Hardware-Inspired Search for More Accurate and Efficient Neural Networks
In ICML 2022 (Acceptance rate: 20%)
H. You, B. Li, H. Shi, Y. Fu, Y. Lin
[Paper] [Code] [Project] [Slide] [Talk@ICML]
Baidu Research Internship Project

EyeCoD: Eye Tracking System Acceleration via FlatCam-Based Algorithm and Accelerator Co-Design
In ISCA 2022 (Acceptance rate: 17%)
H. You*, C. Wan*, Y. Zhao*, Z. Yu*, Y. Fu, J. Yuan, S. Wu, S. Zhang, Y. Zhang, C. Li, V. Boominathan, A. Veeraraghavan, Z. Li, Y. Lin
Selected as the IEEE Micro’s Top Pick of 2023 !
[Paper] [Code] [Project] [Slide] [Poster@ISCA] [Poster@CoCoSys] [Talk@ISCA] [IEEE Micro’s TopPick’23]
In Collaboration with Meta

GCoD: Graph Convolutional Network Acceleration via Dedicated Algorithm and Accelerator Co-Design
In HPCA 2022 (Acceptance rate: 30%)
H. You, T. Geng, Y. Zhang, A. Li, Y. Lin
[Paper] [Code] [Slide] [Talk@HPCA]

Early-Bird GCNs: Graph-Network Co-Optimization Towards More Efficient GCN Training and Inference
In AAAI 2022 (Acceptance rate: 15%)
H. You, Z. Lu, Z. Zhou, Y. Fu, Y. Lin
[Paper] [Code] [Slide] [Poster] [Talk@AAAI]

ShiftAddNet: A Hardware-Inspired Deep Network
In NeurIPS 2020 (Acceptance rate: 20%)
H. You, X. Cheng, Y. Zhang, S. Liu, Z. Liu, Z. Wang, Y. Lin
[Paper] [Code] [Slide] [Poster] [Talk@NeurIPS] [Talk@RICE]
In Collaboration with Alibaba DAMO Academy

Drawing Early-Bird Tickets: Towards More Efficient Training of Deep Networks
In ICLR 2020 Spotlight (Acceptance rate: 4%)
H. You, C. Li, P. Xu, Y. Fu, Y. Wang, X. Chen, R.G. Baraniuk, Z. Wang, Y. Lin
Selected as an ICLR Spotlight !
[Paper] [Code] [Slide] [OpenReview] [Talk@ICLR]

EyeCoD: Eye Tracking System Acceleration via FlatCam-Based Algorithm and Accelerator Co-Design
In IEEE Micro's Top Pick of 2023 (Top 12 in All Accepted Computer Architecture Papers of 2022)
H. You*, C. Wan*, Y. Zhao*, Z. Yu*, Y. Fu, J. Yuan, S. Wu, S. Zhang, Y. Zhang, C. Li, V. Boominathan, A. Veeraraghavan, Z. Li, Y. Lin
[Paper] [Project] [Slide] [Poster@ISCA] [Poster@CoCoSys] [Talk@ISCA]

Max-Affine Spline Insights Into Deep Network Pruning
In TMLR, 2022
H. You, R. Balestriero, Z. Lu, Y. Kou, H. Shi, S. Zhang, S. Wu, Y. Lin, R. Baraniuk
[Paper] [Code]

Bayesian Cycle-Consistent Generative Adversarial Networks via Marginalizing Latent Sampling
In IEEE TNNLS, 2021
H. You, Y. Cheng, T. Cheng, C. Li, P. Zhou
[Paper@IEEE] [Paper@arXiv] [Code]

Towards Cognitive AI Systems: Workload and Characterization of Neuro-Symbolic AI
In ISPASS 2024 (Acceptance rate: 34%)
Z. Wan, C. Liu, H. Yang, R. Raj, C. Li, H. You*, Y. Fu, C. Wan, A. Samajdar, Y. Lin, T. Krishna, A. Raychowdhury
[Paper] [Slide]

EDGE-LLM: Enabling Efficient Large Language Model Adaptation on Edge Devices via Layerwise Unified Compression and Adaptive Layer Tuning & Voting
In DAC 2024 (Acceptance rate: 22%)
Z. Yu, Z. Wang, Y. Li, H. You*, R. Gao, X. Zhou, S. Bommu, Y. Zhao, Y. Lin
[Paper]

NASA+: Neural Architecture Search and Acceleration for Multiplication-Reduced Hybrid Networks
In IEEE Transactions on Circuits and Systems I, 2023
H. Shi, H. You, Z. Wang, Y. Lin
[Paper@IEEE] [Code]

Gen-NeRF: Efficient and Generalizable Neural Radiance Fields via Algorithm-Hardware Co-Design
In ISCA 2023 (Acceptance rate: 21%)
Y. Fu, Z. Ye, J. Yuan, S. Zhang, S. Li, H. You, Y. Lin
[Paper]

Instant-3D: Instant Neural Radiance Fields Training Towards Real-Time AR/VR 3D Reconstruction
In ISCA 2023 (Acceptance rate: 21%)
S. Li, C. Li, W. Zhu, B. Yu, Y. Zhao, C. Wan, H. You, H. Shi, Y. Lin
[Paper]

NASA: Neural Architecture Search and Acceleration for Hardware Inspired Hybrid Networks
In ICCAD 2022 (Acceptance rate: 24%)
H. Shi, H. You, Y. Zhao, Z. Wang, Y. Lin
[Paper]

SmartDeal: Re-Modeling Deep Network Weights for Efficient Inference and Training
In IEEE TNNLS, 2022
X. Chen, Y. Zhao, Y. Wang, P. Xu, H. You, C. Li, Y. Fu, Y. Lin, Z. Wang
[Paper] [Code]

i-FlatCam: A 253 FPS, 91.49 µJ/Frame Ultra-Compact Intelligent Lensless Camera System for Real-Time and Efficient Eye Tracking in VR/AR
In VLSI 2022
Y. Zhao, Z. Li, H. You, Y. Fu, Y. Zhang, C. Li, C. Wan, S. Wu, X. Ouyang, V. Boominathan, A. Veeraraghavan, Y. Lin
Won the first place in University Best Demonstration at DAC 2022 !
[Paper] [Demo]

LDP: Learnable Dynamic Precision for Efficient Deep Neural Network Training and Inference
In TinyML 2022
Z. Yu, Y. Fu, S. Wu, M. Li, H. You, Y. Lin
[Paper]

I-GCN: A GCN Accelerator with Runtime Locality Enhancement through Islandization
In MICRO 2021 (Acceptance rate: 22%)
T. Geng, C. Wu, Y. Zhang, C. Tan, C. Xie, H. You, M. Herbordt, Y. Lin, A. Li
[Paper]

HW-NAS-Bench: Hardware-Aware Neural Architecture Search Benchmark
In ICLR 2021 Spotlight (Acceptance rate: 4%)
C. Li, Z. Yu, Y. Fu, Y. Zhang, Y. Zhao, H. You, Q. Yu, Y. Wang, C. Hao, Y. Lin
[Paper]

G-CoS: GNN-Accelerator Co-Search Towards Both Better Accuracy and Efficiency
In ICCAD 2021 (Acceptance rate: 23%)
Y. Zhang, H. You, Y. Fu, T. Geng, A. Li, Y. Lin
[Paper]

DIAN: differentiable accelerator-network co-search towards maximal DNN efficiency
In ISLPED 2021
Y. Zhang, Y. Fu, W. Jiang, C. Li, H. You, M. Li, V. Chandra, Y. Lin
[Paper]

FracTrain: Fractionally Squeezing Bit Savings Both Temporally and Spatially for Efficient DNN Training
In NeurIPS 2020 (Acceptance rate: 20%)
Y. Fu, H. You, Y. Zhao, Y. Wang, C. Li, K. Gopalakrishnan, Z. Wang, Y. Lin
[Paper]

HALO: Hardware-Aware Learning to Optimize
In ECCV 2020 (Acceptance rate: 27%)
C. Li, T. Chen, H. You, Z. Wang, Y. Lin
[Paper]

SmartExchange: Trading Higher-cost Memory Storage/Access for Lower-cost Computation
In ISCA 2020 (Acceptance rate: 18%)
Y. Zhao, X. Chen, Y. Wang, C. Li, H. You, Y. Fu, Y. Xie, Z. Wang, Y. Lin
[Paper]