Skip to content

Latest commit

History

119 Commits

Folders and files

NameName
Last commit message
Last commit date

Repository files navigation

University of Washington NeuroAI Seminar

Welcome to NeuroAI-UW seminar, a regular weekly seminar for UW community organized by NeuroAI Shlizerman Lab.

Meetings are currently held hybridly (Summer & Fall 2020, Winter & Spring & Fall 2021-2023, Winter 2024). Contact us if you would like to join! UW students can enroll into designated courses: AMATH 500L or EE 598F to participate in the seminarial activities.

New: We will be positing some of the invited visitors talks in NeuroAI YouTube playlist.

2025 Spring Schedule

This quarter, our lab is focusing on reading papers related to our ongoing research in the areas of AI and NeuroAI. We host a weekly seminar where we discuss cutting-edge research from these fields.

  • Time: Every Friday, 11:00 AM - 12:00 PM PDT
  • Format: Presentations and discussions led by members of each group

Student Organizer: Xiulong Liu

DatePaper/ActivityStudent Presenter
04/18/20251. Stabilizing brain-computer interfaces through alignment of latent dynamics
2. Improved Distribution Matching Distillation for Fast Image Synthesis
1. Victoria Pierce, Jimin Kim
2. Yang Zheng, Jinlin Xiang, Bailey Hall
04/25/20251. ConceptFusion: Open-set Multimodal 3D Mapping
2. Dynamically Learning to Integrate in Recurrent Neural Networks
1. Mingfei Chen, Xiulong Liu, Zijun Cui
2. James Hazelden, Saba Heravi, Vishya Adipudi
05/02/20251. Few-shot Algorithms for Consistent Neural Decoding (FALCON) Benchmark1. Hao Fang, Brian Deng, Aida Mustafanova
05/09/20251. 3D-Mem: 3D Scene Memory for Embodied Exploration and Reasoning
2. Neural Encoding and Decoding at Scale
1. Zelin Xu, Brian Deng
2. Saba Heravi, Jimin Kim
05/23/2025Guest Speaker: Krishna Murthy Jatavallabhula (Research Scientist at Meta)

2025 Winter Schedule

This quarter, our lab is focusing on two Hackathon projects in AI and Neuroscience. Inspired by papers we've studied in previous quarters, these projects aim to bridge the gap between theoretical knowledge and practical implementation.

We host a weekly seminar to discuss relevant research and share progress updates from each group.

  • Time: Every Friday, 11:00 AM - 12:00 PM PDT
  • Format: Presentations and discussions led by members of each group

Hackathon projects leads:

  • AI: Xiulong Liu, Yang Zheng
  • Neuroscience: Trung Le, Jimin Kim
DatePaper/ActivityStudent Presenter
01/24/2025
01/31/2025
Hackathon project brainstorming:
1. Benchmarking Performance of existing Audio-Visual LLMs
2. NeuroCodec
All members
02/07/20251. AV LLM: VideoLLaMA 2 Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs
2. High Fidelity Neural Audio Compression
1. Xiulong Liu, Yang Zheng, Zijun Cui, Jinlin Xiang, James Hazelden, Mingfei Chen, Hao Fang
2. Trung Le, Brian Deng, Saba Heravi, Jimin Kim, Bailey Hall, Jingyuan Li
02/14/20251. Thinking in Space: How Multimodal LLMs see, Remember, and Recall Spaces
2. Towards a “universal translator” for neural dynamics at single-cell, single-spike resolution
1. Xiulong Liu, Yang Zheng, Zijun Cui, Jinlin Xiang, James Hazelden, Mingfei Chen, Hao Fang
2. Trung Le, Brian Deng, Saba Heravi, Jimin Kim, Bailey Hall, Jingyuan Li
02/21/2025Hackathon Preparation MeetingAll members
02/28/2025One-day HackathonAll members
03/07/2025Guest Speaker Alexandre Défossez (Chief Exploration Officer at Kyutai)

03/14/2025Guest Speaker Jihan Yang (postdoctoral associate at NYU Courant)

2024 Fall Schedule

This quarter focuses on exploring and advancing research in three interconnected domains: AI, NeuroAI, and Neuroscience. We are passionate about understanding intelligence from both artificial and biological perspectives, bridging the gap between technology and science. We host a weekly seminar where we discuss cutting-edge research from these fields. We host a weekly seminar to discuss cutting-edge research and foster collaboration.

  • Time: Every Friday, 11:00 AM - 12:00 PM PDT
  • Format: Presentations and discussions led by domain experts or lab members

Domain Leads

  • AI: Yang Zheng
  • NeuroAI: Trung Le
  • Neuroscience: Jimin Kim
DatePaper/ActivityStudent Presenter
10/25/2024Brain-to-text Decoding with Context-aware Neural Representations and Large Language ModelsEric Martin, Jinlin Xiang, Mingfei Chen, Ted Zhong, Xiulong Liu, Yang Zheng, Yuan Gao
11/01/2024The FlyWire connectome: neuronal wiring diagram of a complete fly brainTrung Le, Jingyuan Li, Hao Fang, James Hazelden, Keith Phou, Bailey Hall
11/08/2024 & 11/15/2024Tell What You Hear From What You See - Video to Audio Generation Through TextJimin Kim, Saba Heravi, Victoria Pierce, Weijun Liu, Jiawen Liu, Deeksha Prabhu, Dongyi Yang
11/22/2024Guest Speaker Sven Dorkenwald (Allen Institute)

11/29/2024Thanksgiving Break
12/06/2024Guest Speaker Xiulong Liu (UW NeuroAI)

12/06/2024Guest Speaker Francis Robert Willett (Neural Prosthetics Translational Laboratory at Stanford University)

2024 Spring Schedule

This quarter, we review impactful alternative architectures recently proposed in the NeuroAI literature. The seminar is held every Friday from 11:00 am - noon PDT in a hybrid manner.

DatePaper/ActivityStudent Presenter
03/29/2024Brainstorming Meeting & Final Presentations on NeuroAI and LLMs (Team 1, 2)Mingfei Chen, Jingyuan Li, Frenda Lin, Trung Le, Kun Su, Yang Zheng, Jinlin Xiang, Jimin Kim, Xiulong Liu, Eunki Chung, Rahul Biswas
04/05/2024Organizational & Intro Meeting & Final Presentations on NeuroAI and LLMs (Team 3)Saba Heravi, James Hazelden, Ari Asarch, Yoonseo Orite, Kavya Balasubramanian
04/12/2024Energy TransformerJames Hazelden, Saba Heravi, Yang Zheng
04/19/2024State Space Models: Mamba: Linear-Time Sequence Modeling with Selective State Spaces & Efficiently Modeling Long Sequences with Structured State SpacesVictoria Pierce, Mingfei Chen, and Xiulong Liu
04/26/2024RNN Alternatives: RWKV: Reinventing RNNs for the Transformer Era & Hierarchically Gated Recurrent Neural Network for Sequence ModelingJinlin Xiang, Jesse Owens, and Jimin Kim
05/03/2024MLP Mixer: An All MLP Architecture for Vision & The Forward-Forward AlgorithmAdithya Gowda Baragur, Seb Schwab, and Trung Le
05/10/2024Building transformers from neurons and astrocytes & NISQ QNN: Classification with Quantum Neural Networks on Near Term ProcessorsIan Quah, Sean Robert Gamer, and Jingyuan Li

2024 Winter Schedule

Thanks Jinlin, Mingfei and Saba for being Student Organizers.

In this quarter, we will prepare seminars on 3 critical topics related to NeuroAI and LLMs (Large Language Models). The seminar will be held every Friday 11:00am - 12:00pm (PST) hybridly.

TopicStudent Presenter
LLM-Enhanced Neural DecodingMingfei Chen, Jingyuan Li, Frenda Lin, Trung Le, Kun Su, Yang Zheng
Domain Adaptation of Pre-trained LLM for ResearchJinlin Xiang, Jimin Kim, Xiulong Liu, Eunki Chung, Rahul Biswas
Interpretation of Neural Networks in LLMsSaba Heravi, James Hazelden, Ari Asarch, Yoonseo Orite, Kavya Balasubramanian
DatePaper/ActivityStudent Presenter
1/12/2024Organizational & Intro Meeting on NeuroAI and LLMs
1/19/2024Decoding Speech Perception from Non-Invasive Brain RecordingsMingfei Chen, Jingyuan Li, Frenda Lin, Trung Le, Kun Su, Yang Zheng
1/26/2024Large Language Models Struggle to Learn Long-Tail KnowledgeJinlin Xiang, Jimin Kim, Xiulong Liu, Eunki Chung, Rahul Biswas
2/02/2024Hopfield Networks is All You NeedsSaba Heravi, James Hazelden, Ari Asarch, Yoonseo Orite, Kavya Balasubramanian
2/09/2024Guest SpeakerJean-Rémi King (École Normale Supérieure / Meta AI)

2/16/2024Guest SpeakerNikhil Kandpal (University of Toronto)

2/23/2024Guest Speaker: TBA

2023 Fall Schedule

In this quarter, we will continue to present tutorials and organize discussions on 6 critical topics related to NeuroAI.

TopicStudent Presenter
Deep Learning Programming Tools for NeuroAIYang Zheng, Jazlin Taylor
Design, Programing and Publishing OpenSource Code for NeuroAIJinlin Xiang, Trung Le, Jimin Kim
Data and Benchmarking Practices in NeuroAIAmisha Himanshu Somaiya, Trung Le
Neuro, AI and NeuroAI EthicsRahul Biswas, Jingyuan Li
Hardware Acceleration for DL and NeuroAISaba Heravi, James Hazelden
LLMs and Their Relation to NeuroAIMingfei Chen, Xiulong Liu, Pavan Kumar Anand

2023 Spring Schedule

In this quarter, we will prepare and present tutorials on 6 critical topics related to NeuroAI.

TopicStudent Presenter
Deep Learning Programming Tools for NeuroAIAstitwas S. Lathe, Yang Zheng, Wenxuan Hu
Design, Programing and Publishing OpenSource Code for NeuroAIJimin Kim, Jinlin Xiang, Trung Le
Data and Benchmarking Practices in NeuroAIAyush Singh, Chunqing Cao
Neuro, AI and NeuroAI EthicsRahul Biswas, Atharva Mattam, James Hazelden
Hardware Acceleration for DL and NeuroAISaba Heravi, Ruihong Yin, Carter Rowell
LLMs and Their Relation to NeuroAIXiulong Liu, Mingfei Chen, Jingyuan Li

2023 Winter Schedule

In this quarter, we will prepare and present tutorials on 5 critical topics related to NeuroAI.

TopicStudent Presenter
Deep Learning Programming Tools for NeuroAISadjyot Gangolli, Mingfei Chen, Xiulong Liu, Hanna Lee
Design, Programing and Publishing OpenSource Code for NeuroAIJimin Kim, Kun Su, Pranav Kamath, Jingyuan Li
Data and Benchmarking Practices in NeuroAIJinlin Xiang, Trung Le, Ayush Singh
Neuro, AI and NeuroAI EthicsRahul Biswas, Ryan Vogt, Xinwen Liu
Hardware Acceleration for DL and NeuroAIYang Zheng, James Hazelden, Saba Heravi

2022 Fall Schedule

Thanks Mingfei and Jingyuan for being Student Organizer.

DatePaper/ActivityStudent Presenter
10/07/2022Organizational & Intro Meeting on Energy Based Models
10/14/2022A Path Towards Autonomous Machine IntelligenceJames Hazelden, Saba Heravi, Andrew Line, Yang Zheng.
10/21/2022The surprising effectiveness of representation learning for visual imitationHanna Lee, Jimin Kim
10/28/2022Self-supervised learning of pretext-invariant representationsJinlin Xiang, Trung Le
Barlow twins: Self-supervised learning via redundancy reductionRaphael Bechtold, Ryan V
11/04/2022Understanding the world through actionZe Xia (Lucas) Wang, Saba Heravi
Deep hierarchical planning from pixelsRuihong Yin, Pinyi Wang, Xiulong Liu
11/11/2022Break Veterans Day
11/18/2022Guest SpeakerYubei Chen (New York University)

11/25/2022Break Thanksgiving
12/02/2022Break NeurIPS
12/09/2022NeurIPS Updates
12/16/2022Guest SpeakerKuan Fang (UC Berkeley)

2022 Spring Schedule

Thanks Ryan Vogt and Jingyuan Li for being the Student Organizers.

DatePaper/ActivityStudent Presenter
04/01/2022Organizational & Intro Meeting
04/08/2022VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised LearningKun Su, Mingfei Chen, Harsha Vardhan
The Causal-Neural Connection: Expressiveness, Learnability, and InferenceRahul Biswas, Shirui Chen, Xiulong Liu
04/15/2022ILQR-VAE : Control-base Learning of Input Driven Dynamics with Application To Neural DataPamel Kang, Trung Le, Jingyuan Li
Neural Active Learning with Performance GuaranteesZhuochun Liu, Zhongshu Meng, Jinlin Xiang
04/22/2022Inferring Latent Dynamics Underlying Neural Population aCTIVITY VIA neural Differential EquationsMichael Nolan, Saba H, Destiny Alvarado
Retriever: Learning Content-Style Representation as a Token-Level Bipartite GraphYang Zheng, Anoop Mysore Nataraja, Malek Itani
04/29/2022Guest SpeakerKevin Xia (Columbia University)

05/06/2022Towards Biologically Plausible Convolutional NetworksXiangyu Gao, Yujia Liu, Xinyue Sun
Deep Reinforcement Learning with Spiking Q-LearningJingwei Xu, Miranda Anderson, Jimin Kim
05/13/2022A3D3 Speakers
05/20/2022TBA
05/27/2022Guest SpeakerClaudio Gentile (Google)

06/03/2022A3D3 Speakers
06/10/2022Guest SpeakerMarine Schimel (Cambridge)

2022 Winter Schedule

DatePaper/ActivityStudent Presenter
01/14/2022Organizational Meeting
01/21/2022Where is all the nonlinearity: flexible nonlinear modeling of behaviorally relevant neural dynamics using recurrent neural networksMichael Nolan, Saba Heravi, Ryan Vogt, Zekun Chen
Drop, Swap, and Generate: A Self-Supervised Approach for Generating Neural ActivityKun Su, Xiangyu Gang, Pamel Kang, Jingyuan Li
01/28/2022Neural Active Learning with Performance GuaranteesXiulong Liu, James Hazelden, Jinlin Xiang, Liem Vu
Dynamic Causal Modelling RevisitedRahul Biswas, Astitwa Sarthak Lathe, Trung Le
02/04/2022A3D3 NeuroAI
OpenLabCluster DemoJingyuan Li (UW ECE), Moishe Kesselman (UW CSE)
Detection of Sleep Spindles with FPGAXiaohan Liu (UW ECE), Aidan Yokuda (UW ECE)
Somatotopic representation of texture sensation in the primary somatosensory and motor cortices of miceMegan Lipton (Purdue Neurobiology)
02/11/2022Guest SpeakerEva L. Dyer (Gatech)

02/18/2022Stabilizing Dynamical Systems via Policy Gradient MethodsJimin Kim, Mingfei Chen, Aidan Yokuda
AugMax: Adversarial Composition of Random Augmentations for Robust TrainingYang Zheng, Xiaohan Liu, Yujia Liu, Xinyue Sun
02/25/2022Guest SpeakerMax Simchowitz (MIT)

03/04/2022A3D3 NeuroAI
Optimizing brain stimulation using deep learningSeungbin Park (Purdue)
Quantifying the effect of stimulation protocols on rapid network connectivity inferenceTomohiro Ouchi (UW)
Modeling Neural Population Activity with Spatiotemporal TransformerTrung Le (UW)
03/11/2022Guest Speaker: Omid G. Sani (USC)

2021 Fall Schedule

DatePaper/ActivityStudent Presenter
10/08/2021Organizational Meeting
10/15/2021Representation learning for neural population activity with Neural Data TransformersRahul Biswas, Jimin kim
Deep Reinforcement Learning for Neural ControlRyan Vogt, Jinlin Xiang
10/22/2021A unified framework of online learning algorithms for training recurrent neural networksHarsha Vardhan, James Hazelden
Lyapunov-Guided Embedding for Hyper-parameter Selection in Recurrent Neural NetworksKun Su, Michael Nolan
10/29/2021AL-SAR: Active Learning for Skeleton-based Action RecognitionXiulong Liu, Syed M. Aun Haider
How does it sound?Jingyuan Li, Trung Le
11/05/2021Guest SpeakerXiulong liu (UW)

Guest SpeakerJingyuan Li (UW)

11/12/2021Guest Speaker: Chethan Pandarinath (Georgia Tech)

Guest Speaker: Joel Ye (CMU)

11/19/2021Local Plasticity rules can learn deep representations using self-supervised contrastive predictionsYang Zheng, Saba Heravi
AI Choreographer: Music Conditioned 3D Dance Generation with AIST++Xiangyu Gao, Yonghun Lee
11/26/2021Thanksgiving Break
12/03/2021Guest Speaker: Cristina Savin (NYU)

Guest Speaker: Owen Marschall (NYU)

2021 Spring Schedule

DatePaper/ActivityStudent Presenter
04/02/2021Deep Graph Pose: a semi-supervised deep graphical model for improved animal pose trackingChuanmudi Qin, Xiulong Liu, Kun Su
Backpropagation and the brainBen Francis, Felix Tse, Trung Le
04/09/2021Understanding self-supervised Learning Dynamics without Contrastive PairsJingyuan Li, Ayesha Ghaffar, Zidan Luo
Closed-Form Factorization of Latent Semantics in GANsJingxi Yu, Xiangyu Gao, Yang Zheng
04/16/2021Guest Speaker: Anqi Wu (Columbia University)

04/23/2021Non-reversible Gaussian processes for identifying latent dynamical structure in neural dataRahul Biswas, Ryan Vogt, Michael Nolan
Modeling behaviorally relevant neural dynamics with a novel preferential subspace identificationSaba Heravi, Astitwa Lathe, Yiren Wang, Jimin Kim
04/30/2021Guest Speaker: Bolei Zhou (The Chinese University of Hong Kong)

05/07/2021New Papers Discussion
05/14/2021ICLR Paper Presentation
05/21/2021No Meeting
05/28/2021Guest Speaker: Omid G. Sani (USC)

06/04/2021Guest Speaker: Yuandong Tian (Facebook)

2021 Winter Schedule

DatePaper/ActivityStudent Presenter
01/08/2021Organizational Meeting
01/15/2021Graph Convolutional Reinforcement LearningJinlin Xiang, Trung Le
When Counterpoint Meets Chinese Folk MelodyHaobo Zhang, Xiulong Liu, Kun Su
01/22/2021Gradient Starvation: A Learning Proclivity in Neural NetworksRyan Vogt, Yang Zheng
Cliques of Neurons Bound into Cavities Provide a Missing Link between Structure and FunctionMichael Nolan, Ben Francis, Rahul Biswas
01/29/2021Guest Speaker: Zhiyao Duan

02/05/2021Temporal Spike Sequence Learning via Backpropagation for Deep Spiking Neural NetworksJingyuan Li, Saba Heravi, Yetao Chen
Improved protein structure prediction using potentials from deep learningChris Yin, Jamie Park, Jimin Kim
02/12/2021Unsupervised Sound Separation Using Mixture Invariant TrainingKun Su, Jinlin Xiang, Zhichao Lei
Deep Reinforcement Learning and its neuroscientific implicationsBen Francis, Trung Le, Saba Heravi
02/19/2021
02/26/2021Guest Speaker: Kathryn Hess Bellwald

03/05/2021Guest Speaker: Wenrui Zhang

03/12/2021Guest Speaker: Mohammad Pezeshki

2020 Autumn Schedule

DatePaper/ActivityStudent Presenter
10/02/2020Organizational Meeting
10/09/2020Learning a Prior over Intent via Meta-Inverse Reinforcement LearningYang Zheng, Rahul Biswas
Universality and Individuality in recurrent networksMichael Nolan, Ben Francis
10/16/2020Unsupervised deep learning identifies semantic disentanglement in single inferotemporal neuronsJinlin Xiang, Ryan Vogt
Low-dimensional dynamics for working memory and time encodingJimin Kim, Trung Le, David Babin
10/23/2020Guest Speaker: Niru Maheswaranathan

10/30/2020Rotational Dynamics Reduce Interference Between Sensory and Memory RepresenatationsJingyuan Li, Saba Heravi
Foley Music: Learning to Generate Music from VideosKun Su, Xiulong Liu
11/06/2020Guest Speaker: Christopher Cueva

11/13/2020No meeting
11/20/2020Guest Speaker: Alexandra Libby
11/27/2020Thanksgiving Break - No meeting
12/4/2020Guest Speaker: Irina Higgins

12/4/2020Guest Speaker: Chuang Gan

12/11/2020Research Video Updates

2020 Summer Schedule

We are reading papers published in recent Top AI Conferences (CVPR 2020, ICML 2020)!

DatePaperKeywordsPresenterPresentation Link
7/30/2020Improving the Gating Mechanism of Recurrent Neural NetworksRNNRyan VogtGoogle Slides
Encoding Musical Style with Transformer AutoencodersMusic GenerationKun SuGoogle Slides
8/6/2020Controllable Orthogonalization in Training DNNsNetwork OptimizationYang ZhengGoogle Slides
Π´nets: Deep Polynomial Neural NetworksNetwork DesignJinlin XiangGoogle Slides
8/13/2020Forecasting Sequential Data Using Consistent Koopman AutoencodersTime Series PredictionSaba HeraviGoogle Slides
Learning to Combine Top-Down and Bottom-Up Signals in Recurrent Neural Networks with Attention over ModulesRNNJingyuan LiGoogle SLides
8/20/2020Disentangling and Unifying Graph Convolutions for Skeleton-Based Action RecognitionGraph, SkeletonRahul BiswasGoogle Slides
Do RNN and LSTM have Long MemoryRNNJimin KimGoogle Slides
8/27/2020XtarNet: Learning to Extract Task-Adaptive Representation for Incremental Few-Shot LearningIncremental LearningKun SuGoogle Slides
Approximating Stacked and Bidirectional Recurrent Architectures with the Delayed Recurrent Neural NetworkRNNSaba HeraviGoogle Slides
9/3/2020Transformers are RNNs: Fast Autoregressive Transformers with Linear AttentionRNNRyan VogtGoogle Slides
Deep Isometric Learning for Visual RecognitionNetwork DesignJiminGoogle Slides
9/10/2020Self-supervised Equivariant Attention Mechanism for Weakly Supervised Semantic SegmentationWeakly SupervisedJinlin XiangGoogle Slides
Towards Global Explanations of Convolutional Neural Networks with Concept AttributionInterpretabilityJingyuan LiGoogle Slides
9/17/2020Low-rank Compression of Neural Nets: Learning the Rank of Each LayerCompressionRahul BiswasGoogle Slides
Sign Language Transformers: Joint End-to-end Sign Language Recognition and TranslationYang ZhengGoogle Slides

About

NeuroAI-UW seminar, a regular weekly seminar for the UW community, organized by NeuroAI Shlizerman Lab.

Topics

Resources

Stars

58 stars

Watchers

6 watching

Forks

Releases

Packages

Contributors