Wednesdays Bi-Weekly

VIDY Paper Reading Group
2023 - 2024

Organized by Jiaqi Ma, Yujun Yan , Rex Ying , and Dawei Zhou


NEXT PRESENTATION


UML Chapter 31 & A PAC-Bayesian Approach to Spectrally-Normalized Margin Bounds for Neural Networks

by Pingbang Hu

Host: Dr. Ma

Summarizer: Fatimah Alotaibi

WEDNESDAY (8:30-10:00 PM), July 24TH, 2024



Join the Zoom Call

About

Welcome to our bi-weekly joint reading group with Dartmouth, UIUC, VT, and Yale.

To participate and subscribe to our email update, please kindly contact us.

Schedule

  • Tinglin Huang

    DiGress: Discrete Denoising Diffusion for Graph Generation

    Calendar Icon October 11th, 2023

  • Weikang Qiu

    Brain Network Transformer

    Calendar Icon October 25th, 2023

  • Menglin Yang

    Fully Hyperbolic Neural Networks

    Calendar Icon November 1st, 2023

  • Junwei Deng

    Certified Data Removal from Machine Learning Models

    Calendar Icon November 15th, 2023

  • Shuaicheng Zhang/ Longfeng Wu

    Chain-of-Thought Prompting Elicits Reasoning in Large Language Models
    Self-Consistency Improves Chain of Thought Reasoning in Language Models
    Least-to-Most Prompting Enables Complex Reasoning in Large Language Models
    Language Models are Multilingual Chain-of-Thought Reasoners

    Calendar Icon December 6th, 2023

  • Tuo Wang

    Dropout as Bayesian approximation: Representing Model Uncertainty in Deep Learning
    Simple and Scalable Predictive Uncertainty Estimation using Deep Ensembles

    Calendar Icon December 27th, 2023

  • Jialin Chen

    Geometric Latent Diffusion Models for 3D Molecule Generation

    Calendar Icon January 10th, 2024

  • Xingjian Zhang

    Learning to Execute Programs with Instruction Pointer Attention Graph Neural Networks

    Calendar Icon January 24th, 2024

  • Jianpeng Chen

    SchNet: A continuous-filter convolutional neural network for modeling quantum interactions
    Spherical Message Passing for 3D Molecular Graphs

    Calendar Icon February 14th, 2024

  • Ngoc Bui

    Graph Optimal Transport for Cross-Domain Alignment

    Calendar Icon February 28th, 2024

  • Zheng Huang

    ROLAND: Graph Learning Framework for Dynamic Graphs

    Calendar Icon March 6th, 2024

  • Gaotang Li

    UML Chapter 2 & 3 (ERM & PAC Learning)

    Calendar Icon March 27th, 2024

  • Haohui Wang

    UML Chapter 4 (Uniform Convergence)

    Calendar Icon April 17th, 2024

  • Xuyuan Liu

    UML Chapter 6 (VC Dimension)

    Calendar Icon May 29th, 2024

  • Zi Wang

    UML Chapter 30 & Stronger generalization bounds for deep nets via a compression approach

    Calendar Icon June 19th, 2024

  • Rebecca Salganik

    MocoSFL: enabling cross-client collaborative self-supervised learning

    Calendar Icon July 10th, 2024

  • Pingbang Hu

    UML Chapter 31 & A PAC-Bayesian Approach to Spectrally-Normalized Margin Bounds for Neural Networks

    Calendar Icon July 24th, 2024

Latest Recorded Talks

Whenever possible, slides will be available after each talk.

Organizerss

For questions, please contact us.

portfolio
Jiaqi Ma
University of Illinois Urbana-Champaign
portfolio
Yujun Yan
Dartmouth College
portfolio
Rex Ying
Yale University
portfolio
Dawei Zhou
Virginia Tech

Group Reading Logistics

The group reading is organized around the different “roles” students play each week: Presenter, Challenger, Discussant, Summarizer, and Hacker. Roles define the lens through which students read the paper.

  • Presenter: Create the main presentation, describing the motivation, problem definition, method, and experimental findings of this paper.
  • Challenger: Prepare 2-3 critical but not necessarily negative questions. Please note that this role does not require going over related work, and is not an exhaustive list of all arguments you can think of. What are your reactions to the Papers and why? What can the authors do to improve the Paper? Learning how to read other Papers with the critical eye of a good
  • Discussant: Propose an imaginary follow-up project (e.g., novel theorem, methodology, and applications) that has now become possible due to the existence and success of the current paper. Think about what is beyond this paper and the what are the connections with other papers? Come up with several discussion points (e.g., constructive ways to improve the paper, the relevance of the paper to academia and society).
  • Summarizer: Your responsibility is to help the audience understand the papers better. You should have read the papers carefully, taken time to understand their contributions, strengths and weaknesses, and what the audience needs to know about them. After the meeting, you should summarize the meeting discussion in 2-3 slides by including the paper's main message, contributions, limitations, and future directions. Collect all the reading materials (papers, presentation slides, summary slides) and upload them to our shared repository.
  • Hacker (optional): Implement a small part of the paper on a small dataset or toy problem, or any other simplified version of the paper. Share a Jupyter Notebook with the code of the algorithm with the reading group. This role is optional, i.e., you can declare if you would like to be a Hacker as an alternative for a specific week, for example, when you like the topic and would like to get hands-on experience, but no student will necessarily have to complete this role. Please do not simply download and run an existing implementation, make an effort to at least implement a core method from the paper. After all, your code does not have to be bug-free or run perfectly in all scenarios. Also, you are welcome to use (and give credit to) an existing implementation for “backbone” code (e.g. model building, data loading, training loop, etc.).