Skip to main content

Main navigation

  • About BCS
    • Mission
    • History
    • Building 46
      • Building 46 Room Reservations
    • Leadership
    • Employment
    • Contact
      • BCS Spot Awards
      • Building 46 Email and Slack
    • Directory
  • Faculty + Research
    • Faculty
    • Areas of Research
    • Postdoctoral Research
      • Postdoctoral Association and Committees
    • Core Facilities
    • InBrain
      • InBRAIN Collaboration Data Sharing Policy
  • Academics
    • Course 9: Brain and Cognitive Sciences
    • Course 6-9: Computation and Cognition
      • Course 6-9 MEng
    • Brain and Cognitive Sciences PhD
      • How to Apply
      • Program Details
      • Classes
      • Research
      • Student Life
      • For Current Students
    • Molecular and Cellular Neuroscience Program
      • How to Apply to MCN
      • MCN Faculty and Research Areas
      • MCN Curriculum
      • Model Systems
      • MCN Events
      • MCN FAQ
      • MCN Contacts
    • Computationally-Enabled Integrative Neuroscience Program
    • Research Scholars Program
    • Course Offerings
  • News + Events
    • News
    • Events
    • Recordings
    • Newsletter
  • Community + Culture
    • Community + Culture
    • Community Stories
    • Outreach
      • MIT Summer Research Program (MSRP)
      • Post-Baccalaureate Research Scholars
      • Conferences, Outreach and Networking Opportunities
    • Get Involved (MIT login required)
    • Resources (MIT login Required)
    • Upcoming Events
  • Give to BCS
    • Join the Champions of the Brain Fellows Society
    • Meet Our Donors

Utility Menu

  • Directory
  • Apply to BCS
  • Contact Us

Footer

  • Contact Us
  • Employment
  • Be a Test Subject
  • Login

Footer 2

  • McGovern
  • Picower

Utility Menu

  • Directory
  • Apply to BCS
  • Contact Us
Brain and Cognitive Sciences
Menu
MIT

Main navigation

  • About BCS
    • Mission
    • History
    • Building 46
    • Leadership
    • Employment
    • Contact
    • Directory
  • Faculty + Research
    • Faculty
    • Areas of Research
    • Postdoctoral Research
    • Core Facilities
    • InBrain
  • Academics
    • Course 9: Brain and Cognitive Sciences
    • Course 6-9: Computation and Cognition
    • Brain and Cognitive Sciences PhD
    • Molecular and Cellular Neuroscience Program
    • Computationally-Enabled Integrative Neuroscience Program
    • Research Scholars Program
    • Course Offerings
  • News + Events
    • News
    • Events
    • Recordings
    • Newsletter
  • Community + Culture
    • Community + Culture
    • Community Stories
    • Outreach
    • Get Involved (MIT login required)
    • Resources (MIT login Required)
    • Upcoming Events
  • Give to BCS
    • Join the Champions of the Brain Fellows Society
    • Meet Our Donors

Events

News Menu

  • News
  • Events
  • Newsletters

Breadcrumb

  1. Home
  2. Events
  3. Quest | CBMM Seminar Series - Chiyuan Zhang, Google
Quest | CBMM Seminar Series - Chiyuan Zhang, Google
Center for Brains, Minds and Machines (CBMM)

Quest | CBMM Seminar Series - Chiyuan Zhang, Google

Add to CalendarAmerica/New_YorkQuest | CBMM Seminar Series - Chiyuan Zhang, Google03/21/2023 4:00 pm03/21/2023 4:00 pmSingleton Auditorium,46-3002
March 21, 2023
4:00 pm
Location
Singleton Auditorium,46-3002
Contact
penagos@mit.edu
    Description

    Title: Quantifying and Understanding Memorization in Deep Neural Networks

    Abstract: Deep learning algorithms are well-known to have a propensity for fitting the training data very well and memorize idiosyncratic properties in the training examples. From a scientific perspective, understanding memorization in deep neural networks shed light on how those models generalize. From a practical perspective, understanding memorization is crucial to address privacy and security issues related to deploying models in real world applications. In this talk,  we present a series of studies centered at quantifying memorization in neural language models. We explain why in many real world tasks, memorization is necessary for optimal generalization. We also present quantitative studies on memorization, forgetting and unlearning of both vision and language models, to better understand the behaviors and implications of memorization in those models.

    Upcoming Events

    May
    Tue
    13
    McGovern Institute for Brain Research

    McGovern Institute Special Seminar with Dr. John Krakauer

    12:00pm to 1:00pm
    Add to CalendarAmerica/New_YorkMcGovern Institute Special Seminar with Dr. John Krakauer05/13/2025 12:00 pm05/13/2025 1:00 pmBuilding 46,3310
    May
    Fri
    16
    Simons Center for the Social Brain

    SCSB Lunch Series with Dr. Christopher Fell: Repurposing natural enzymes for large genomic edits

    12:00pm to 1:00pm
    Add to CalendarAmerica/New_YorkSCSB Lunch Series with Dr. Christopher Fell: Repurposing natural enzymes for large genomic edits05/16/2025 12:00 pm05/16/2025 1:00 pmSimons Center Conference room, 46-6011,46-6011
    May
    Mon
    19
    Department of Brain and Cognitive Sciences (BCS)

    NeuroLunch: Giselle Fernandes (Sur Lab) & Sabrina Drammis (TDS and Graybiel Lab)

    12:00pm to 1:00pm
    Add to CalendarAmerica/New_YorkNeuroLunch: Giselle Fernandes (Sur Lab) & Sabrina Drammis (TDS and Graybiel Lab)05/19/2025 12:00 pm05/19/2025 1:00 pmBuilding 46,3310
    See All Events
    Don't miss our next newsletter!
    Sign Up

    Footer menu

    • Contact Us
    • Employment
    • Be a Test Subject
    • Login

    Footer 2

    • McGovern
    • Picower
    Brain and Cognitive Sciences

    MIT Department of Brain and Cognitive Sciences

    Massachusetts Institute of Technology

    77 Massachusetts Avenue, Room 46-2005

    Cambridge, MA 02139-4307 | (617) 253-5748

    For Emergencies | Accessibility | Adapting to COVID

    Massachusetts Institute of Technology