Skip to main content

Main navigation

  • About BCS
    • Mission
    • History
    • Building 46
      • Building 46 Room Reservations
    • Leadership
    • Employment
    • Contact
      • Building 46 Email and Slack
    • Directory
  • Faculty + Research
    • Faculty
    • Areas of Research
    • Postdoctoral Research
      • Postdoctoral Association and Committee
    • Core Facilities
    • InBrain
      • InBRAIN Collaboration Data Sharing Policy
  • Academics
    • Course 9: Brain and Cognitive Sciences
    • Course 6-9: Computation and Cognition
      • Course 6-9 MEng
    • Brain and Cognitive Sciences PhD
      • How to Apply
      • Program Details
      • Classes
      • Research
      • Student Life
      • For Current Students
    • Molecular and Cellular Neuroscience Program
      • How to Apply to MCN
      • MCN Faculty and Research Areas
      • MCN Curriculum
      • Model Systems
      • MCN Events
      • MCN FAQ
      • MCN Contacts
    • Computationally-Enabled Integrative Neuroscience Program
  • News + Events
    • News
    • Events
    • Recordings
    • Newsletter
  • Diversity + Equity + Inclusion
    • DEIJ Mission and Vision
    • Strategic Plan
    • Community and Culture
    • Resources
      • DEIJ Readings & Workshop Materials
      • Learning
      • Resources (MIT Login Required)
    • Outreach
      • MIT Summer Research Program (MSRP)
      • Post-Baccalaureate Research Scholars
      • Volunteer Opportunities
    • Get Involved / Upcoming Events

Utility Menu

  • Directory
  • Give to BCS
  • Apply to BCS
  • Contact Us

Footer

  • Contact Us
  • Employment
  • Be a Test Subject
  • Login

Footer 2

  • McGovern
  • Picower

Utility Menu

  • Directory
  • Give to BCS
  • Apply to BCS
  • Contact Us
Brain and Cognitive Sciences
Menu
MIT

Main navigation

  • About BCS
    • Mission
    • History
    • Building 46
    • Leadership
    • Employment
    • Contact
    • Directory
  • Faculty + Research
    • Faculty
    • Areas of Research
    • Postdoctoral Research
    • Core Facilities
    • InBrain
  • Academics
    • Course 9: Brain and Cognitive Sciences
    • Course 6-9: Computation and Cognition
    • Brain and Cognitive Sciences PhD
    • Molecular and Cellular Neuroscience Program
    • Computationally-Enabled Integrative Neuroscience Program
  • News + Events
    • News
    • Events
    • Recordings
    • Newsletter
  • Diversity + Equity + Inclusion
    • DEIJ Mission and Vision
    • Strategic Plan
    • Community and Culture
    • Resources
    • Outreach
    • Get Involved / Upcoming Events

Events

News Menu

  • News
  • Events
  • Newsletters

Breadcrumb

  1. Home
  2. Events
  3. Quest | CBMM Seminar Series - Chiyuan Zhang, Google
Quest | CBMM Seminar Series - Chiyuan Zhang, Google
Center for Brains, Minds and Machines (CBMM)

Quest | CBMM Seminar Series - Chiyuan Zhang, Google

Add to CalendarAmerica/New_YorkQuest | CBMM Seminar Series - Chiyuan Zhang, Google03/21/2023 4:00 pm03/21/2023 4:00 pmSingleton Auditorium,46-3002
March 21, 2023
4:00 pm
Location
Singleton Auditorium,46-3002
Contact
penagos@mit.edu
    Description

    Title: Quantifying and Understanding Memorization in Deep Neural Networks

    Abstract: Deep learning algorithms are well-known to have a propensity for fitting the training data very well and memorize idiosyncratic properties in the training examples. From a scientific perspective, understanding memorization in deep neural networks shed light on how those models generalize. From a practical perspective, understanding memorization is crucial to address privacy and security issues related to deploying models in real world applications. In this talk,  we present a series of studies centered at quantifying memorization in neural language models. We explain why in many real world tasks, memorization is necessary for optimal generalization. We also present quantitative studies on memorization, forgetting and unlearning of both vision and language models, to better understand the behaviors and implications of memorization in those models.

    Upcoming Events

    Mar
    Tue
    21
    Department of Brain and Cognitive Sciences (BCS)

    Cog Lunch: Sugandha Sharma "Functional utility of hierarchical spatial representations, and their underlying mechanisms in the Hippocampal Complex"

    12:00pm to 1:00pm
    Add to CalendarAmerica/New_YorkCog Lunch: Sugandha Sharma "Functional utility of hierarchical spatial representations, and their underlying mechanisms in the Hippocampal Complex"03/21/2023 12:00 pm03/21/2023 1:00 pm46-3002,Singleton Auditorium
    Mar
    Thu
    23
    The Picower Institute for Learning and Memory

    Picower Special Seminar with Lina Marcela Carmona, PhD, "Cell type and Cell State Engagement During Motor Learning "

    10:00am to 11:00am
    Add to CalendarAmerica/New_YorkPicower Special Seminar with Lina Marcela Carmona, PhD, "Cell type and Cell State Engagement During Motor Learning "03/23/2023 10:00 am03/23/2023 11:00 amBuilding 46,46-3310 (THIRD FLOOR, PICOWER SEMINAR ROOM)
    Mar
    Thu
    23
    The Picower Institute for Learning and Memory

    Colloquium on the Brain and Cognition with Adam Kepecs, PhD, Washington University in St. Louis, "Neural architecture of confidence"

    4:00pm to 5:00pm
    Add to CalendarAmerica/New_YorkColloquium on the Brain and Cognition with Adam Kepecs, PhD, Washington University in St. Louis, "Neural architecture of confidence"03/23/2023 4:00 pm03/23/2023 5:00 pmBuilding 46,46-3002, Singleton Auditorium (Third Floor)
    See All Events
    Don't miss our next newsletter!
    Sign Up

    Footer menu

    • Contact Us
    • Employment
    • Be a Test Subject
    • Login

    Footer 2

    • McGovern
    • Picower
    Brain and Cognitive Sciences

    MIT Department of Brain and Cognitive Sciences

    Massachusetts Institute of Technology

    77 Massachusetts Avenue, Room 46-2005

    Cambridge, MA 02139-4307 | (617) 253-5748

    For Emergencies | Accessibility | Adapting to COVID

    Massachusetts Institute of Technology