Skip to content
← All work

2026 · AI / ML

wav2vec2 Layer Probing

A layer-by-layer study of spoken-digit and speaker information in wav2vec2.

  1. Speech recordings
  2. Layer-wise linear probes
  3. Pretraining comparison

wav2vec2 Layer Probing illustration

Layer-wise probe accuracy for pretrained and randomly initialized wav2vec2
Small-scale research reproductionGitHub ↗

Problem

Different layers of a speech model may encode different kinds of information.

My role

Designed and ran a layer-wise probing experiment with a random-weights comparison.

Approach

Results

Stack

Next projectShow and Tell Image Captioning ↗