Headpieces That Sound Through Touch

Series: alt.ctrl activities

Made by Tess Buckley with Adrian Freed, at the Stochastic Labs residency. Two e-textile headpieces, crocheted with conductive thread and stabilised with Kevlar, each make their own sound, one in a minor key and one in major, and make more sound as their wearers touch. The circuit closes only through contact.

These pieces start from a simple, physical question: what does touch, connection, and intimacy sound like? The interest here isn't in data for its own sake, but in the physicality of closing a circuit, a loop completed through connection with another person.

To explore this question I made these headpieces in collaboration with Adrian Freed during my summer residency in creative technology at Stochastic Labs […]

Clothes already do this, quietly, without any circuitry at all. We might wear a partner's jumper because it still smells like them. We keep a cardigan because it was our grandmother's. We reach for certain colours on hard days the way we reach for a mood we want to borrow, or wear them as armour when we need one.

The costumes are built for exactly this kind of contact: two e-textile garments that each can generate their own audio (one tuned to a minor key, the other to major) and produce more sound as the wearers come into contact. In this way, friction becomes signal: the closer the touch, the more the sound builds, so the depth, discomfort and clumsiness of getting close to someone is written into the piece as much as the tenderness is. Worn by two dancers (eventually), they form a closed circuit for sound, completed only through touch, so that connection is felt and heard at once, and the importance of being held becomes, briefly, audible.

Visually, the garments borrow from helmets and chain mail: protective, armoured forms but crocheted with conductive thread and stabilised with Kevlar, the material invented by American chemist Stephanie Kwolek and used in bulletproof vests, rather than forged. That contradiction is the point. Contact can be difficult, guarded, something we brace for rather than invite and yet we're a social species, wired to seek it out regardless. The holed, soft armour doesn't refuse touch; it simply tells the truth about what touch can cost, while the sound underneath tells the truth about why we reach for it anyway.

The two headpieces are now left in Berkley, California with Héloïse Garry for further play and performance by dancers.

*semi-inspired by my "tactile - auditory synesthesia", which I learned about this summer while chatting with Adrian !!

Tess Buckley, in a LinkedIn post about the pieces
The two finished headpieces, working (17 seconds, with sound).

Materials

ItemAmazonM5StackMouser
Conductive thread, for the sensing regions of the crochet
Non-conductive thread, crocheted between the regions to isolate them electrically
A little very conductive thread, such as silver-plated Kevlar or nylon, threaded through each region
Silicone-clad hookup wire, one length for each region
For each headpiece, an M5Stack Capsule (ESP32-S3) as the microcontroller, using inputs that can sense capacitance, one for each region (four in the examples); the link is to the Capsule Kit v1.1 with M5StampS3AK129-V11170-K129-V11
For each headpiece, an M5Stack MIDI Synthesizer Unit (SAM2695), which plays the notes through its built-in 8 Ω, 1 W speaker; it takes MIDI over serial through its Grove cableU178170-U178

Tools

  • A crochet hook
  • Soldering iron
  • An MCU IDE

Skills

  • Crochet, changing threads
  • Soldering
  • Programming capacitive sensing on an MCU

Instructions

  1. Crochet each headpiece, in protective forms borrowed from helmets and chain mail, changing between conductive and non-conductive thread so that the conductive parts form electrically isolated regions: four in each of the examples.
  2. Thread a little very conductive thread, such as silver-plated Kevlar or nylon, through each region: it increases the region's capacitance and makes the sensing more reliable.
  3. Tie a silicone-clad wire to each region with a knot, and solder the wires to MCU inputs that can sense capacitance.
  4. Program the start-up: measure each patch's baseline capacitance, then play a special tone sequence to signal that the patches can be touched.
  5. Give each patch a clearly different sound, such as the pitches of a chord, so that you can hear that every patch is sensed reliably. The examples tune one headpiece to a minor key and the other to major.
  6. Connect each headpiece's MIDI Synthesizer Unit to its Capsule with the Grove cable, and send it MIDI notes over serial; the unit plays them through its built-in speaker.
  7. Wear them, two people (in time, two dancers): the closer the contact, the more the sound builds; the circuit for sound closes only through touch.
Crocheting a headpiece (24 seconds, no sound).

Variations

  • Crochet more or fewer isolated regions; the examples have four in each headpiece.

Related resources

Coding Prompt Build Block

A prompt to give a coding assistant, to start the code for this activity. Copy the box, answer its questions about your board and pins, and test what comes back on the bench before you rely on it.

I am building "Headpieces That Sound Through Touch", the activity at https://adrianfreed.com/touch-sounding-headpieces.html.

Write a program for an ESP32-S3 (an M5Stack Capsule) in a crocheted headpiece: four conductive regions, each wired to a pin that can sense touch, and an M5Stack MIDI Synthesizer Unit (SAM2695) on serial through its Grove cable, which plays the notes through its own speaker.

At start-up, measure each region's baseline, then play a special tone sequence to signal that the regions can be touched. Give each region a clearly different sound, such as the pitches of a chord, so that you can hear that every region is sensed reliably; one headpiece is in a minor key and the other in major. The closer the contact, the more the sound builds: map how far each reading moves from its baseline to the loudness of its note, and let the baseline follow slow drift while nothing touches the region.

Libraries to explore:

Before writing anything, ask me what I am using: the board and its pins, or the software (such as Max, Pd or Python), and check its documentation for what this needs. Put the pin numbers, ranges and other settings in one block at the top, each with a comment. Say which of the libraries above you use, and why. Start with a test that shows the raw readings, so that I can check the wiring and the ranges before the rest.

This activity by Adrian Freed and Tess Buckley is licensed under Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International (CC BY-NC-SA 4.0): you may share and adapt it with attribution, for non-commercial purposes such as personal projects and teaching, and you must share adaptations under the same licence. Product names and links belong to their suppliers.

Design strategies: