fems logo

MIDI Movement Module: "M3"

Designed and Built by: Dr. Michel A. Lynch
© 1993


FOR 1993 PERFORMANCE PHOTOS CLICK HERE
FOR 1993 TECH PHOTOS CLICK HERE

    Computer System

    1Overview

    This design shows the computer system used to monitor dancer movements for the Ender's Game ballet. It consists of various dancer-mounted sensors connected to a 68HC11 computer. A data lransmission channel is used to format a serial bit stream with suitable formatting to move the data via an FM radio transmitter to a receiving system. The entire sensor, computer and transmitter system is mounted on the dancer. The receiving system consists of an FM receiver, a 68HC11 computer and MIDI interface. Its purpose is to receive the serial data stream Erom the dancer and reformat it for input into the MAX system running on a MacIntosh computer where the various sensor commands are reworked and elaborated for the musical purposes of the dance. The overall system is shown in Figure 1.

    Figure 1: The Overall System

    1.1 The Dancer-Mounted System: A more detailed block diagram of the Dancer-Mounted System is shown in Figure 2:

    Figure 2: The Dancer-Mounted System

    The Limb-Angle sensors are placed at the right and left elbows and the right and left knees to sense rotation of these joints. An analog voltage is sensed by the lower block of ADC channels in the 68HC11 Port E. This allows them to be monitored, as a block, with a different sampling frequency than the accelerometers.

    The two accelerometers are mounted in a vertical orientation, one on each leg below the knee. They consist of a tube containing two magnets and an analog Hall Effect Sensor to measure the magnetic field between the two magnets. One magnet levitates above the other in its repulsive magnetic field. The sensor presents an analog voltage that is proportional to the distance of the floating magnet above the fixed magnet (and sensor). If the dancer "stomps" his foot then the upper magnet is accelerated toward the lower (fixed) magnet thus causing the magnetic field between the magnets to decrease. This is a time-varying value that will be "peak-detected" by the computer. It will send a new accelerometer message whenever a peak is detected and it will append the maximum value of the peak.

    The four "Finger Switches" are mounted on the finger-tips of one hand. A magnet is sewn into the opposing thumb such that the dancer can place the thumb-magnet in contact with the surface of each sensor without touching the sensors on the adjacent finger-tips. Hall-Effect switches are used so that the only information that is transduced is whether the magnetic field is greater than a threshold value set by the switch specified. The dancer uses these switches for various "two-state" selections determined by the MAX program on the MacIntosh computer. The computer serializes a block of acquired data and Pulse-Width Modulates the serial bit stream for the FM transmitter. The PWM bit-stream will directly (DC) modulate the FM transmitter's carrier.

    1.2 The Receiving System: The architecture of the Receiving System is shown in Figure 3: The FM receiver will present the serial data channel to the Demodulator where the data clock will be recovered. The 68HC11 synchronous serial port converts the incoming serial stream into byte serial form with the aid of the recovered clock. The byte-serial data is reserialized into asynchronous form with suitable MIDI instructions and transmitted at the MIDI data rate to the MIDI adaptor. The MIDI adaptor drives the MIDI cable.

    Figure 3: The Receiving System

    The power subsystem for this section can be driven by an AC adapter since it is a stationary system. Battery backup may be included for reliability.

    2Transmitting System Subsections

    2.1 The Accelerometer: The accelerometer consists of a Hall Effect Magnetic field sensor piaced between two cylindrical permanent magnets. The magnets are placed in a close-fitting cylindrical tube with their North poles facing. One magnet is attached to the housing such that it and the Hall-Effect sensor are at rest with respect to each other. The second magnet "floats" above the first in a mutually repelling magnetic field. When the body of the cynlindrical containing tube is accelerated along its longitudinal axis the position of the "floating" magnet changes thus varying the magnetic field intensity at the Hall-Effect sensor location between the two magnets. The output of the Hall-Effect sensor is a voltage that represents the value of the magnetic field intensity at the sensor's location. For our purposes, we can AC couple the sensor's output voltage to suitable amplification circuitry since we are interested in only the impulses that are applied to the sensor container, not the steady state value of the magnetic field.

    The AC coupled signal is amplified and level shifted before being applied to the Analog-to-Digital converter in the computer as shown in Figure 4.

    Figure 4: The Accelerometer

    2.2 The Limb-Angle Sensors: The limb-angle is sensed by using a potentiometer attached to the limb above and below the joint being monitored. The case of the potentiometer is anchored to a metal strip that is attached to the limb on one side of the joint. The "wiper" of the potentiometer is similarly anchored to a metal strip that is attached to the other side of the joint. The angle between the metal strips is translated to an analog voltage on the wiper terminal of the potentiometer relative to one of the end terminals.

    The potentiometer output is level-shifted and amplified to match the input range (0-5V) of the Analog-to-Digital input port of the MC68HC11 computer as shown in Figure 5.

    Figure 5: The Limb-Angle Sensor

    RIGHT LEG: CONTROLLER 7 ON CHANNEL 1 (PITCHBEND) AD_CHAN4
    LEFT LEG: CONTROLLER 7 ON CHANNEL 2 (VOLUME) AD_CHAN5
    LEFT ARM: CONTROLLER 7 ON CHANNEL 3 (VELOCITY) AD_CHAN7
    RIGHT ARM: CONTROLLER 7 ON CHANNEL 4 (PITCH - NOTE GENERATOR) AD_CHAN6

    Potentiometer
    Position
    Male DB 15
    Plug Pins
    MCU Port EVBU J4 MCU socket
    Signal Power Ground
    Right Arm 6 1 11 PE6 (AW) 48 48
    Left Arm 7 2 12 PE7 (AD7) 50 50
    Right Leg 8 3 13 PE4 (AD4) 44 44
    Left Leg 9 4 14 PE5 (AD5) 46 46

    Table 1: Limb-Angle Sensor Connections

    Figure 6: The Potentiometer Connector

    2.3 The Glove Sensors: The Glove Sensors consist of Hall-Effect Switches (Sprague UGN 3013) attached to the fingers and pa]m of a left-handed glove. The Hall-Effect Switch differs from a Hall-Effect Sensor in that its output assumes only two states (a voltage near zero and a voltage near 5V) depending on whether a magnet is nearby. The outputs of each Hall-Effect Switch are applied to the input port of the 68HC11 computer (PORTC) where they are read just like any other switch. MIDI NoteOn and NoteOff commands are generated on channel one.

    GLOVE: NOTEON - SWITCH ON; NOTEOFF- SWITCH OFF
    CHANNEL 1
    MIDI NOTE NUMBER: 56 - INDEX, 57 - MIDDLE, 59 - RING, 60 - LITTLE, PALM - 58
    VELOCITY: 127

    Hall-Effect Switch
    Finger Position
    Male DB 9
    Plug Pins
    MCU Port EVBU J4 MCU socket
    Signal Power Ground
    Index 2 1 6 PC4 13 13
    Middle 3 1 6 PC3 12 12
    Palm 4 1 6 PC2 10 10
    Ring 5 1 6 PC1 10 10
    Little 9 1 6 PC0 9 9

    Table 2: Glove Sensor Connections

    Figure 7: Glove Subsystem of the Dancer Computer System

    2.4 The Card Sensors: The Card Sensors are Hall-Effect Switches mounted on small printed circuit boards (1" x 1") for mechanical stability. The cards are slipped into pockets on the vest of the costume. They are connected as shown in Table 3. The Card Sensors generate MIDI Program Change commands.

    PC 1 ON CHANNEL 1 (PLAY STOP) SHOULDER (CARD 1)
    PC 2 ON CHANNEL 2 (RECORD STOP) CHEST (CARD 2)
    PC 3 ON CHANNEL 3 (PULSE TRIGGER) THIGH (CARD 3)
    PC 4 ON CHANNEL 4 (PROG CHANGE) HIP (CARD 4)

    Hall-Effect Switch
    Finger Position
    Male DB 15
    Plug Pins
    MCU Port EVBU J4 MCU socket
    Number Signal Power Ground
    Shoulder 1 6 1 11 PA1 33 33
    Chest 2 7 2 12 PA0 33 34
    Thigh 3 8 3 13 PC6 33 15
    Hip 4 9 4 14 PC5 33 14

    Table 3: Card Sensor Connections

fems home UF fems courses
- last update November 21, 2002 -