TED2008
Tod Machover + Dan Ellsey: Inventing instruments that unlock new music
托德 馬克弗和丹 埃爾西演奏新音樂
Filmed:
Readability: 4.1
578,384 views
(Click to translate into Chinese (Traditional))
Tod Machover - Composer, inventor
At MIT's Media Lab, Tod Machover creates boundary-breaking new music, often using new instruments and music technologies he has invented. Full bioDan Ellsey - Musician
Dan Ellsey uses Hyperscore music software and a custom-tuned musical "hyperinstrument" to write, perform and conduct his music, and to help others learn how to compose. Full bio
At MIT's Media Lab, Tod Machover creates boundary-breaking new music, often using new instruments and music technologies he has invented. Full bioDan Ellsey - Musician
Dan Ellsey uses Hyperscore music software and a custom-tuned musical "hyperinstrument" to write, perform and conduct his music, and to help others learn how to compose. Full bio
Double-click the English transcript below to play the video.
00:18
The first idea I'd like to suggest is that we all
0
0
2000
音樂，大家都非常熱愛它
00:20
love music a great deal. It means a lot to us.
1
2000
3000
因為它對於我們很重要。
00:23
But music is even more powerful if you don't just listen to it, but you make it yourself.
2
5000
6000
假如你不只是作為一名聽眾，而且還能親自參與創作，那麼音樂會對你更具影響力
00:29
So, that's my first idea. And we all know about the Mozart effect --
3
11000
3000
所以，這是我要講的第一點。在最近5-10年裡頭
00:32
the idea that's been around for the last five to 10 years --
4
14000
3000
有個著名的莫札特效應，
00:35
that just by listening to music or by playing music to your baby [in utero],
5
17000
4000
講的是只靠聽音樂，或者是給胎兒播放音樂，
00:39
that it'll raise our IQ points 10, 20, 30 percent.
6
21000
4000
就可以使我們的智商提高10%到30%，
00:43
Great idea, but it doesn't work at all.
7
25000
3000
這真是個好主意，但是根本行不通。
00:46
So, you can't just listen to music, you have to make it somehow.
8
28000
3000
因為只是聽是不夠的，你還必須設法創作音樂。
00:49
And I'd add to that, that it's not just making it,
9
31000
4000
而且，我還要說，這不僅僅是這樣，
00:53
but everybody, each of us, everybody in the world
10
35000
2000
我們每一個人、世界上的所有的人，
00:55
has the power to create and be part of music in a very dynamic way,
11
37000
4000
都具有能力去創作，並以動態的方式讓自己和音樂融為一體，
00:59
and that's one of the main parts of my work.
12
41000
2000
這是我所從事的工作中非常重要的一部分。
01:01
So, with the MIT Media Lab, for quite a while now,
13
43000
2000
所以，這段時間裡，我和我的同事在美國麻省理工學院媒體實驗室(MIT Media Lab)裡，
01:03
we've been engaged in a field called active music.
14
45000
2000
致力於發展主動音樂。
01:05
What are all the possible ways that we can think of
15
47000
2000
藉由任何我們可以想到的可行的途徑，
01:07
to get everybody in the middle of a musical experience,
16
49000
3000
使得人人都可以融入音樂體驗，
01:10
not just listening, but making music?
17
52000
3000
而且不只是聽音樂，還能創造音樂。
01:13
And we started by making instruments for some of the world's greatest performers --
18
55000
3000
一開始，我們製造樂器給馬友友 Peter Gabriel,Prince等人，
01:16
we call these hyperinstruments -- for Yo-Yo Ma, Peter Gabriel, Prince,
19
58000
3000
而我們稱這些由管絃以及搖滾樂團製作的樂器為超級樂器(Hyper Instruments)，
01:19
orchestras, rock bands. Instruments where they're all kinds of sensors
20
61000
4000
這種樂器具備多種感官感應器，
01:23
built right into the instrument, so the instrument knows how it's being played.
21
65000
3000
用來感知我們是如何演奏的。
01:26
And just by changing the interpretation and the feeling,
22
68000
3000
所以，我只要稍微改變我的演奏方式以及情感
01:29
I can turn my cello into a voice, or into a whole orchestra,
23
71000
3000
我可以把我的大提琴演奏聲轉變成和諧的人聲，一個樂團的協奏，
01:32
or into something that nobody has ever heard before.
24
74000
3000
或者是大家從未聽過的天籟之音。
01:35
When we started making these, I started thinking, why can't we make
25
77000
2000
當我們開始製作時，我開始思考
01:37
wonderful instruments like that for everybody,
26
79000
2000
為什麼我們不能創造出一個完美的樂器，使得平凡人
01:39
people who aren't fantastic Yo-Yo Mas or Princes?
27
81000
4000
而不僅僅是馬友友或者Princes所演奏的?
01:43
So, we've made a whole series of instruments.
28
85000
2000
所以，我們製作的一整個系列的樂器。
01:45
One of the largest collections is called the Brain Opera.
29
87000
3000
我們統稱它為「頭腦歌劇」。
01:48
It's a whole orchestra of about 100 instruments,
30
90000
2000
這整個管絃樂隊大概有100個樂器
01:50
all designed for anybody to play using natural skill.
31
92000
3000
都是以平常人的自然演奏方式去設計的。
01:53
So, you can play a video game, drive through a piece of music,
32
95000
3000
所以，你可以一邊玩遊戲，"駛"過一段音樂
01:56
use your body gesture to control huge masses of sound,
33
98000
3000
用你的肢體語言去控制大量的聲音
01:59
touch a special surface to make melodies, use your voice to make a whole aura.
34
101000
5000
觸碰一個特別的介面去製造旋律，用你的聲音去製造整個氛圍。
02:04
And when we make the Brain Opera, we invite the public to come in,
35
106000
2000
當我們製作頭腦歌劇時，我們邀情一邊大眾加入
02:06
to try these instruments and then collaborate with us
36
108000
3000
去體驗這些樂器並且和我們合作，
02:09
to help make each performance of the Brain Opera.
37
111000
1000
舉辦了多場的頭腦歌劇。
02:10
We toured that for a long time. It is now permanently in Vienna,
38
112000
3000
我們巡迴持續相當長的一段時間。現在，在音樂之都維也納，
02:13
where we built a museum around it.
39
115000
2000
我們還建造了一個永久性的博物館。
02:15
And that led to something which you probably do know.
40
117000
3000
這些促使吉他英雄(Guitar Hero)的誕生，
02:18
Guitar Hero came out of our lab,
41
120000
1000
相信大多數的人都知道這些都源於我們的實驗室。
02:19
and my two teenage daughters and most of the students at the MIT Media Lab
42
121000
3000
我從我兩個小女兒和大多數在MIT實驗室裡的學生身上，
02:22
are proof that if you make the right kind of interface,
43
124000
3000
得到證實。就是，只要你提供適當的交界面，
02:25
people are really interested in being in the middle of a piece of music,
44
127000
4000
人們就會真正的融入音樂
02:29
and playing it over and over and over again.
45
131000
3000
而且對這樣的演奏方式樂此不疲。
02:32
So, the model works, but it's only the tip of the iceberg,
46
134000
3000
所以，這樣的模式是可行的，但這只是冰山一角，
02:35
because my second idea is that it's not enough just to want
47
137000
3000
我的第二觀點是，
02:38
to make music in something like Guitar Hero.
48
140000
3000
僅用"吉他英雄"這類的東西來做音樂是不夠的。
02:41
And music is very fun, but it's also transformative.
49
143000
3000
音樂不僅非常有趣，而且也頗具變化性。
02:44
It's very, very important.
50
146000
1000
這是非常非常重要的一點。
02:45
Music can change your life, more than almost anything.
51
147000
3000
音樂可以改變你的人生，勝過任何其他東西。
02:48
It can change the way you communicate with others,
52
150000
2000
它可以改變你和其他人溝通的方式，
02:50
it can change your body, it can change your mind. So, we're trying
53
152000
3000
還能改變你的身心靈。所以我們嘗試突破
02:53
to go to the next step of how you build on top of something like Guitar Hero.
54
155000
4000
也就是想在"吉他英雄"這類東西的基礎上做些什麼。
02:57
We are very involved in education. We have a long-term project
55
159000
3000
我們深入到教育界，開展了一個長久的計畫
03:00
called Toy Symphony, where we make all kinds of instruments that are also addictive,
56
162000
4000
稱為「玩具交響樂」(Toy Symphony)。我們製作各式各樣好玩的樂器
03:04
but for little kids, so the kids will fall in love with making music,
57
166000
4000
但是是給小孩子的，期望他們會愛上演奏音樂，
03:08
want to spend their time doing it, and then will demand to know how it works,
58
170000
3000
想要在這方面投入時間，而且渴求學習樂理知識，
03:11
how to make more, how to create. So, we make squeezy instruments,
59
173000
3000
以及如何演奏，如何創造音樂。所以我們製做一個可捏的樂器，
03:14
like these Music Shapers that measure the electricity in your fingers,
60
176000
4000
比如說這個可以測量你指尖的電流的音樂塑型機(Music Shapers)
03:18
Beatbugs that let you tap in rhythms -- they gather your rhythm,
61
180000
3000
又如這個敲擊節奏的節拍蟲子(Beat Bugs)，你可以用他們來蒐集節奏，
03:21
and like hot potato, you send your rhythm to your friends,
62
183000
2000
傳遞這個節奏就像是傳送熱洋芋給你的朋友，
03:23
who then have to imitate or respond to what your doing --
63
185000
3000
他們需要模仿你，或者對你的動作做出回應
03:26
and a software package called Hyperscore, which lets anybody use lines and color
64
188000
4000
再來就是製造一個稱為"超級樂譜"(Hyperscore)的軟件。可以讓大家用線條以及顏色
03:30
to make quite sophisticated music. Extremely easy to use, but once you use it,
65
192000
4000
去創造一個複雜的音樂。其操作容易，一旦你上了手
03:34
you can go quite deep -- music in any style. And then, by pressing a button,
66
196000
4000
你可以應付任何曲風的音樂。最後只要按下按鈕，
03:38
it turns into music notation so that live musicians can play your pieces.
67
200000
6000
這些音樂就會自動轉換成樂譜，以便音樂家來演奏你創作的樂曲。
03:44
We've had good enough, really, very powerful effects with kids
68
206000
3000
這個軟件，在全世界各地的孩子以及不同年齡層的人身上，
03:47
around the world, and now people of all ages, using Hyperscore.
69
209000
3000
都得到了非常良好、顯著的效果。
03:50
So, we've gotten more and more interested in using these kinds of creative activities
70
212000
4000
所以，我們樂於將這類的創意
03:54
in a much broader context, for all kinds of people
71
216000
2000
加入到更廣泛的人群之中，
03:56
who don't usually have the opportunity to make music.
72
218000
3000
讓那些沒有機會進行音樂創作的人也能積極參與。
03:59
So, one of the growing fields that we're working on
73
221000
1000
其中，我們的實驗室正在著手一個領域
04:00
at the Media Lab right now is music, mind and health.
74
222000
3000
叫做音樂、心靈、健康。
04:03
A lot of you have probably seen Oliver Sacks' wonderful new book called
75
225000
3000
相信很多人都讀過奧利佛 薩克斯(Oliver Sacks')的新書
04:06
"Musicophilia". It's on sale in the bookstore. It's a great book.
76
228000
4000
《腦袋裝了兩千部歌劇的人》，這是一本正在熱賣的好書。
04:10
If you haven't seen it, it's worth reading. He's a pianist himself,
77
232000
2000
如果你還沒看過，那我推薦你讀一讀。書的作者是一個鋼琴家，
04:12
and he details his whole career of looking at and observing
78
234000
4000
他在書中詳細地記錄了自己職業生涯中所觀察到的事實，
04:16
incredibly powerful effects that music has had on peoples' lives in unusual situations.
79
238000
5000
那就是音樂在非常狀態下的人身上（殘疾 /重症病人），所能發生的不可思議的效應。
04:21
So we know, for instance, that music is almost always the last thing
80
243000
3000
正如大家所知道的那樣，
04:24
that people with advanced Alzheimer's can still respond to.
81
246000
4000
音樂是老年癡呆症病患晚期能做出回應的最後一件事情。
04:28
Maybe many of you have noticed this with loved ones,
82
250000
2000
也許不少人在摯愛身上發現這點，
04:30
you can find somebody who can't recognize their face in the mirror,
83
252000
2000
他們無法在鏡子中認出自己、分辨自己的家人，
04:32
or can't tell anyone in their family, but you can still find a shard of music
84
254000
3000
但你仍然能找到一段音樂，
04:35
that that person will jump out of the chair and start singing. And with that
85
257000
4000
讓他們從病床上驚醒，並且輕聲唱和。正是藉由這種方式，
04:39
you can bring back parts of people's memories and personalities.
86
261000
2000
你可以喚回一些他們的記憶以及自我意識。
04:41
Music is the best way to restore speech to people who have lost it through strokes,
87
263000
4000
對於中風所導致的失語症，以及帕金森氏症所導致的運動功能喪失，
04:45
movement to people with Parkinson's disease.
88
267000
2000
音樂是最好的治療方法。
04:47
It's very powerful for depression, schizophrenia, many, many things.
89
269000
4000
它對抑鬱症、精神分裂症以及其他許許多多的病症都頗具療效。
04:51
So, we're working on understanding those underlying principles
90
273000
2000
所以我們正在探索其背後的原理，
04:53
and then building activities which will let music really improve people's health.
91
275000
4000
並展開一系列的活動，用音樂來改善人類的健康。
04:57
And we do this in many ways. We work with many different hospitals.
92
279000
3000
我們採取了很多方式，和各類醫院有著合作。
05:00
One of them is right near Boston, called Tewksbury Hospital.
93
282000
3000
其中有一家就是離美國波士頓不遠的圖斯伯里醫院。
05:03
It's a long-term state hospital, where several years ago
94
285000
2000
這是一家歷史悠久的州立醫院。許多年前，
05:05
we started working with Hyperscore and patients with physical and mental disabilities.
95
287000
4000
我們在那裡就開始將“超級樂譜” (Hyperscore) 介紹給生理和精神殘疾病人。
05:09
This has become a central part of the treatment at Tewksbury hospital,
96
291000
4000
這已成為圖斯伯里醫院核心治療項目，
05:13
so everybody there clamors to work on musical activities.
97
295000
4000
每個接受治療的人都要求參與音樂活動。
05:17
It's the activity that seems to accelerate people's treatment the most
98
299000
4000
這一活動似乎大大加速了治療的過程，
05:21
and it also brings the entire hospital together as a kind of musical community.
99
303000
4000
在某種程度上也把醫院變成音樂社區。
05:25
I wanted to show you a quick video of some of this work before I go on.
100
307000
4000
繼續下一個話題之前，我想先給大家看些以上內容的相關短片。
06:10
Video: They're manipulating each other's rhythms.
101
352000
2000
（這些玩具交響樂的）參與者在操控音樂節奏。
06:12
It's a real experience, not only to learn how to play and listen to rhythms,
102
354000
4000
通過親身體驗，孩子們不但學會了怎樣演奏和聽節奏，
06:16
but to train your musical memory and playing music in a group.
103
358000
5000
而且鍛煉了音樂記憶，練習了合奏。
06:21
To get their hands on music, to shape it themselves, change it,
104
363000
4000
他們“拿”著音樂，捏一捏，
06:25
to experiment with it, to make their own music.
105
367000
2000
改變和體驗它，並創作自己的音樂。
06:27
So Hyperscore lets you start from scratch very quickly.
106
369000
4000
“超級樂譜”從塗塗畫畫開始，很便捷。
06:38
Everybody can experience music in a profound way,
107
380000
2000
每個人都可以深刻地體驗音樂，
06:40
we just have to make different tools.
108
382000
2000
我們所必須做的就是創造各種各樣的工具（來幫助大家）。
06:59
The third idea I want to share with you is that music, paradoxically,
109
401000
6000
第三點想法是：我覺得音樂，異乎尋常地，
07:05
I think even more than words, is one of the very best ways we have
110
407000
3000
是比語言更好的展示自我的方式。
07:08
of showing who we really are. I love giving talks, although
111
410000
4000
我也喜歡做演講，
07:12
strangely I feel more nervous giving talks than playing music.
112
414000
2000
但是奇怪的是，我在演講時，比演奏音樂感覺要更緊張些。
07:14
If I were here playing cello, or playing on a synth, or sharing my music with you,
113
416000
3000
當在演奏大提琴，控制電子音響合成器，或者和你們共同分享我的音樂時，
07:17
I'd be able to show things about myself that I can't tell you in words,
114
419000
5000
我就能展現無法用語言描述的一面，
07:22
more personal things, perhaps deeper things.
115
424000
3000
更多的是個人的東西，也許更深層的東西。
07:25
I think that's true for many of us, and I want to give you two examples
116
427000
3000
對於我們中許多人來講，我想的確是這樣。我想舉兩個例子，
07:28
of how music is one of the most powerful interfaces we have,
117
430000
3000
來說明音樂是我們與外界交流的
07:31
from ourselves to the outside world.
118
433000
2000
最有效的媒介之一。
07:33
The first is a really crazy project that we're building right now, called
119
435000
4000
首先是我們現在正在進行的一個非常瘋狂的項目，名字叫作“死亡和鮑威爾一家”(Death and Powers)。
07:37
Death and the Powers. And it's a big opera,
120
439000
2000
它是一部大型歌劇，
07:39
one of the larger opera projects going on in the world right now.
121
441000
4000
是目前全球在運作中的大型歌劇項目之一。
07:43
And it's about a man, rich, successful, powerful, who wants to live forever.
122
445000
5000
它是關於一位富有、成功、有權勢並期望永生的人的歌劇。
07:48
So, he figures out a way to download himself into his environment,
123
450000
2000
他找到了把自己下載到他所建立的環境中
07:50
actually into a series of books.
124
452000
3000
事實上是把自己放在一系列的書籍中。
07:53
So this guy wants to live forever, he downloads himself into his environment.
125
455000
3000
於是，他想長生不老，就把自己放進了系統中。
07:56
The main singer disappears at the beginning of the opera
126
458000
4000
主唱在歌劇開始後便消失了，
08:00
and the entire stage becomes the main character. It becomes his legacy.
127
462000
4000
整個舞台變成了主角，變成了他的遺贈。
08:04
And the opera is about what we can share, what we can pass on to others,
128
466000
3000
這部歌劇講的是，我們能和所愛的人分享些什麼，向他們傳承些什麼，
08:07
to the people we love, and what we can't.
129
469000
2000
又有什麼是我們辦不到的。
08:09
Every object in the opera comes alive and is a gigantic music instrument,
130
471000
4000
歌劇中的所有道具都是活的、巨型的樂器。
08:13
like this chandelier. It takes up the whole stage. It looks like a chandelier,
131
475000
3000
譬如，佔據舞台很大部份的一盞“吊燈。”它看上去像個吊燈，
08:16
but it's actually a robotic music instrument.
132
478000
2000
但同時又是一件機器人樂器。
08:18
So, as you can see in this prototype, gigantic piano strings,
133
480000
4000
正如你在這裡的樣機上所看到的，長長的鋼琴弦，
08:22
each string is controlled with a little robotic element --
134
484000
3000
每根都被小型機器人部件所控制。
08:25
either little bows that stroke the strings, propellers that tickle the strings,
135
487000
5000
這裡有小巧的琴弓來撥動，驅動器來撩撥，
08:30
acoustic signals that vibrate the strings. We also have an army of robots on stage.
136
492000
5000
聲學信號來震動琴弦。在舞台上，還會出現一大群機器人。
08:35
These robots are the kind of the intermediary between the main character, Simon Powers,
137
497000
4000
這些機器人是主角西蒙 鮑威爾(Simon Powers)和家人之間交流的一種媒介。
08:39
and his family. There are a whole series of them, kind of like a Greek chorus.
138
501000
4000
他們為數眾多，有如古希臘歌劇中的合唱團。
08:43
They observe the action. We've designed these square robots that we're testing right now
139
505000
5000
他們觀察舞台上的一舉一動。我們在實驗室裡設計和測試了這些立方形的
08:48
at MIT called OperaBots. These OperaBots follow my music.
140
510000
3000
“歌劇機器人”（Operabots）。它們能隨歌舞動，
08:51
They follow the characters. They're smart enough, we hope,
141
513000
3000
還會跟隨舞台人物。它們很聰明，
08:54
not to bump into each other. They go off on their own.
142
516000
3000
我們也希望他們能互相規避（以避免碰撞）。它們自主行動;
08:57
And then they can also, when you snap, line up exactly the way you'd like to.
143
519000
6000
如果你打個指響，他們也會如你所願，排成整齊的一行。
09:03
Even though they're cubes, they actually have a lot of personality.
144
525000
2000
別看它們是一個個方盒子，卻擁有許多人格化的內涵。
09:12
The largest set piece in the opera is called The System. It's a series of books.
145
534000
4000
歌劇中最大的道具就是所謂“系統”。它是一系列“圖書”。
09:16
Every single book is robotic, so they all move, they all make sound,
146
538000
4000
每一部書都是一個機器人，都能運動，都能發聲。
09:20
and when you put them all together, they turn into these walls,
147
542000
4000
放在一起，它們構成了一道道投影牆，
09:24
which have the gesture and the personality of Simon Powers. So he's disappeared,
148
546000
5000
展現出西蒙 鮑威爾(Simon Powers)的動作和性格。歌劇的主人公雖然消失在舞台上，
09:29
but the whole physical environment becomes this person.
149
551000
3000
卻存在於環境之中。
09:32
This is how he's chosen to represent himself.
150
554000
3000
這是他選擇的，代表自己的辦法。
09:35
The books also have high-packed LEDs on the spines. So it's all display.
151
557000
7000
這些書的書脊上集成了LED的光源，作為顯示平面。
09:42
And here's the great baritone James Maddalena as he enters The System.
152
564000
4000
這位是男中音詹姆士 馬達萊納（），他正在進入系統。
09:46
This is a sneak preview.
153
568000
1000
這是預告片。
10:11
This premieres in Monaco -- it's in September 2009. If by any chance you can't make it,
154
593000
5000
首映將於 2009年10月在摩洛哥舉行。如果你不能前往觀看，
10:16
another idea with this project -- here's this guy building his legacy
155
598000
3000
那麼還有一個辦法。
10:19
through this very unusual form, through music and through the environment.
156
601000
4000
西蒙用一種非同尋常的方法，即通過音樂和環境，來建立他的遺贈。
10:23
But we're also making this available both online and in public spaces,
157
605000
4000
我們將把系統放在網絡和公共場所，
10:27
as a way of each of us to use music and images from our lives
158
609000
4000
以便人人都能用音樂和生活中的影像
10:31
to make our own legacy or to make a legacy of someone we love.
159
613000
3000
來製作我們或者我們摯愛的人的遺贈。
10:34
So instead of being grand opera, this opera will turn into what we're
160
616000
3000
這不再是一部單純的大歌劇，它將把我們現在所想的，
10:37
thinking of as personal opera.
161
619000
2000
變成一部個性化歌劇。
10:39
And, if you're going to make a personal opera, what about a personal instrument?
162
621000
2000
要做個性化歌劇，怎麼能沒有個性化的樂器呢？
10:41
Everything I've shown you so far -- whether it's a hyper-cello for Yo-Yo Ma
163
623000
3000
我到目前為止所展示的這些，比如給馬友友的超級大提琴，
10:44
or squeezy toy for a child -- the instruments stayed the same and are valuable
164
626000
5000
又或者是給孩子們捏音樂的玩具，這些樂器都是一成不變的，
10:49
for a certain class of person: a virtuoso, a child.
165
631000
3000
或為藝術家，或為小朋友，它僅僅針對某一類人有著實用價值。
10:52
But what if I could make an instrument that could be adapted
166
634000
3000
試想一下，如果我再製作一種樂器，能夠適應我的個人行為，
10:55
to the way I personally behave, to the way my hands work,
167
637000
4000
按照手指彈奏方式，根據我熟悉的，甚至不熟悉的技法
10:59
to what I do very skillfully, perhaps, to what I don't do so skillfully?
168
641000
3000
來自我調整，情況又會如何呢？
11:02
I think that this is the future of interface, it's the future of music, the future of instruments.
169
644000
5000
我以為這就是交互界面，音樂和樂器的未來趨勢。
11:07
And I'd like now to invite two very special people on the stage,
170
649000
3000
為了現場演示個性化樂器，
11:10
so that I can give you an example of what personal instruments might be like.
171
652000
6000
我想邀請兩位嘉賓到台上。
11:16
So, can you give a hand to Adam Boulanger, Ph.D. student from
172
658000
5000
掌聲有請，亞當 布朗傑（Adam Boulanger），麻省理工媒體實驗室的博士生
11:21
the MIT Media Lab, and Dan Ellsey. Dan,
173
663000
7000
和丹 埃爾西（Dan Ellsey）。
11:28
thanks to TED and to Bombardier Flexjet, Dan is here with us today
174
670000
7000
感謝泰德，感謝龐巴迪 佛里士傑(Bombardier Flexjet)
11:35
all the way from Tewksbury. He's a resident at Tewksbury Hospital.
175
677000
4000
丹今天從圖斯伯里遠道而來，他在那裡住院。
11:39
This is by far the farthest he's strayed from Tewksbury Hospital, I can tell you that,
176
681000
4000
我要告訴大家：這是迄今為止，他離開醫院外出旅行距離最遠的一次。
11:43
because he's motivated to meet with you today and show you his own music.
177
685000
5000
他是因為要和大家見面並分享自已的音樂，才特地來這裡的。
11:48
So, first of all, Dan, do you want to say hi to everyone and tell everyone who you are?
178
690000
4000
首先，丹，先自我介紹一下，好嗎？
11:57
Dan Ellsey: Hello. My name is Dan Ellsey. I am 34 years old and I have cerebral palsy.
179
699000
8000
丹•埃爾西（以下簡稱丹）：你們好，我叫丹•埃爾西。我34歲，是一名腦癱患者。
12:05
I have always loved music and I am excited to be able to conduct
180
707000
6000
我一直都很熱愛音樂，能用這樣的新軟件來指揮我的樂曲，
12:11
my own music with this new software.
181
713000
2000
我感到非常激動。
12:15
Tod Machover: And we're really excited to have you here, really Dan. (Applause)
182
717000
11000
托德•麥克弗（以下簡稱托德）：你能來這裡，我們真的也很激動。（掌聲）
12:26
So we met Dan about three years ago, three and a half years ago,
183
728000
3000
我們和丹大約在三年半前相識，
12:29
when we started working at Tewksbury. Everybody we met there was fantastic,
184
731000
5000
那時我們剛開始和圖斯伯里醫院合作。那裡我們遇到的每一個人都妙極了，
12:34
did fantastic music. Dan had never made music before, and it turned out
185
736000
5000
能作出美妙的曲子。丹此前從來沒有作曲，但出乎意料的是，
12:39
he was really fantastic at it. He's a born composer.
186
741000
7000
他擅長於這種方式。他天生就是個作曲家。
12:46
He's very shy, too.
187
748000
3000
他也很害羞。
12:49
So, turned out he's a fantastic composer, and over the last few years has been
188
751000
4000
嗯，他是一個非常棒的作曲家。從那以後，
12:53
a constant collaborator of ours. He has made many, many pieces.
189
755000
3000
我們就成了固定合作者。丹作了許多許多曲子，
12:56
He makes his own CDs. Actually, he is quite well known in the Boston area --
190
758000
3000
發行了自己的光碟唱片。其實在波士頓地區，他知名度很高，
12:59
mentors people at the hospital and children, locally, in how to make their own music.
191
761000
4000
還教授醫院的人們和當地的孩子如何創作音樂。
13:03
And I'll let Adam tell you. So, Adam is a Ph.D. student at MIT, an expert in music
192
765000
5000
下面請亞當來講，他是麻省理工學院的博士生，
13:08
technology and medicine. And Adam and Dan have become close collaborators.
193
770000
5000
他是音樂技術和醫藥方面的專家，和丹有著密切的合作。
13:13
What Adam's been working on for this last period is not only how to have Dan
194
775000
4000
亞當所做的不但使丹能夠
13:17
be able easily to make his own pieces,
195
779000
3000
輕輕鬆鬆作曲，
13:20
but how he can perform his piece using this kind of personal instrument.
196
782000
3000
而且使他能用個性化樂器來演奏自己的作品。
13:23
So, you want to say a little bit about how you guys work?
197
785000
2000
所以，談談你們是怎麼做的吧？
13:25
Adam Boulanger: Yes. So, Tod and I entered into a discussion
198
787000
3000
亞當•布朗傑（以下簡稱亞當）：好。圖斯伯里醫院的項目源自
13:28
following the Tewksbury work and it was really about how Dan is an expressive
199
790000
4000
我和托德的一次討論，那時我們談到丹是個非常有表現欲，
13:32
person, and he's an intelligent and creative person. And it's in his face,
200
794000
5000
聰明而且有創造力的人。你可以從
13:37
it's in his breathing, it's in his eyes. How come he can't perform
201
799000
3000
他的一舉一動裡看出來。但是為什麼他就不能演奏一段屬於自己樂曲呢？
13:40
one of his pieces of music? That's our responsibility, and it doesn't make sense.
202
802000
4000
沒有理由說這不可以呀！同樣，這也是我們的責任。
13:44
So we started developing a technology that will allow him with nuance,
203
806000
3000
於是我們開始著手研發一種技術，
13:47
with precision, with control, and despite his physical disability, to be able to do that,
204
809000
5000
讓他用微小的動作和精準的操控，來演奏自己的作品，
13:52
to be able to perform his piece of music.
205
814000
3000
並且不需要在意自己肢體上的不便。
13:55
So, the process and the technology --
206
817000
2000
接著，談到流程和技術，
13:57
basically, first we needed an engineering solution. So, you know,
207
819000
3000
簡言之，首先需要一個工程之道。你看，
14:00
we have a FireWire camera, it looked at an infrared pointer.
208
822000
3000
我們放置了一台1394火線接口的攝像頭來追踪紅外指針。
14:03
We went with the type of gesture metaphor that Dan was already used to
209
825000
4000
我們利用了丹在言語控制中使用的肢體語言
14:07
with his speaking controller.
210
829000
4000
和表意系統。
14:11
And this was actually the least interesting part of the work, you know,
211
833000
3000
設計流程是“不太”有趣的一部份。
14:14
the design process. We needed an input; we needed continuous tracking;
212
836000
3000
我們需要一些輸入，持續的跟踪
14:17
in the software, we look at the types of shapes he's making.
213
839000
3000
以及軟件來監測他做出的不同形狀。
14:20
But, then was the really interesting aspect of the work, following the engineering part,
214
842000
4000
解決了工程問題，隨後便是工作中真正有趣的部分了。
14:24
where, basically, we're coding over Dan's shoulder at the hospital
215
846000
3000
簡單的講吧，我們在醫院現場編程，和丹密切合作，
14:27
extensively to figure out, you know, how does Dan move?
216
849000
3000
理解他是如何動作，
14:30
What's useful to him as an expressive motion?
217
852000
2000
哪些具有表現力的動作是他覺得有用的。
14:32
You know, what's his metaphor for performance?
218
854000
3000
再如，他用什麼手法來演奏？
14:35
What types of things does he find
219
857000
2000
哪些是他覺得重要，
14:37
important to control and convey in a piece of music?
220
859000
2000
並可以用於控制和傳達音樂的東西？
14:39
So all the parameter fitting, and really the technology
221
861000
4000
可以說，所有的參數，所有的技術，
14:43
was stretched at that point to fit just Dan.
222
865000
3000
都是為丹量身定做的。
14:46
And, you know, I think this is a perspective shift. It's not that our technologies --
223
868000
6000
嗯，我覺得，這也是未來的趨勢。
14:52
they provide access, they allow us to create pieces of creative work.
224
874000
4000
並非是技術本身打開了創新之門。
14:56
But what about expression? What about that moment when an artist delivers
225
878000
3000
是表達麼？是藝術家創作作品的那一刻嗎？
14:59
that piece of work? You know, do our technologies allow us to express?
226
881000
4000
我們的技術有給大家表述的機會麼？
15:03
Do they provide structure for us to do that? And, you know, that's a personal relationship
227
885000
4000
他們有提供這樣的構架嗎？其實，是人與人之間的聯繫
15:07
to expression that is lacking in the technological sphere. So, you know,
228
889000
4000
產生了表達，而這恰是技術本身所不能的。
15:11
with Dan, we needed a new design process, a new engineering process
229
893000
3000
於是，我們需要新的設計流程和工程流程，
15:14
to sort of discover his movement and his path to expression that allow him to perform.
230
896000
5000
來了解丹的動作以及表達方式，使他能更容易的表演，
15:19
And so that's what we'll do today.
231
901000
2000
這便是今天我們所要做的。
15:21
TM: So let's do it. So Dan do you want to tell everyone
232
903000
2000
托德：我們開始吧，丹，要告訴大家
15:23
about what you're going to play now?
233
905000
2000
你將要演奏什麼嗎？
15:31
DE: This is "My Eagle Song."
234
913000
2000
丹：我的“鷹之頌”。
15:35
TM: So Dan is going to play a piece of his, called "My Eagle Song".
235
917000
3000
托德：丹將演奏他的樂曲“鷹之頌”。
15:38
In fact, this is the score for Dan's piece,
236
920000
2000
這是他的樂譜，
15:40
completely composed by Dan in Hyperscore.
237
922000
3000
完全由他用“超級樂譜”完成的。
15:43
So he can use his infrared tracker to go directly into Hyperscore.
238
925000
5000
他用紅外追踪器來操作軟件。
15:48
He's incredibly fast at it, too, faster than I am, in fact.
239
930000
3000
他用起軟件來，出乎意料的快，事實上，比我還快呢。
15:51
(Laughter)
240
933000
2000
丹：(笑聲)... ...（似乎想說些什麼）
15:55
TM: He's really modest, too.
241
937000
2000
托德：他太謙虛了，哈哈。
15:58
So he can go in Hyperscore. You start out by making melodies and rhythms.
242
940000
6000
他使用了軟件，從樂音和旋律開始，
16:04
He can place those exactly where he wants.
243
946000
2000
他可以把它們放置在自己想要的地方。
16:06
Each one gets a color. He goes back into the composition window,
244
948000
3000
每個元素都有色彩，回到編曲窗口，
16:09
draws the lines, places everything the way he wants to. Looking at the Hyperscore,
245
951000
5000
畫線，把這些東西放到他所想要的位置。
16:14
you can see it also, you can see where the sections are,
246
956000
3000
看著“超級樂譜”
16:17
something might continue for a while, change, get really crazy and then end
247
959000
5000
你可以觀察到音樂的
16:22
up with a big bang at the end.
248
964000
3000
起承轉合。
16:25
So that's the way he made his piece, and as Adam says,
249
967000
3000
這就是他作曲的方法。正如亞當所說的，
16:28
we then figured out the best way to have him perform his piece.
250
970000
7000
我們找到了讓他演奏的最好的辦法。
16:35
It's going to be looked at by this camera, analyze his movements,
251
977000
3000
攝像頭會監控丹，分析他的動作，
16:38
it's going to let Dan bring out all the different aspects of his music that he wants to.
252
980000
4000
讓他隨心所欲地展示他音樂的各種層面。
16:42
And you're also going to notice a visual on the screen.
253
984000
3000
你還會看到銀屏上的視覺特效。
16:45
We asked one of our students to look at what the camera is measuring.
254
987000
6000
我的一位學生負責視覺採樣。
16:51
But instead of making it very literal, showing you exactly
255
993000
3000
其實這裡並非是原封不動地顯示相機跟踪的物體，
16:54
the camera tracing, we turned it into a graphic that shows you the basic
256
996000
5000
我們把採集的數據轉化成了影像，
16:59
movement, and shows the way it's being analyzed.
257
1001000
4000
以便顯示基本的運動和分析的方法。
17:03
I think it gives an understanding of how we're picking out movement from what
258
1005000
4000
我覺得這些影像有助於大家理解我們是如何提取丹的動作。
17:07
Dan's doing, but I think it will also show you, if you look at that movement,
259
1009000
4000
如果觀察他表演時的舉動，
17:11
that when Dan makes music, his motions are very purposeful, very precise,
260
1013000
7000
銀幕上的影像還能展現丹的動作目的明確、精準、
17:18
very disciplined and they're also very beautiful.
261
1020000
3000
有專業素養，並且很優美。
17:21
So, in hearing this piece, as I mentioned before, the most important thing is
262
1023000
5000
正如我先前提到的，在聽他的作品時，
17:26
the music's great, and it'll show you who Dan is.
263
1028000
3000
重點是音樂棒極了，它會告訴你一個真正的丹。
17:29
So, are we ready Adam?
264
1031000
2000
亞當，準備好了嗎？
17:31
AB: Yeah.
265
1033000
2000
亞當：好啦。
17:33
TM: OK, now Dan will play his piece "My Eagle Song" for you.
266
1035000
4000
托德：好，有請丹為大家表演他的作品“鷹之頌”。
20:01
(Applause)
267
1183000
24000
（持續熱烈的掌聲）
20:25
TM: Bravo.
268
1207000
2000
托德：太棒了。
20:27
(Applause)
269
1209000
9000
（掌聲）
ABOUT THE SPEAKERS
Tod Machover - Composer, inventorAt MIT's Media Lab, Tod Machover creates boundary-breaking new music, often using new instruments and music technologies he has invented.
Why you should listen
Tod Machover is head of the MIT Media Lab's Hyperinstruments/Opera of the Future group. He has composed five operas and helped to develop many groundbeaking musical technologies -- including Hyperinstruments, a technology that augments musical expression for both virtuosi (from Yo-Yo Ma to Prince) and amateurs, and Hyperscore, software that allows anyone to create sophisticated, original music by using lines and colors. Many of Machover's principles about "active participation" in music are exemplified in Guitar Hero, which grew out of his lab.
Among his current projects is a new opera, Death and the Powers, complete with a musical chandelier, animatronic walls, and an army of robots. Death and the Powers premieres in Monaco in September 2009.
A recent focus of Machover's group has been on Music, Mind and Health, which marshals the power of music to promote well-being. Working with long-term patients at facilities such as Tewksbury Hospital, north of Boston, the group's goal is to develop personal musical activities that adapt to the particular skills and needs of each individual. In this way, the path to health becomes as rewarding as learning an instrument, composing a symphony, or premiering at Carnegie Hall.
Tod Machover | Speaker | TED.com
Dan Ellsey - Musician
Dan Ellsey uses Hyperscore music software and a custom-tuned musical "hyperinstrument" to write, perform and conduct his music, and to help others learn how to compose.
Why you should listen
A resident of Tewksbury Hospital in Massachusetts, Dan Ellsey has cerebral palsy and does not walk or speak. He does, however, write and play his own music, and mentor others, through a groundbreaking music system developed by MIT's Tod Machover and his team, including grad student Adam Boulanger. Working closely with this team, Ellsey helped to develop and fine-tune a head-mounted interface, tweaked to respond to his movements, that allows him to compose music and to conduct nuanced performances of his work. Hyperscore software helps Ellsey notate his musical ideas.
Ellsey's work has been performed at MIT, on the radio and at workshops around the Boston area. The Lowell Symphony Orchestra performed his piece "Our Musically" at a 2004 concert for residents of Tewksbury -- many of whom count Ellsey as a mentor in their own musical education.
Dan Ellsey | Speaker | TED.com