Music for Games, Films, and other Visuals

Today was the first day of the full conference at GDC. I was thrilled to run into some colleagues, chat about the industry and to see some wonderful panel discussions. If you’ve never been to a large conference, I have to tell you, the possibilities are very daunting. You can schedule yourself solid from 9 am to 9 pm thrice over! Needless to say, I had to make some choices if I was going to be able to both see the panels I found interesting PLUS catch up with people I only have the opportunity to see at this one time of the year.

The morning started off with a keynote address by John Schappert, from Microsoft. He spoke about the burgeoning online game world. With the introduction of the next-gen series of game consoles, Wii, Xbox 360, and PS3, delivering content online has never been easier. Mr. Schappert’s goal is to democratize the process of making games, much like iTunes and other online services has done for the music world. Games made by individuals or small independent teams will now be available in the Xbox Live Marketplace. He also highighted the XNA developer’s toolkit as a great resource for anyone with a game idea that wants to do guerilla production.

After the keynote I ran into Berklee alum Dan Lehrich from Seven Studios. We met up at one of the best panels I’ve seen, on the topic of creating procedural music for the game Spore. Kent Jolly and Aaron McLean gave a rundown on how they are using Pure Data, an opensource audio and music programming environment, to create the generative music components used in parts of the game. Working with Brian Eno, they were able to develop some fascinating musical ideas. Kent started with a quick rundown of how they molded the PD environment to not only create generative music pieces but also to have the ability to select ideas that had a musical relevance. I’m hoping the GDC makes the audio transcript available. Here is a snapshot of the demonstration in PD. This isn’t a script from the game but rather what they used to demonstrate making generative music musical.

If you look closely at the generators you can see how they were able to get the generated music to fall into a given musical idea. Notice the weighting they can do to force a major, wholetone or minor scale. It was a very interesting way to algorithmically cause a musical scale! Aaron McLean went on to talk about programming the rules of counterpoint as stated by the master text by Fux which allows counter-melodies to be generated by the music engine. Very fascinating indeed!

This was interesting primarily because it was a lot of very technically minded creative people sitting around talking about music. Again and again on this trip I was reminded of the importance and relevance to being skilled not only in the technical areas of making games but also as a musician. The future is looking great, from my vantage point, for music and musicians!

Another wonderful day in San Francisco, despite the rain! I had the chance to sit down with some Berklee alums and also to listen to some very informed views on game curriculum, both from educators and practitioners in the field.

This is an interesting time to be coming into the game development field. Most people working in the industry did not receive any formal education in game development, but that is changing now. There have been programs popping up that deal with all manner of game development and there has been a huge leap in the past 5 years for game development education opportunities. The IGDA held their first summit on game education in 2000, that is hard to believe! 8 years ago! The Education Special Interest Group or SIG has been thinking about game education for a long time. However, the question came up again and again, about the style of education. On the one hand you have the classic higher education model which is about molding the person, making them more well-rounded, teaching critical thinking and global citizenship. On the other hand you have a more vocational approach which is about teaching a specific skill and a specific toolset.

On a quick glance these two may seem at odds with each other, one is more theoretical the other is more hands-on, but I kept seeing links between the two during the day. Interestingly enough, when I went to visit with an established game audio director and talk about game audio he saw the connections as well.

At LucasArts in San Francisco I imagine life is pretty good! Here is the view from the walk through the Presidio that ends up in the middle of their complex. This is a statue of the Father of Cinema - Eadweard James Muybridge.

Muybridge had an interesting career, balancing creative vision with technical limitations, which by the way is a great definition of a game audio composer and sound designer!

I was at LucasArts spending a bit of time with alumnus David Collins. He graduated from Berklee in ‘99 and at that time we had no specific course geared toward game audio. However, through his education, he learned specifics on audio fundamentals, music production techniques, teamwork, collaboration and problem-solving skills. To hear David talk about his work is to have a rose blossoming in the room. As hard as the work may be at times, it is evident that it is ultimately very satisfying. He is hard at work on the next big Star Wars game Star Wars:The Force Unleashed as the Audio Lead.

I know a lot has been said about the physics and graphics of this game, but wait until you hear it! David has had some of the finest audio talent working on this project and it shows! As you watch the trailers that talk mostly about the visuals and effects think hard about what it would take to create audio to match the images. One documentary shows how they’ve created solid objects that react the same as they do in the real world. Wood cracking, metal bending that sort of thing. David’s job is to figure out just how that would sound. He couldn’t rely on simple samples since every instance is different depending on the situation. This is an interactive audio gold mine!

Then there is the question of music. David has an audio team that on one day may be cutting sound effects, recording dialogue or even editing music. Video game enthusiasts expect a classic John Williams score in all of the Star Wars games, but unfortunately Mr. Williams isn’t always available! David’s job is to make sure the music meets expectations AND works in the game. An interactive score must not only sound good but also has to work in the context of the game. Everyone who works for David on this project has to have a strong sense of musicality to make their edits believable, and that is what brings us back to the beginning question, creative or technical?

In this little snapshot of the industry at LucasArts, I witnessed that every member of the audio team has a strong theoretical understanding of audio and music and those same people having a very high proficiency in technical skills. Working in game audio is a combination of both the technical skills of today balanced with the need for a balanced critical-thinking approach and knowledge of music and sound. So if you you are thinking about entering the field, I have two recommendations. If you are an accomplished musician and/or sound designer, start delving into the world of interactivity and the technical implementations of that. Download Fmod or XNA and start diving in and creating sounds that change based on outside factors. If you have been more technically-minded and understand about scripting or using MAX/MSP start thinking about the music and the aesthetics of sound design. Expose yourself to different musical genres and start listening critically to the music and sound in games and even film. A career in game audio is worth the time studying, and you can never be too prepared!

learn network inspire

Those are the three words on the GDC pamphlets. Very simple words, but with so much meaning…

It is a lovely day in San Francisco today! Not because it is warm and sunny (it isn’t) but rather…. it is the first day of the Game Developers Conference! I had the chance to sit in on some great conversations about education and games offered as part of the 2 day summit on game education by the IGDA.

The morning sessions started with an impassioned plea to do it right. Our job as educators is not to train our students for a specific job when they leave our school, but rather to build a student’s knowledge base and their critical/independent thinking. In the music world you might think of it as teaching a musician how to approach sight reading as opposed to trying to teach the musician every single piece of music they might ever be called upon to play.

I love the GDC slogan. Learn, Network, Inspire. It is perfect in this day and age. We all can bear to learn more, of course, that means we have to look at exactly where we spend our time. None of us has the ability to learn everything about everything we are interested in. Susan Rogers, from McGill University, compares it to science. Back when Leonardo DaVinci was learning about science there was a small set of known truths. He really was able to master most of what was known at that time. Now things are different. Not only in science where researchers can spend a lifetime on the smallest of details, but also in music. I can’t, as someone who studies drums for instance, be a master of all styles. I can not master the playing styles of Vic Firth on timpani, Evelyn Glennie on percussion AND John Bonham on set. I must choose where to spend my time and energy.

Network. Some might think this is a hard sell for students, but in reality it might be the one thing that separates a great student from a great job. In every industry, networking is a part of the process. You can be the most talented “fill in your own blank here” but if no one knows about you it doesn’t matter. Networking is a part of the modern life. There are so many opportunities that come up through a network of professionals. Being a part of that network will help to put you in the right place at the right time.

Inspire. Great art has to come from somewhere. Great artists are inspired. The videogame industry is one of the few remaining places where great artists are rewarded when they are inspired. It is also a place where creative people inspire other creative people. Teamwork and collaboration are the foundation of great games. That very same teamwork and collaboration helps one artist inspire another.

A wonderful set of three words, meant for the modern world.

learn network inspire