DEV Community: Vash

All about Sound effects and Music (soundtrack) creation for game-dev

Vash — Wed, 13 Nov 2024 18:38:40 +0000

Introduction

In this article, I will (have AI) explain the basics of sound and music in game development, and show you applications for creating them using both free and paid tools. The topics include:

Soundtrack / music creation
SFX (sound effects) / sound creation
Ambient sounds / music

I would like to note that besides AI writing the article I have modified most of it myself but used an AI's suggestion(s) as guideline(s). Because, I'm a really really bad writer 😅.
If you spot any mistakes or see a topic or subject that is important but hasn't been talked about or something you would like to know, leave a reaction and I'll look into it.

I would also like to note that the only things you need to create any form of music or SFX are time, a microphone (or pre-sampled sounds), and an application to layer and eventually render/compose all the sounds. (Unless you are working with LPs, but that's another story.)

Music:

Music is composed of melodies, harmonies, and rhythms.
It evokes emotions, tells a story, or provides entertainment.
Often features instruments, vocals, and structured compositions.
Examples include: background music in films, songs in albums, and instrumental tracks.

SFX (Sound Effects):

Short, specific audio clips used to enhance actions, environments, or situations.
Designed to simulate real or imagined sounds.
Often used to support visual media by adding realism or emphasis.

Ambient Sounds / Music:

Forms of sound or music used to create atmosphere or set a mood.
Often low or high-pitched sounds or tracks with a consistent frequency.

Maybe, in the future I will make a seperate article on voice acting / voice-overs and natural sounds (sounds that are made by animals / nature).

Soundtrack / music creation
Differences between SFX and Sound design (By AI)
SFX / sound creation / design
Ambient sounds / music
Applications and methods for music creation
Applications and methods for SFX creation
References and links for educational materials
Final conclusion
References and (external)sources

Soundtrack / music creation

Soundtrack and music creation are two different things. Both involve making music, but soundtracks are made to fit into movies, games, and other media. This means that they have to be more flexible.

Since this article is for game development, we'll talk about soundtracks and soundtrack creation. However, some tips might also help with regular music creation.

How soundtracks are made

To make a soundtrack for a game, movie, or series, you can follow these steps:

1) Understanding the game/movie/series:

The composer first needs to fully grasp the story, characters, and atmosphere. This helps in creating music that complements/fits the gameplay and emotions.

2) The concept and theme development:

Develop a concept or draft for the main themes and motifs. This could be a specific melody or rhythm that represents the game or certain characters.

3) Composing:

Write or record the music using one of multiple techniques. A few composing techniques will be shown at the bottom of this chapter.

4) Integration with gameplay:

Syncing the composed soundtracks to the game’s events. This might involve adaptive music that changes based on the player's actions, surroundings, or other specific cues.

5) Testing and tweaking the music:

One of the most important steps. The music should fit the game’s atmosphere and not be repetitive or negatively impact the player's experience. Modify re-compose your soundtrack/music if necessary.

6) Finalizing:

If necessary, compose a final piece that replaces the composition from step 3 with a cleaner or higher-resolution version after testing.

Note: The higher the resolution of the audio, the better because you can't upscale audio without any consequenses that lower the quality of the audio.

Composing techniques

Composing is a broad term that includes many different techniques and styles. You can compose music both digitally and manually (analog). The biggest difference is that when composing sounds digitally, you can have a direct preview, while composing manually requires you to play an instrument yourself.

Today, most people use a MIDI (Musical Instrument Digital Interface) controller to sample and play sounds. This is a combination of both hardware and software that allows a composer to make music with an actual instrument and modify it digitally.

When recording analog sounds, you have to either modify the sound itself by tuning your instrument or altering the soundwaves through software solutions.

Like with many other things, you have both free and paid software for all these tasks. The benefit of paid music-creation software is that all the sounds that come with your software are licensed, meaning you can use them however you want. This isn't always the case with free software.

Additional Composing Techniques:

Leitmotif:

Assign specific themes or motifs to characters, places, or ideas. For example, Darth Vader’s theme in Star Wars.

Layering:

Build complexity by layering multiple instruments or sounds. Start with a basic melody and add harmonies, rhythms, and effects.

Variation:

Use variations of a theme to keep the music interesting. This could be changing the rhythm, harmony, or instrumentation.

Orchestration:

Decide which instruments will play which parts. This can dramatically change the feel of the piece.

Adaptive Music:

Create music that changes dynamically based on player actions or game events. This involves composing multiple variations and transitions.

Counterpoint:

Write independent melodies that work together harmoniously. This is often used in classical music.

Improvisation:

Allow room for spontaneous creation. This is more common in jazz and live performances.

Sound Design:

Incorporate unique, synthetic sounds created through sound design to add atmosphere and texture.

Recording a Composition

Recording a composition can be done in a few ways. You could:

Make and store a digital composition through different software packages.
Combine both digital and analog recordings and turn it into a digital composition.
Record instruments by playing them yourself or in a (small) group and then stack multiple recordings together to get a final composition.
Record an orchestra playing your composition (this requires a big budget).

Differences between SFX and Sound design (By AI)

Sound Effects (SFX) and sound design are closely related but differ in scope and application. Here’s a breakdown of their differences:

Sound Effects (SFX)

Definition: Sound effects are specific audio clips used to enhance actions, environments, or situations in media such as games, movies, and television. They simulate real or imagined sounds to add realism or emphasis to visual content.

Examples of SFX:

Footsteps
Gunshots
Door creaks
Explosions
Animal sounds

Purpose: The primary purpose of SFX is to create a more immersive and believable experience by providing auditory cues that complement the visual elements.

Creation: SFX can be recorded from real-world sources, created digitally, or sourced from sound libraries. They are often short and specific to particular actions or events.

Sound Design

Definition: Sound design is a broader and more holistic process that involves creating the overall soundscape for a piece of media. This includes not only individual sound effects but also the ambiance, mood, and audio aesthetics that support the narrative and emotional impact.

Examples of sound design:

Designing the unique sounds of an alien environment
Crafting the audio experience of a haunted house
Creating the background ambiance of a bustling city
Developing the sonic identity of a character or creature

Purpose: The purpose of sound design is to shape the auditory experience in a way that enhances storytelling, emotional engagement, and immersion. It considers the entire audio landscape and how various sounds interact and complement each other.

Creation: Sound design involves a combination of recording, synthesis, manipulation, and layering of sounds. It often requires creativity and experimentation to achieve the desired effect. Sound designers use tools like DAWs, virtual instruments, synthesizers, and plug-ins to craft unique sounds.

Summary: while SFX are individual sounds used to enhance specific actions or events, sound design encompasses the entire process of creating a cohesive and immersive audio experience for a piece of media. Both are crucial for making games and other media more engaging and realistic, but sound design goes beyond just effects to include the overall audio atmosphere and aesthetic.

SFX / sound creation / design

Sound effects are crucial in enhancing the immersive experience of a game. They add realism, emphasize actions, and create atmosphere. Here’s a guide to help you understand and create effective sound effects for your game:

How Sound Effects Are Made

To create sound effects for a game, follow these steps:

1. Identifying the Needs

Understand the game’s requirements by identifying where sound effects are necessary. This includes actions, environmental sounds, character movements, and more.

2. Recording or Sourcing Sounds

Recording:
Use a microphone to capture real-world sounds. This could be anything from footsteps to door creaks.

Consider using field recording techniques to capture environmental sounds like birds chirping or wind blowing.

Sourcing:
Use sound libraries to find pre-recorded sound effects. Websites like Freesound.org and SoundBible.com offer free and paid sounds.

3. Editing and Manipulating Sounds

Once you have the raw sounds, edit and manipulate them using audio editing software:

Trimming and Cutting:
Remove unwanted parts of the sound clip to get a clean effect.

Enhancing:
Use tools like EQ, reverb, and compression to enhance the sound.

Adjust pitch and speed to match the game’s requirements.

4. Integrating SFX into the Game

Ensure that the sound effects are integrated seamlessly into the game:

Syncing:
Synchronize sounds with in-game actions and events.

Use middleware like Wwise (from AudioKinetic) or FMOD for dynamic and adaptive audio.

Balancing:
Ensure that SFX levels are balanced with music and dialogue to avoid overwhelming the player.

5. Testing and Refining

Regularly test the sound effects within the game environment to ensure they fit well:

Player Feedback:
Gather feedback from playtesters to identify areas for improvement.

Iteration:
Continuously refine the sound effects based on feedback and testing results.

Tools and Software for SFX Creation

Digital Audio Workstations (DAWs)
DAWs are essential for editing and producing sound effects. Some beginner-friendly options include:

Audacity:
A free, open-source DAW that is great for basic sound editing.

Reaper:
A low-cost DAW with extensive features and customization options.

Sound Libraries

Use sound libraries to source high-quality sound effects:

Free Libraries:

Paid Libraries:

Audio Plug-ins

Enhance your sound effects with audio plug-ins:

Reverb and Delay:
Adds depth and space to your sounds.

Pitch Shifters:
Alters the pitch of the sound for various effects.

Additional SFX Techniques

Foley:
Recreate everyday sound effects using props in a studio setting.

Layering:
Combine multiple sounds to create a complex and rich effect.

Granular Synthesis:
Breaks down sounds into tiny grains and recombines them to create new textures.

Creative Use of Silence:
Sometimes, the absence of sound can be as powerful as the sound itself.

Time-stretching:
Extend or compress the length of a sound without changing its pitch.

Automation:
Use DAW automation features to adjust volume, panning, and effects over time.

Recording SFX

Recording sound effects can be done in various ways:

Field Recording: Capture real-world sounds using portable recorders.

Studio Recording: Use a controlled environment to create and capture sounds.

Hybrid: Combine both field and studio recordings for a richer sound palette.

Applications and methods for music creation

Digital Audio Workstations (DAWs)

1. What are DAWs?

Digital Audio Workstations (DAWs) are software platforms used for recording, editing, mixing, and producing audio files. They are essential tools for music creators.

2. Popular DAWs for Beginners:

Audacity: Free, open-source DAW ideal for simple recording and editing.

GarageBand: User-friendly DAW for Mac users, featuring virtual instruments and loops.

FL Studio: Known for its powerful features and ease of use, suitable for all levels.

Ableton Live: Great for live performances and music production, with a user-friendly interface.

Reaper: Low-cost DAW with extensive customization options and professional features.

Virtual Instruments and Synthesizers

1. Virtual Instruments:

Software that simulates traditional instruments (e.g., pianos, drums, strings).

Can be played using a MIDI controller or programmed directly in a DAW.

2. Popular Virtual Instruments:

Kontakt: A versatile sampler with a vast library of sounds. It's paid (and pretty expensive), but it's worth it if you have a lot to do with music. Native Instruments, much like Pioneer, offers one of the best dj suites available. (sorry, I just wanted to tell you this).

Serum: A powerful wavetable synthesizer known for its high-quality sound.

Omnisphere: A software synthesizer with an extensive sound library for various genres.

Sound Libraries and Sample Packs

1. What are Sound Libraries?

Collections of pre-recorded sounds, loops, and samples that can be used in music production.

Useful for quickly adding professional-quality sounds to your projects.

2. Popular Sound Libraries:

Freesound: A community-driven database of free sound effects and samples.

Loopmasters: A commercial site offering high-quality sample packs in various genres.

Splice: A subscription-based platform with access to a massive library of sounds and samples.

Audio Effects and Plug-ins

1. What are Audio Plug-ins?

Software components that add audio effects or virtual instruments to your DAW.

Essential for enhancing and shaping your sound.

2. Common Audio Effects:

Reverb: Adds a sense of space and depth to your sounds.

Delay: Creates echo effects by repeating the sound.

EQ (Equalization): Adjusts the balance of different frequency components.

Compression: Controls the dynamic range of audio signals.

Methods of Music Creation

1. Composing:

Writing Melodies: Start with a simple melody and build upon it.

Harmonizing: Add chords to support and enrich the melody.

Arranging: Organize your musical ideas into a structured format.

2. Recording:

Using a Microphone: Capture live instruments or vocals.

Direct Input (DI): Record instruments like electric guitars directly into your DAW.

MIDI Recording: Use a MIDI controller to input notes and control virtual instruments.

3. Editing:

Trimming and Cutting: Remove unwanted sections of audio.

Quantizing: Align recorded MIDI notes to the grid for precise timing.

Pitch Correction: Adjust the pitch of vocals or instruments.

4. Mixing:

Balancing Levels: Ensure all elements are heard clearly and sit well together.

Panning: Position sounds in the stereo field to create a sense of space.

Applying Effects: Use reverb, delay, EQ, and other effects to enhance your tracks.

5. Mastering:

Final Processing: Apply compression, EQ, and limiting to prepare your track for distribution.

Loudness Optimization: Ensure your track meets industry loudness standards.

Applications and methods for SFX creation

Sound effects (SFX) are essential in game development for creating an immersive and engaging experience. They enhance the realism of actions, environments, and events within the game. This chapter will guide you through the tools and methods for creating effective sound effects.

Digital Audio Workstations (DAWs)

1. What are DAWs?

Digital Audio Workstations (DAWs) are software platforms used for recording, editing, and producing audio files. They are crucial for sound designers to create and manipulate sound effects.

2. Popular DAWs for SFX Creation:

Audacity: A free, open-source DAW ideal for basic sound editing tasks.

Reaper: Affordable and highly customizable with a professional feature set.

Adobe Audition: A comprehensive DAW with advanced editing tools and effects.

Sound Libraries and Resources

1. What are Sound Libraries?

Sound libraries provide pre-recorded sounds that can be used directly in your projects. They are a valuable resource for finding high-quality sound effects without having to record them yourself.

2. Popular Sound Libraries:

Freesound.org: A community-driven database of free sound effects.

SoundBible.com: Offers both free and royalty-free sounds.

Boom Library: Professional sound libraries for various themes and genres.

Audio Effects and Plug-ins

1. What are Audio Plug-ins?

Plug-ins are software components that add effects or enhancements to your audio. They are essential for shaping and polishing your sound effects.

2. Common Audio Effects:

Reverb: Adds a sense of space and depth to your sounds, making them feel more natural.

Delay: Creates echo effects by repeating the sound, useful for simulating environments.

EQ (Equalization): Adjusts the balance of different frequency components to shape the sound.

Compression: Controls the dynamic range of the audio, making it sound more consistent.

Methods of SFX Creation

1. Recording:

Field Recording: Capture real-world sounds using portable recorders. For example, recording footsteps, doors creaking, or ambient nature sounds.

Studio Recording: Use a controlled environment to create specific sounds. Foley artists often use props to recreate everyday noises like footsteps or clothing rustling.

2. Sourcing:

Using Sound Libraries: Find and use pre-recorded sounds from sound libraries.

Creative Commons: Use sounds available under Creative Commons licenses, ensuring proper attribution where required.

3. Editing and Manipulating:

Trimming and Cutting: Remove unwanted parts of the sound to isolate the desired effect.

Pitch Shifting: Change the pitch of the sound to create different effects.

Time Stretching: Adjust the speed of the sound without altering the pitch.

Layering: Combine multiple sounds to create a richer and more complex effect.

Integrating SFX into the Game

1. Syncing:

Synchronize sound effects with in-game actions and events to enhance immersion. For example, footstep sounds should match the character's movements.

2. Middleware:

Use middleware like Wwise or FMOD for dynamic audio implementation. These tools allow for adaptive audio, where the sound changes based on the game’s state or player actions.

3. Balancing:

Ensure that sound effects are balanced with music and dialogue. Proper audio mixing prevents any single element from overwhelming the others.

Testing and Refining

1. Playtesting:

Regularly test the sound effects within the game environment to ensure they fit well and enhance the gameplay experience.

2. Feedback:

Gather feedback from playtesters and make adjustments based on their experiences and suggestions.

3. Iteration:

Continuously refine the sound effects based on feedback and playtesting results to achieve the best possible outcome.

References and links for educational materials

for music / soundtrack composition

Zectro is a pretty good youtube chanel for music creation for games.

Venus Thory is a pretty good youtube chanel for music creation for games.

Rocking The Plank: The Music of Sea of Thieves | Inside Xbox is a really good video that shows how the music for a game like Sea of Thieves could be made.

Here is something similar but then for God of War: The Music of God of War with Composer Bear McCreary | Countdown to Launch

The video: ARK Soundtrack: Behind the Scenes is something similar to the one of Sea of Thieves but with a bigger budget and less information on how they did it.

There are many more video's similar to this avalible on YouTube just try to look one up with the following text: "name of the game" + behind the scenes music creation

for SFX creation / recording

As said earlier the difference between SFX and Sound Design is really small. So you could learn very much from both types of work because they are nearly the same.

A video by Artlist: How To SOUND DESIGN | Step by step tutorial

A video about the creation of SFX in God of War How This Woman Creates God of War’s Sound Effects | Obsessed | WIRED

A video about the sound design of halo: How The Sounds In "Halo" Are Made | Movies Insider | Insider

Search on YouTube for "name of the game" + behind the scenes SFX creation

Final conclusion

The best way to learn stuff like this is by doing. While there is a lot of theory you can learn and apply, great music or sound effects often come from your own experience, knowledge, and (usually) your own personal taste / imagination. So, dive in and start creating!

Also, try different tools, sounds, and settings. Remember to make backups, as Ctrl+Z or autosaves may not always save you in certain situations.

And stay updated. Use the best tools available to you. High-quality tools can make it easier to produce better work, but you still need to master them. Without proper skills, even the best tools won’t guarantee great results.

Also, don't forget to enjoy the Process. Have fun with your projects. Enjoying what you do makes the whole journey worthwhile.

References and (external)sources

Sound Libraries:

freesound = https://freesound.org/
SoundBible = https://soundbible.com/
Boom Library = https://www.boomlibrary.com/
Sound Ideas = https://soundideas.sourceaudio.com/albums
Loopmasters = https://www.loopmasters.com/
Splice = https://splice.com/features/sounds

SFX software:

Wwise = https://www.audiokinetic.com/en/wwise/overview/
FMOD = https://www.fmod.com/

DAW software:

Audacity = https://www.audacityteam.org/
Reaper = https://www.reaper.fm/
GarageBand = https://en.wikipedia.org/wiki/GarageBand
FL Studio = https://www.image-line.com/
Ableton Live = https://www.ableton.com/en/
Adobe Audition = https://www.adobe.com/products/audition.html

Virtual Instruments:

YouTube:

Other:

Native Instruments = https://www.native-instruments.com/en/
Pioneer = https://www.pioneerdj.com/en/
Sea of Thieves = https://www.seaofthieves.com/
YouTube = https://www.youtube.com/

Learn about 2D art / animation (methods) / (softwares) and how to choose one

Vash — Mon, 30 Sep 2024 12:35:12 +0000

Introduction

This article is written for anyone interested in 2D art / animation. This article has references to multiple sub-subjects that fall into the categories of these types. I do this in order to avoid the mess I made with my article on 3D art / animation.

This article also includes usefull information for game-devs.

Regarding copyright, the sources of webistes and images have been noted at the botom of the article.

Enjoy reading! - Vash000

Forms of 2D art / animation
How traditional art is made and can be used
How digital art is made and can be used
How traditional animation is made and can be used
How digital animation is made and can be used
Art for game-devs
Art / Animation program comparisons
Usefull links
- Links to tutorials
Links and references to external sources

Forms of 2D art / animation

There are many ways to sort different types of art. I like to divide them into static art and animation. Both are art, but it’s easier to work with smaller categories. There are many forms of art and animation, so I can’t cover them all, but I’ll show you the main types and explain how typical animation works.

Static Art:

Traditional (drawing / painting)

Digital art (Made using a computer / laptop (or tablet / mobile device))

Animation:

Traditional (Hand-drawn Animation, stop-motion)

Digital (Digitally-drawn Animation, Motion Graphics)

Most art is converted to a digital format (usually image or video) to be stored, edited, or shared more easily than physical art like paintings or sketchbooks.

I’ll explain more about how art could be made and used in the chapters below.

How traditional art is made and can be used

About traditional art

Traditional art includes styles made without using technology, except to make the work easier or to digitize the finished pieces. For example, a drawing copy board with an LED backlight helps see the contours of an underlying image or drawing.

To digitize art, you might use a photo scanner like this one (A4-format photo scanner) from Canon:

The most basic forms of traditional art are drawing and painting. These use materials like pencils, charcoal, ink, and various types of paint (oil, acrylic, watercolor).

Most artists sketch with a pencil before painting so they can erase mistakes. However, erasers leave marks on your artwork, whether on canvas or paper.

Traditional art also includes sculpting, but since this article is about 2D art, I won’t cover that.

Traditional art is often used to study the basics of art, such as anatomy, color theory, lighting, perspective, and scene composition.

Uses of traditional art

Traditional art can be used for:

Posters to promote a product, as a prop, or to decorate your room.

Portraits to learn facial anatomy, sell as a service, or promote your drawing skills. (I don't know, I usually don't draw portraits).

Landscapes to create or recreate entire landscapes to hang on your wall or use as a background, maybe like Bob Ross.

Scenes / Settings to study, copy, and use as (your laptop’s / game's) background / home-screen or to hang on your wall.

Sketches / Drafts / Concepts to learn and progress or use for later artworks.

There are more forms and techniques of 2D art, but this article is a starting guide for beginners. I won’t over-complicate things by giving more information on traditional art.

I will leave links to useful sites in the “Useful Sites” chapter and might make another series of articles or videos on different art techniques and styles if I have time.

How digital art is made and can be used

Digital art is often found easier to use than traditional art because you only need a laptop/PC with a mouse or a tablet and an application that lets you edit images. Many digital artists prefer using a tablet or drawing tablet (pen/display tablet).

Digital art tries to simulate traditional art on digital devices through specialized drawing software. One of the most popular paid software is Adobe Photoshop. There are many free and paid alternatives, as well as specialized apps for certain art styles. For example, Aseprite is a paid app for pixel art.

Applications / programs like Adobe Photoshop can be used for nearly any form of 2D processing, making it a good choice for professional digital artists or editors.

There are many different art programs. At the end of this article, I will compare multiple art/animation programs.

One of the biggest advantages of digital art is that you can easily copy and paste images, make backups, work with multiple people on the same drawing without being in the same room, revert changes (ctrl+z), or use an older backup file. You can also change the entire image and color values without needing to redraw the entire frame. Additionally, you can increase the size of your canvas/paper without redrawing anything.

Digital art has many advantages compared to traditional art. The main difference is the feeling you get when drawing traditionally versus digitally. You can often tell digital art apart from traditional art, making traditional art a sought-after style.

How traditional animation is made and can be used

Traditional animation has many forms and styles. In the past, the only format was film. Nowadays, we have digital formats that can be displayed and shared over social media and other networks. The most popular digital formats are: (.MP4 and .mov). In film the .raw format is used for getting uncompressed data form the camera. Please don't store your animation in this format. (It's file-size will become way too big).

Most traditional animation today is made by taking pictures or scanning large series of pictures and compiling them at a certain speed (24 FPS is common).

For both traditional and digital animation, there are “still frames” where nothing or nearly nothing moves. This technique saves time by reusing the same image instead of redrawing it.

Traditional animation is done without computers and can include anything from stop-motion to hand-drawn animation.

Traditional animation can be used for:

Movies and TV shows: Classic animations like Disney films were created using traditional methods.
Short films and commercials: Many short animations and ads use traditional techniques for a unique look.
Educational content: Traditional animation can make learning materials more engaging and easier to understand.
Artistic projects: Artists often use traditional animation to create unique, hand-crafted pieces.
Music videos: Many music videos feature traditional animation for a distinctive visual style.

For more specialized forms of traditional animation, you can visit this wikipedia page.

How digital animation is made and can be used

Digital animation is created using a computer, PC, or (drawing) tablet, just like digital art. The only difference could be the program(s) you are using.

Digital animation offers many advantages:

Efficiency: You can easily copy and paste frames, make backups, and work with others remotely.
Flexibility: You can revert changes, adjust colors, and resize your canvas without starting over.
Tools: Software like Adobe After Effects and Toon Boom Harmony provide powerful tools for creating complex animations.

Digital animation can be used for:

Movies and TV shows: Many modern animations are created digitally for better control and efficiency.
Video games: Characters and environments are often animated digitally.
Advertising: Digital animation is used in commercials and online ads.
Educational content: Animated videos can make learning more engaging.

Digital animation combines the creativity of traditional animation with the power of modern technology, making it a versatile and popular choice for many artists.

Art for game-devs

To create art for a game, you first need to know what your game will be and its main selling point. Everything in the game should fit together well to make it a “good game.”

The factors that influence a game will be discussed in another article.

When making art for a game, you need to know what kind of game it will be and what style you want. If you’re unsure, experiment with different styles! Look at other games like Cuphead, Rayman Legends, Undertale, Street Fighter (I-II), and Heartbound. These are some popular 2D games with different art styles. For example, Undertale and Heartbound are pixel-art games, and Heartbound uses a color palette that is accessible for colorblind players.

It’s hard to give specific advice, but generally, “Art can be used to visualize the game, and the underlying code controls the art and triggers different animations.”

Besides the story, sound, and gameplay, art is one of the biggest selling points of a game.

Art in a game can be made in two different forms

Sprite animation

Rigging (bone-based animation)

Sprite animation uses a series of images called frames. These images are shown one after another to make the character look like it’s moving.

Rigging is a method where you add “bones” to a character, similar to how it’s done in 3D animation. These bones control the character’s movement, making it easier to animate complex actions.

Art / Animation program comparisons

List of programs:

Price comparison

OTL = One Time Licence

Program:	free:	paid:	price:	Kind of licence:
Microsoft Paint	✅	❌	-	-
Paint.net	✅	❌	-	-
Aseprite	❌	✅	€19,99-	OTL
Adobe Photoshop	❌	✅	€316,97- (2024)	Per year
Adobe Illustrator	❌	✅	€316,97- (2024)	Per year
Autodesk Sketchbook	✅	❌	-	-
GIMP	✅	❌	-	-
Krita	✅	❌	-	-
Procreate	❌	✅	<€23,-	OTL, (depends on platform)
Rebelle	❌	✅	€169,39	OTL, (3 devices)
Corel painter	❌	✅	<€430,-	OTL
Clip studio paint	❌	✅	€45,49-	OTL
Inkscape	✅	❌	-	-

Main uses of the programs:

Program:	Drawing:	Animating:
Microsoft Paint	✅	❌
Paint.net	✅	❌
Aseprite	✅	✅
Adobe Photoshop	✅	✅
Adobe Illustrator	✅	❌
Autodesk Sketchbook	✅	❌
GIMP	✅	❌
Krita	✅	✅
Procreate	✅	✅
Rebelle	✅	❌
Corel painter	✅	❌
Clip studio paint	✅	✅
Inkscape	✅	❌

In theory you could use any of these programs to animate but the listed programs have build-in support and features for animaton. Please correct me if I'm wrong in the comments.

I use Microsoft Paint for small quick tasks and image scaling, Paint.net for other more complicated tasks and modifications, GIMP for editing even harder or more complicated images. (I use Paint.net way more often than GIMP because I'm used to it (and it is a lot simpler)). Then I use Krita for my art and animation.

Currently I'm making games in GameMaker and am using its build-in image editor in combination with Paint.net, altough Aseprite might be a really good application to use instead. You'll just have to find out for yourself what application you like.

When you are converting series of images from your hand-drawn animation into 2D animation then here is a list of applications for that:

Pencil2D an open-source 2D animation software that allows you to import scanned images of your drawings and animate them.
Animation Paper lets you scan your paper drawings and animate them digitally.
Toon Boom Harmony professional animation software that supports importing scanned drawings and offers powerful tools for traditional and digital animation.
Adobe Animate / Flash software allows you to import scanned images and create animations. It’s widely used in the industry for both 2D and interactive animations.
TVPaint Animation a high-end animation software that supports traditional animation techniques. You can scan your paper drawings and use TVPaint to animate them.
FlipAnim An online tool that allows you to create flipbook animations. You can upload images of your drawings and animate them frame by frame.

You could use most video-editing software that allows you to import images at durations shorter than your desired frame-rate. the only problem is that for example in Microsoft's Moviemaker (now Clipchamp) has you select, import and scale the images one-by-one. Or at least, that was my experience with Microsoft MovieMaker (maybe I was missing some information or feature when using the software).

Usefull links

to learn art over-all

Youtube channels

Marc Brunet (former Senior 3D Artist at Blizzard Entertainment): https://www.youtube.com/@YTartschool I defenitely reccomend watching Marc Brunet (He is one of the best art teachers on youtube).

Draw like a sir: https://www.youtube.com/@DrawlikeaSir

Brad's art school: https://www.youtube.com/@BradsArtSchool

KeshArt: https://www.youtube.com/@KeshArt

Winged Canvas: https://www.youtube.com/@wingedcanvas

Trent Kaniuga: https://www.youtube.com/@TrentKaniuga

Ross Draws: https://www.youtube.com/@RossDraws 50/50 sometimes usefull, sometimes not.

Rapid fire art: https://www.youtube.com/@RapidFireArt

to learn software applications

Krita

Krita tutorial for beginners course (by: Aaron Rutten): https://www.youtube.com/watch?v=viTuqB3Qofo&list=PLo_kbikcLfN-4kZjxDr0k4pmFJa147JTd

Complete krita tutorial (by: sociamix): https://www.youtube.com/watch?v=NbNQmE6WPK0

How to animate in krita for beginners (by: Winged Canvas): https://www.youtube.com/watch?v=oXMCmiT_wxA

Shading basics in krita (by: TutsByKai): https://www.youtube.com/watch?v=a6Sg25lfoIE

Photoshop

Beginners guide to drawing in photoshop (by: Trent Kanigua): https://www.youtube.com/watch?v=ZOQ0A46IAGI

Animation in photoshop step-by-step tutorial (by: Olof Storm): https://www.youtube.com/watch?v=PH7vcZjTSLA

For the other programs and tutorials: please search for yourself by using the following terms:

beginner tutorial "program name"
drawing in "program name"
animating in "program name"
shading in "program name"
composing in "program name"

and so on it saves me a lot of time.

Links and references to external sources

links from applications

Microsoft Paint: https://www.microsoft.com/nl-nl/windows/paint

Paint.net: https://www.getpaint.net/

Aseprite: https://www.aseprite.org/

Adobe Photoshop: https://www.adobe.com/products/photoshop.html

Adobe Illustrator: https://www.adobe.com/products/illustrator.html

Autodesk Sketchbook: https://www.sketchbook.com/

GIMP (GNU Image Manipulation Program): https://www.gimp.org/

Krita: https://krita.org/en/

Procreate: https://procreate.com/

Rebelle: https://www.escapemotions.com/products/rebelle/about

Corel painter: https://www.painterartist.com/en/product/painter/

Clip studio paint: https://www.clipstudio.net/en/

Inkscape: https://gitlab.com/inkscape/inkscape

Pencil2D: https://www.pencil2d.org/

Animation Paper: https://animationpaper.com/

Toon Boom Harmony: https://www.toonboom.com/products/harmony

Adobe Animate / Flash: https://www.adobe.com/products/animate.html

TVPaint Animation: https://tvpaint.com/en

FlipAnim: https://flipanim.com/

GameMaker: https://gamemaker.io/en

references to external sites

Wikipedia:
https://en.wikipedia.org/wiki/Traditional_animation

Games:

Cuphead: https://en.wikipedia.org/wiki/Cuphead
Rayman Legends: https://en.wikipedia.org/wiki/Rayman_Legends
Undertale: https://en.wikipedia.org/wiki/Undertale
Street Fighter (I-II): https://en.wikipedia.org/wiki/Street_Fighter_(video_game)
Heartbound: https://gopiratesoftware.com/games/Heartbound/

Images

Example image static art: https://i.pinimg.com/originals/5e/e7/30/5ee730626ea86ed583c4e72f6145abdc.jpg

Traditional art: https://miro.medium.com/v2/resize:fill:1200:675/g:fp:0.47:0.34/1*Y50-Ut4Bry8xIaC5YRlbrA.jpeg

Digital art: https://artignition.com/wp-content/uploads/2021/06/artignition-what-is-a-digital-art.jpg

Example image animation: https://oyster.ignimgs.com/wordpress/stg.ign.com/2015/08/tumblr_nr13fzCrVO1rwg7ino2_400.gif

Traditional animation, hand-drawn: https://www.traditionalanimation.com/wp-content/uploads/2013/12/AaronBlaisePaperAnimation.jpeg

Traditional animation, stop-motion: https://patmat.tv/wp-content/uploads/2020/04/BenB-studio-foto-making-off-4.jpg

Digitally-drawn animation: https://beforesandafters.com/wp-content/uploads/2019/11/klaus_feature.jpg

Motion graphics animation: https://media0.giphy.com/media/OcbCi4OcPuqPTHCLR0/source.gif

Example image drawing copy board: https://img.ltwebstatic.com/images3_spmp/2023/12/18/a0/170290967925276e913add02acd4fabb61b5bd3574_thumbnail_720x.webp

Example image A4-format photo scanner canon: https://i1.adis.ws/i/canon/Madiera-FSL-Ambient_1920x520_232914564267280?w=1920&sm=aspect&aspect=4:1&qlt=80&fmt=jpg&fmt.options=interlaced&bg=rgb(255,255,255)

Example image art supply kit: https://images-na.ssl-images-amazon.com/images/I/51Y%2BUU648tL.SS600.jpg

Example image traditional art poster: https://ae01.alicdn.com/kf/Sceb5b748133648a58bc14ce6cc532e30H/Japanse-Vintage-Art-Poster-Reizen-Japanse-Art-Print-Paar-Geisha-Japan-Canvas-Schilderij-Moderne-Galerij-Leeszaal.jpg

Example image traditional art portrait (Het melkmeisje):
https://i.ytimg.com/vi/XHUyMDyFBEo/hqdefault.jpg

Example image traditional art landscapes (Bob Ross): https://files.floridados.gov/media/706604/ross.png?width=300&height=200&mode=max

Example image traditional art scenery (Anton Pieck): https://www.lambiek.net/artists/image/p/pieck_anton/pieck_gebakkraam.jpg

Example of traditional art draft (Sans, Undertale): https://krita-artists.org/uploads/default/optimized/3X/4/b/4bda707fdd65c77abe228c3305d1a74b13f4de5e_2_800x774.jpeg

Example image tablets: https://annamystory.com/wp-content/uploads/2021/10/2.webp

Example image aseprite: https://img.utdstc.com/screen/837/b1c/837b1ca821f9ee4aee68963cc2c551fbc27a539bcf062a9245b505ce0a4d89f7:600

Example image film: https://cdn.shopify.com/s/files/1/0429/4769/files/Banner-35mm-Film.jpg?v=1613511249

Example image digital movie formats: https://blog.filestack.com/wp-content/uploads/2019/03/video_file_format.png

Sprite animation: https://i.pinimg.com/originals/47/38/39/473839c16d4b5cd6b5ec335ee3a9923c.gif

Rigging animation: https://school.mangoanimate.com/wp-content/uploads/2021/04/mango-animate-make-2D-rigging-in-5-minutes-step3-1.gif-1.gif

Learn how to choose your (digital) 3D art / animation software and the basics

Vash — Tue, 17 Sep 2024 09:35:58 +0000

Introduction

This article is for anyone interested in choosing 3D art or animation software. Whether you're working in game development, creating animations, or producing 3D renders, this guide will help you make an informed decision.

If you're considering using 3D software for a hobby or work, be prepared to invest time. Learning the skills needed for 3D art can take at least 30 hours, and that’s just the beginning. You’ll spend many more hours making 3D models, sculpting, animating, or rendering.

For those already familiar with 3D art, you can skip to the tables below. However, if you’re new to this field, I recommend reading through the entire article for a solid introduction.

At the end of the article, I’ve included links to helpful resources for learning 3D techniques. Feel free to leave comments about anything I might have missed or areas where I could improve. Your feedback will help me improve future articles.

Lastly, I used a mix of AI tools, including Copilot and ChatGPT, to improve my writing because, although I have a lot of knowledge, I find writing challenging. But thankfully, AI helped fix that problem for me.😊

Enjoy reading! - Vash000

The order of creating 3D models
About 3D models
The different kinds of 3D art creation (Modeling, Sculpting, Photogrammetry)
Rigging
Simulation
Animation
Rendering
Compositing / composition
The types of applications and what they are used for
For game-devs
Filetypes
Program comparison (Free/Paid, Filetype support, Use case(s))
popular software combinations / bundles
3D suite combinations
My conclusion about the software
Things to take away
Links and references
recomended Free tutorials

The order of creating 3D models

The process behind the creation of 3D models, art and/or animations is usually pretty similar. You usually first start with a concept (usually a drawing or a storyboard). Then you start either blocking out a individual model or an entire scene. After that you are going to polish and finalize all the models. Then you start animating (expecting that you've already made a 3D model, textured it and rigged it). Then you add lightning (adding lights can also be done earlier this just depends on your own personal preferences). And after that you can do camera placement, rendering, and compositing/post-processing.

Here is the same information in the form of a list (by AI my helpful assistent):

Concept: The process usually starts with a concept, which can be a drawing, a storyboard, or a written description. This stage involves brainstorming and planning the overall look and feel of the project.
Blocking Out: Next, you begin blocking out an individual model or an entire scene. This involves creating basic shapes and structures to establish the composition and layout.
Modeling and Polishing: After blocking out, you move on to modeling and polishing the models. This step involves adding details, refining shapes, and ensuring that the models are accurate and visually appealing.
Texturing: Once the models are finalized, you apply textures to add color, patterns, and surface details. This step enhances the realism and visual interest of the models.
Rigging: If the models need to be animated, you create a rig by adding bones and controls. This allows you to manipulate the models and create realistic movements.
Animation: With the rigged models, you can start animating. This involves creating keyframes and adjusting the movements to bring the models to life.
Lighting: Adding lighting to the scene is crucial for setting the mood and enhancing the visual quality. Lighting can be added at various stages, depending on personal preferences and project requirements.
Camera Placement: Positioning the camera is essential for framing the shots and guiding the viewer’s attention. This step involves setting up camera angles, movements, and focal points.
Rendering: Once everything is set up, you render the scene to generate the final images or animations. This step involves calculating the effects of lighting, shading, and textures to produce high-quality visuals.
Compositing/Post-Processing: The final step is compositing and post-processing. This involves combining multiple elements, adjusting colors, adding effects, and enhancing the overall visual quality.

In this article, I will try to explain 3D models, what components they consist of, and the major steps within the workflow of creating 3D models/art/animation. (Sorry for my poor writing skills I tired...)

About 3D models

Basics of a 3D model

A 3D model, even without color information, is made up of three key components:

Vertices (points in 3D space (X, Y, Z))
Edges (Lines between the points (V1, V2))
Faces (In-fill between the edges and vertices (V1, V2, V3))

These three elements (vertices, edges, and faces) are the building blocks of all 3D models. Without them, 3D models as we know them wouldn’t exist.

There’s a debate in the 3D community about whether to use triangles (tris) or quadrilaterals (quads). While tris are more compatible across different software (since most applications convert everything into triangles), quads are easier to work with when modeling. Ultimately, it’s a matter of preference.

Watch out for N-gons (polygons with more than four sides). They can cause problems in 3D modeling and are generally avoided. It’s best to stay avoid them whenever possible.

For more detailed information about polygon meshes, you can visit this wikipedia page.

Faces, Materials and Textures

Faces

Faces form the surface of a 3D model. Each face has a normal vector that indicates which direction the face is pointing. If the normals are incorrect, they can cause issues, like the surface appearing invisible. Thankfully, this is a common problem with easy fixes, and most 3D software has tutorials you could use to help you solve this issue.

Materials

In 3D modeling, materials control how an object interacts with light. They determine properties such as color, shininess, and transparency. Materials can also use multiple textures, like a diffuse texture for color or a bump map for surface details.

While materials can be tricky to explain, they will start to make more sense as you are working on your own projects.

Here is an example image of a material in Blender.

Textures

Textures are images (usually in formats like JPG or PNG) applied to the surface of a 3D model to add details such as color, patterns, and surface variations. They simulate the appearance of different materials.

There are several methods for applying textures to a 3D model, including:

Generative/Procedural Textures These are generated algorithmically, creating patterns or surface details without using pre-made images.

Photoscanned Textures: These are textures created by scanning real-world objects to capture detailed surface characteristics.

Triplanar Mapping This method projects textures onto a model from three directions, making it useful for objects with complex surfaces.

Vertex Colors Vertex colors allow you to paint colors directly onto a 3D model without needing a texture map.

In game development and animation, you'll often come across different texture maps, like Normal Maps, Roughness Maps, Specular Maps, and Ambient Occlusion Maps. Each of these adds a different layer of detail or effect to your model.

One of the most interesting maps is the Normal Map. It creates the illusion of depth and complexity by converting a flat image into a 3D-like surface without increasing the number of polygons. This is commonly used in game development to reduce memory usage.

If you are serious about 3D texturing, you might want to try Substance Painter. Substance Painter, is a popular (though paid) tool for creating and applying textures. While it can be expensive, it’s a powerful tool used by many professionals in the industry.

I’ve only ever used a demo version of Substance Painter(probably pirated it) 🏴‍☠️. But I definitely recommend it to anyone interested in 3D art, animation, or game-dev. But don't be like me and use a legal, paid, or free trial version.

The different kinds of 3D art creation

There are many ways to create 3D art, including:

Modeling
(Digital) Sculpting
Photogrammetry

Photogrammetry and laser scanning can produce realistic models, but traditional techniques like sculpting, modeling, and procedural generation can also achieve highly realistic results. There are many different styles of 3D art, and this article will focus on the various tools and their uses.

Modelling and its different forms

Modeling is the process of creating 3D objects, often used to design buildings, props, and other assets.

Some common modeling techniques include:

Box modeling: Starting with a basic shape (like a cube) and refining it by adding more detail (adding more geometry).
Boolean modeling: Using operations like union or subtraction to combine (simple) shapes into more complex forms.

Subdivision modeling: Dividing polygons into smaller parts to create smoother, more detailed surfaces.

Surface modeling: Creating smooth, complex surfaces, often used in product or automotive design.

Modular modeling: Building reusable components (or "modules") that can be used in larger scenes.

Kitbashing: Combining pre-made models to quickly create new designs, often used in concept art.

Procedural modeling: Using algorithms to generate complex structures, like cities or natural landscapes.

Spline/NURBS modeling: Using curves to define surfaces, often for smooth, mathematically precise objects.

Each of these methods offers unique strengths, depending on the task at hand. As you experiment with 3D modeling software, like Blender, Autodesk Maya, or 3ds Max, you’ll discover which techniques work best for you.

(Digital) Sculpting

Digital sculpting, or 3D sculpting, is a popular way to create 3D models, especially when you want to achieve highly detailed and organic shapes. It is similar to traditional clay sculpting, where you mold and shape the object. Some well-known software used for this technique includes ZBrush, Mudbox, and Blender.

Digital sculpting is great for creating natural forms like characters, creatures, and even landscapes. It’s also perfect for adding fine details like surface textures, scratches, wrinkles, or other elements that make 3D models look more realistic.

Once a model has been sculpted, artists usually perform retopology. Retopology is the process of simplifying a model’s polygon count to make it easier to use in games, animations, or real-time applications. Lowering the number of polygons helps reduce file sizes and improves performance, whether in games or during rendering.

Though there are automatic retopology tools, manually adjusting the polygons is often needed to get the best results. In manual retopology, the artist carefully traces over the sculpted model to create a more efficient and cleaner version. For models meant for animation, a well-planned edge flow (how the lines or edges are arranged) is crucial to make sure they move properly.

After retopology, artists often "bake" a normal map, which captures the fine details from the high-resolution model and applies them to the lower-poly version. This way, the model looks detailed without being too heavy for computers to process.

Retopology is vital for game development because it ensures smooth performance, but in movies, high-resolution models are sometimes used without optimization, as performance isn’t as much of a concern.

Photogrammetry

Photogrammetry is a technique used to create highly detailed 3D models by taking multiple photos of an object or environment from different angles. Specialized software like Agisoft Metashape, RealityCapture, or Meshroom stitches (joins) these images together to form a detailed 3D mesh, complete with textures.

To achieve full coverage of an object, you can either place it on a rotating platform or move around it, capturing as many angles as possible. The goal is to collect all visual data necessary to produce a highly accurate model.

In game development, a well-known company, Quixel, uses photogrammetry to build the Megascans library. These assets are integrated into Unreal Engine 5, allowing developers to use high-resolution models directly in real-time applications thanks to a technology called Nanite. Nanite efficiently handles detailed photogrammetry models without requiring manual optimization.

However, in game engines that don’t support Nanite, retopology may still be necessary to lower the polygon count for real-time use. This ensures that the models run smoothly without affecting game performance.

Photogrammetry is widely used across industries like game development, animation, architecture, archaeology, and virtual tourism. It is especially helpful for creating realistic environments and objects that require lifelike detail.

Rigging

Rigging is an essential process in 3D modeling that allows artists to create the skeleton or structure that will move a model. This involves grouping certain points (or vertices) of the model and attaching them to invisible objects called “bones,” which control their movement. This technique makes it possible to animate the model later.

In blender and other 3D applications, a bone typically looks like this:

While the default bone is simple, you can modify its appearance and even color it for easier identification. Larger studios often create reusable rigs, ensuring efficiency when rigging new models.

In complex animations, bones can be connected and limited, meaning one bone's movement may affect another. This simplifies the animation process, making movements more natural.

The rigging process typically includes the following steps:

Inserting bones Adding bones to the model to create a skeleton.
Weightpainting (Automatic or manually) This process assigns influence to bones over specific parts of the model. Weight painting can be done automatically, but manual adjustments are often necessary to ensure precision.

For a more in-depth guide on rigging, check out this article at CG Wire.

Rigging can be a delicate process, and any errors will become apparent during animation. For instance, if weights are misassigned, parts of the model may not move as expected.

Simulation

In 3D animation and game development, simulations are used to replicate real-world physics and behaviors, adding a dynamic and realistic quality to virtual scenes. Here are common types of simulations used:

Gravity & Collisions: These simulate how objects fall and interact with one another in terms of physical forces. For example, objects falling, colliding, or bouncing in a realistic manner is vital for creating immersive experiences.

Particles: These are used to simulate tiny, discrete elements like fire, smoke, rain, and even bugs. Particle systems are critical for creating environmental effects that enhance the visual quality of games and animations.

Bodies of water (rivers, oceans): Water simulation goes beyond basic fluid dynamics to capture the complex behavior of oceans, rivers, and lakes. These simulations make water feel more alive, showing realistic waves, ripples, and interactions with other objects.

Here is a link to a youtube video talking about simulated rivers.

Cloth and Fur/hair: Cloth simulation replicates how fabrics and materials move, while fur and hair simulation focuses on natural movements for characters. These systems help create more realistic animations for clothes, fur, or hair interacting with the environment and other objects.

Growth of vegitation: This type of simulation models the natural growth of plants and trees. It is often used to create evolving, dynamic environments, making a scene feel more alive.

Simulations are made possible through advanced features in software, such as:

Physics Engines: These handle the interactions between objects (3D models) based on physical properties like mass, velocity, and friction.
Particle Systems: These manage and simulate vast numbers of particles to create effects like smoke or fire. Particle systems are controlled "particles" that are controlled by their physical properties like mass, velocity, and friction. In some 3D editors particles are also effected by wind and other factors.
Fluid Dynamics: Used to simulate liquids and gases, fluid dynamics replicate how these substances move and behave in different environments.
Soft Body Dynamics: This simulates objects that can deform, such as skin, fabric, or even jelly-like materials.
Procedural Generation: This creates complex environments or structures through algorithms, often used for landscapes or large-scale environments.

Uses of Simulation in Game Development and 3D Animation

Simulations are used in a wide range of applications within game development and 3D animation, including:

Environmental Effects: Creating realistic weather, smoke, fire, and water effects.
Character Animation: Enhancing the realism of character movements, including clothing and hair dynamics.
Gameplay Mechanics: Simulating physical interactions and behaviors to create engaging and believable gameplay experiences.
Visual Storytelling: Using simulations to create dynamic and immersive scenes that enhance the narrative.

Simulations are widely used in game development and 3D animation to create lifelike environments, enhance character animations, and add depth to gameplay mechanics. They provide an essential tool for building dynamic and immersive experiences in digital media.

Animation

Animation is the process of creating the illusion of motion by displaying a sequence of images, or frames, one after the other. In game development and 3D animation, it plays a crucial role in making characters, environments, and objects come to life. Here are some key techniques and features of animation:

Types of Animation

Keyframe Animation: In this widely used technique, animators set "key" poses at specific points, and the software interpolates (fills in) the frames between those poses. This is a fundamental method for creating smooth movements in character animation and complex actions.
Motion Capture (MoCap): Motion capture records real-world movements using sensors or cameras and translates them into digital animations. This method is commonly used in high-budget games and films to create lifelike character movements.
Procedural Animation: This technique uses algorithms to generate real-time animations, often based on physics or other dynamic systems. It's especially useful for creating responsive, natural movements without the need for manual keyframing.
Blend Shapes: This technique involves creating multiple shapes or expressions for a model and blending between them to produce smooth transitions. It's widely used for facial animations, allowing characters to convey a range of emotions.

Animation tools often come with various features to simplify the animation process, such as:

Timeline and Keyframes: These tools allow animators to set and manipulate keyframes along a timeline, controlling when and how a motion occurs.
Graph Editor: This tool provides a visual interface to fine-tune motion curves, offering precise control over transitions between keyframes for smoother animations.
Inverse Kinematics (IK): This powerful technique simplifies the animation of characters by allowing animators to control interconnected bones easily, particularly for limbs and joints.
Rigging Tools: These tools are used to create and manage the skeleton (or "rig") of a model, defining how it moves and interacts with other parts of the character or object.
Physics Simulation: Some animation software integrates physics engines to simulate realistic physical movements, like falling objects or cloth behavior.

Uses of Animation in Game Development and 3D Art

Animation plays a vital role in multiple areas of game development and 3D art, including:

Character Animation: Bringing characters to life with realistic movements, expressions, and interactions. High-quality character animation is crucial for creating an emotional connection with players.
Environmental Animation: Bringing characters to life with realistic movements, expressions, and interactions. High-quality character animation is crucial for creating an emotional connection with players.
Special Effects: Creating dynamic, eye-catching effects like explosions, magical spells, or particle systems (e.g., sparks, dust, fire).
Cinematics: Producing pre-rendered cutscenes or story sequences that help drive the narrative forward, enriching the overall player experience.

How Animation is created

The process of animating in game development typically follows these steps:

Conceptualization and Planning: Developing storyboards or animation sequences and planning the key actions.
Modeling and Rigging: Creating the 3D models and rigs that will be animated.
Animating: Using techniques like keyframe animation, MoCap, or procedural methods to bring the models to life.
Refining and Polishing: Fine-tuning the animation for smooth transitions, realistic movements, and expressive motions.
Rendering and Integration: Rendering the final animation and integrating it into the game or animation project.

Examples of Successful Animation in Games

Games like "The Last of Us Part II", "God of War", and "Red Dead Redemption 2" have set industry standards for animation quality. These titles showcase highly detailed character animations, lifelike facial expressions, and intricate environmental movements that draw players deeper into the story and gameplay.

Animation isn’t just about visuals. It’s a core element of storytelling, gameplay design, and player engagement in modern games.

Rendering

Rendering is the process of generating a final image or sequence of images from a 3D model using computer software. It calculates how light interacts with objects, how textures appear on surfaces, and how shadows and reflections behave. Rendering can produce either highly realistic images or more stylized ones, depending on the desired effect.

Types of Rendering

Real-Time Rendering: Typically used in video games, this type of rendering processes images at speeds of 30 to 60 frames per second, allowing for smooth, interactive visuals.
Offline Rendering: Common in films and high-end animation, offline rendering focuses on producing the highest image quality, even if it takes hours or days to render a single frame.
Ray Tracing: A rendering technique that simulates how light interacts with objects to create highly realistic reflections, refractions, and shadows.
Rasterization: A faster rendering method used in real-time applications, rasterization converts 3D objects into 2D images, altough it may lack the realism of ray tracing.

Features of rendering software

Rendering software provides various tools and options, such as:

Lighting and Shading: Tools to simulate different lighting conditions and apply shaders to surfaces for realistic or artistic effects.
Texture Mapping: Applying textures to 3D models to add surface detail and realism.
Anti-Aliasing: Techniques to smooth out jagged edges and improve image quality.
Global Illumination: Simulating how light bounces off surfaces for more realistic lighting and shadow effects.
Render Passes: Breaking down the rendering process into multiple layers (e.g., diffuse, specular, shadow) for greater control during post-processing.

Uses of rendering in game-dev and animation

Rendering is used in various aspects of game development and animation, including:

Cutscenes and Cinematics: Creating high-quality, pre-rendered sequences that enhance storytelling.
In-Game Graphics: Generating real-time visuals that players interact with during gameplay.
Visual Effects: Producing detailed effects such as explosions, fire, and smoke.
Architectural Visualization: Creating photorealistic images of buildings and interiors for design or marketing purposes.

How rendering works

The rendering process typically follows these steps:

Scene Setup: Arranging models, lights, and cameras within the scene.
Material and Texture Application: Adding materials and textures to models for realistic surface detail.
Lighting Setup: Configuring the lighting for the desired atmosphere and effects.
Rendering: Using software to calculate and generate the final image or sequence.
Post-Processing: Enhancing the final output with effects and adjustments, like color grading or depth of field.

Mastering animation and rendering techniques is vital in game development and 3D art, as these processes significantly impact the overall quality and experience of digital content.

Compositing / composition

Compositing is the process of combining multiple visual elements into a single image or sequence of images. It involves layering, blending, and adjusting different elements to create a cohesive final product. Here are some key aspects of compositing:

Types of Compositing

Layer-Based Compositing: Using layers to stack and blend different elements. Each layer can be adjusted independently.
Node-Based Compositing: Using nodes to represent different operations and effects. This method provides greater flexibility and control over the compositing process.
3D Compositing: Combining 3D elements with 2D footage to create integrated scenes. This is often used in visual effects for movies and TV shows.

Compositing features and functions

Compositing software typically includes features such as:

Layering and Blending: Combining multiple layers of visual elements and adjusting their blending modes.
Color Correction: Adjusting the color balance, contrast, and saturation of the elements.
Masking and Rotoscoping: Isolating specific parts of an image for targeted adjustments.
Keying: Removing backgrounds (e.g., green screen) to integrate different elements seamlessly.
Motion Tracking: Matching the movement of elements to create realistic interactions.

Different uses of compositing in game-dev and Animation

Compositing is used in various aspects of game development and 3D animation, including:

Visual Effects (VFX): Integrating CGI elements with live-action footage or other CGI elements.
Cutscenes and Cinematics: Enhancing pre-rendered sequences with additional effects and adjustments.
Environment Creation: Combining different elements to create complex and detailed environments.
Title Sequences and Motion Graphics: Creating dynamic and engaging title sequences and motion graphics.

How Compositing is Used

The process of compositing typically involves the following steps:

Layering: Arranging the different visual elements in layers.
Blending and Adjusting: Adjusting the blending modes, opacity, and other properties of each layer.
Color Correction and Effects: Applying color correction and additional effects to enhance the final image.
Rendering: Generating the final composite image or sequence of images.

Compositing is a crucial step in the production pipeline, allowing artists to create polished and cohesive visuals by combining multiple elements seamlessly.

The types of applications and what they are used for

For each step you could use a different application. Most indie devs (induvidual developers) use blender. Blender is a so called: "3D creation suite" which means that the application does all the steps individual applications and algorythms used to do. Since blender is free and open source it is the no.1 choise for people who are just starting out and/or trying to get into 3D-art / game-dev.

I myself learned how to 3D-model using Boolean modeling on Tinkercad when I was pretty youngh because blender was stil version ~1.8 and I found it too hard to learn. I started learning blender after update 2.5 something. I have to say that blender's Interface has increased in user-friendliness rapidly over the past few years.

For game-devs

In game development, the techniques mentioned earlier can be used for various purposes, such as creating animations (walking, running, jumping, breathing, swimming, emotes, etc.), cinematics, splash screens, loading screens, and even cover art. Essentially, any visual component in a game can be developed using these methods.

Props and assets

One of the most common tasks for game developers using 3D software is creating props and assets. These include objects like furniture, weapons, vehicles, trees, and other elements that populate the game environment. Since games often require numerous assets, mastering the creation of 3D models for props is essential. Characters, though often more complex, are another common focus for 3D modeling in game development.

Generally, assets far outnumber characters in a typical game. Some developers, however, opt to buy assets from online marketplaces or asset stores and create characters themselves, depending on the specific needs of the project.

Essential skills for game-dev

When diving into 3D art for game development, it's critical to master the basics. Some of the key skills include:

Basic 3D Modeling: Understanding how to shape objects using tools like extrusion, scaling, and rotation is the foundation of creating any game asset.
Materials & Textures: Learning how materials work and how to apply textures to models is crucial. Textures give your models surface detail, such as wood grain or metallic shine.
UV Mapping: UV mapping is essential for applying textures accurately. It’s the process of unwrapping a 3D model into a 2D space so textures can be applied seamlessly. Understanding sharp and seam edges is also important for controlling how UV maps are divided and how textures align. Here’s a link to an youtube explanation video about sharp and seam edges for further learning about Sharp and Seam edges.

By mastering these foundational techniques, you'll be able to build up your 3D modeling skills and expand into more complex areas of game development.

Filetypes

Another critical aspect of working in 3D software is understanding the various file types used in the process. Different file formats store different kinds of information, such as the 3D scene layout, individual objects, simulations, lighting, and more. Some formats can even store multiple scenes or layouts in one file.

Most 3D applications are capable of opening and working with a wide range of file types, making it easier to collaborate across different software platforms or import projects from others.

There are several types of 3D file formats, each serving a specific purpose in the pipeline. Here are the major ones:

3D Scene Files: Store entire scenes, including multiple objects, lighting setups, and sometimes animations.
Object Files: Contain individual 3D models or parts that can be used in larger scenes.
Material Files: Store material information like textures, shaders, and surface properties.
3D Data & Positioning Logs: Typically meta files used for tracking object positions, scale, and other data across different scenes or projects.

Here is a list of common 3D-scene file formats:

.blend Native file format for Blender, used to store full 3D scenes.
.fbx A highly versatile format widely used in both games and films. It stores scenes with multiple objects and animations.
.obj Another commonly used format that stores object geometry. It’s supported by almost all 3D software and game engines.
.dae COLLADA format, often used for transferring assets between different software.
.usd /.usdz Universal Scene Description formats, increasingly used for complex scenes, especially in animation pipelines.
.gltf A lightweight format optimized for use in web-based applications, but it also works in game engines.
.3ds An older format associated with 3D Studio, but still widely used.
.x3d and .wrl Formats designed for use in virtual reality and web-based 3D environments.

Here is a list of common 3D-file / part formats:

.stl A widely-used format in 3D printing that stores the surface geometry of a model.
.obj In addition to being a scene file, OBJ can also store individual models. It's favored for its simplicity and wide compatibility.
.3mf A newer format designed to be more advanced than STL, especially for 3D printing.
.ply Stores polygonal data and is often used for 3D scanning and point cloud data.
.step/.stp and .iges/.igs Formats commonly used for CAD and engineering designs.

For game developers, the most frequently used file formats are:

.stl Mainly used for 3D printing, but occasionally used in game development for modeling.
.fbx Favored for its ability to store complex data, including animations, and its compatibility with almost every game engine.
.obj Widely used due to its simplicity and compatibility across software platforms.

These formats are supported by nearly all game engines and contain the necessary 3D data for development. However, a drawback of some formats like OBJ is that they may require exporting color maps, material metadata, and texture information separately, as they don't natively store these data types.

Program comparison

pricing

Program:	free	paid
Autodesk Maya	❌	✅
Autodesk Mudbox	❌	✅
Autodesk 3ds Max	❌	✅
Blender	✅	❌
Cinema 4D	❌	✅
Daz 3D	✅	✅
Houdini	✅	✅
Substance painter	❌	✅
ZBrush	✅	✅

File-support

Part 1:

Program:	fbx	stl	obj	step	iges	blend	dae
Autodesk Maya	✅	✅	✅	✅	✅	❌	✅
Autodesk Mudbox	✅	✅	✅	❌	❌	❌	✅
Autodesk 3ds Max	✅	✅	✅	✅	✅	❌	✅
Blender	✅	✅	✅	❌	❌	✅	✅
Cinema 4D	✅	✅	✅	❌	❌	❌	✅
Daz 3D	✅	✅	✅	❌	❌	❌	✅
Houdini	✅	✅	✅	✅	✅	❌	✅
Substance painter	✅	✅	✅	❌	❌	❌	✅
ZBrush	✅	✅	✅	❌	❌	❌	✅

Part 2:

Program:	usd / usdz	gltf	3ds	x3d	wrl
Autodesk Maya	✅	✅	✅	❌	❌
Autodesk Mudbox	❌	✅	❌	❌	❌
Autodesk 3ds Max	✅	✅	✅	✅	✅
Blender	✅	✅	✅	❌	❌
Cinema 4D	✅	✅	✅	❌	❌
Daz 3D	❌	✅	❌	❌	❌
Houdini	✅	✅	✅	✅	✅
Substance painter	❌	✅	❌	❌	❌
ZBrush	❌	✅	❌	❌	❌

Use case(s)

Program:	modeling	sculpting	texturing	animation	rendering
Autodesk Maya	✅	✅	✅	✅	✅
Autodesk Mudbox	❌	✅	✅	❌	❌
Autodesk 3ds Max	✅	❌	✅	✅	✅
Blender	✅	✅	✅	✅	✅
Cinema 4D	✅	❌	✅	✅	✅
Daz 3D	✅	❌	✅	✅	✅
Houdini	✅	❌	✅	✅	✅
Substance painter	❌	❌	✅	❌	❌
ZBrush	❌	✅	✅	❌	❌

3D creation suites vs Specialized software

As you can see from the comparison, both Blender and Autodesk Maya are versatile 3D applications that support a wide range of features. They are often used as complete 3D suites, which means they cover everything from modeling and texturing to animation and rendering. However, many 3D artists or studios often use multiple specialized software applications depending on the specific task.

For instance, a lot of people use ZBrush alongside other 3D software. This is because ZBrush is renowned for its digital sculpting capabilities, making it the go-to tool for creating highly detailed, organic models like characters or creatures. While Blender can perform sculpting tasks, ZBrush is often considered smoother and more intuitive for sculpting.

Similarly, Substance Painter is widely used in the industry for texturing and material creation. It excels in these areas because it offers a lot of control over how materials and textures are applied, including features like smart materials and real-time feedback. While Blender can handle texturing tasks, using Substance Painter often results in more detailed and polished textures.

Blender for Beginners

For those just starting in 3D modeling, I recommend trying to learn Blender first. It’s free, open-source, and includes all the tools you need to create 3D content, from modeling and sculpting to texturing and animation. Even though you may hear about more specialized tools like ZBrush and Substance Painter, Blender offers enough functionality for you to learn the basics and develop your skills without needing to invest in expensive software.

Once you understand the basics and want to continue in this field. I would recommend trying the other paid softwares trough trail licenses so you know how they feel and how to use them.

After that might want to invest in specialized software like ZBrush, Autodesk Maya, or Substance Painter. These tools might help you refine your workflow and achieve higher-quality results in specific areas like sculpting or texturing.

However, even if you (have to) stick with Blender, you can still produce professional-level work, as the software is extremely capable and continues to evolve with new features.

popular software combinations / bundles

If you’re working on larger projects or want more specialized control over certain aspects of your workflow, many artists and studios use combinations of multiple software applications. Here are some popular combinations:

3D suite combinations

If you have the budget, you could create a pipeline that includes several different programs. For example:

Blender / Autodesk Maya for general modeling and animation.
ZBrush for high-detail sculpting.
Substance Painter for texturing and material creation.

This combination would allow you to take advantage of each software's strengths. Alternatively, if you're looking for a "professional-grade bundle" (what they say it is), you could invest in a package from Adobe that includes software like Substance Painter along with other tools for texturing and materials.

animation and rendering

A popular combination for 3D animatiors is Autodesk Maya together with Redshift, a powerful rendering engine. Autodesk Maya is widely used for character animation, rigging, and scene development, while Redshift is known for its speed and high-quality renders, making it a common choice for large studios creating complex scenes and videos.

Another strong option is combining Cinema 4D with Otoy's Octane Renderer. This pairing is favored for its fast rendering times and real-time feedback, which is particularly useful for motion graphics and visual effects.

Besides these, there are many different combinations you could explore.

My conclusion about the software

There are many ways to approach 3D creation, depending on your budget, your needs, and the type of work you're producing. If you're just starting, Blender and Autodesk Maya are excellent all-in-one solutions that can take you a long way. However, as you progress, you may want to explore specialized tools like ZBrush, Substance Painter, or advanced renderers like Redshift.

Ultimately, whether you’re using a single program or a combination of software, what matters most is understanding how to use the tools effectively to bring your creative vision to life.

Things to take away

Now you should at least know one or two different things about 3D, 3D art, and 3D animation. If not it's probably my fault.

Long, big 3D animations are usually made in multiple different scenes and/or files to make it easier and more efficient to work with the different animations, objects and set-ups.

Choosing your software always is a risk. Starting out I recomend you go for free alternatives but if you have more than enough money I'd recommend trying out software's free licences and/or 1 month (or more) of... your selected software (bundle / combination).

You don't need to remember all these techniques as long as you learn how to use the basic techniques of each of them and find your own ways to make your 3D-models.

Most people start out with Blocking-out a 3D model by using Box modeling and / or boolean modeling methods. Ater that you can apply more detail or better shapes using any of the other methods.

This really depends on what you are making and the workflow you are using, want to use or are recomended / required to use by your company.

Note: most applications have a free trail period. Once you've

Links and references

applications mentioned

Autodesk Maya: https://www.autodesk.com/nl/products/maya/overview
Autodesk Mudbox: https://www.autodesk.com/nl/products/mudbox/overview
Autodesk 3ds Max: https://www.autodesk.com/nl/products/3ds-max/overview
Blender: https://www.blender.org/
Cinema 4D: https://www.maxon.net/en/cinema-4d
Daz 3D: https://www.daz3d.com/
Houdini: https://www.sidefx.com/products/houdini/
Substance painter: https://www.adobe.com/products/substance3d/apps/painter.html
Tinkercad: https://www.tinkercad.com/
ZBrush: https://www.maxon.net/en/zbrush-digital-scultping-software / https://www.maxon.net/en/zbrush

Agisoft Metashape: https://www.agisoft.com/
RealityCapture: https://www.capturingreality.com/
Meshroom: https://alicevision.org/

Quixel: https://quixel.com/
Megascans library: https://quixel.com/megascans
Epic Games: https://store.epicgames.com/en-US/
Unreal Engine 5: https://www.unrealengine.com/en-US/unreal-engine-5

Reminder: Don't forget to look for more (software) applications than just these there are more applications out there than just these few big well-known ones.

Other software and render engines mentioned

Maxon's Redshift: https://www.maxon.net/en/redshift

Ottoy's Octane Renderer: https://home.otoy.com/render/octane-render/

Software that was not mentioned but recomended to check out

Chaos (V-Ray, Enscape, Corona) (render engines and rendering software): https://www.chaos.com/

Quixel Mixer (texturing software): https://quixel.com/mixer

Articles from this series

none, this is the first article that is released. New articles will be found either here or in the comments. This article is more of a test if it its quality is good enough. If not I've got to change some thing(s). - Vash000

recomended Free tutorials

I don't know much about paid tutorials so here are a few good free ones:

Blender:

Over-all: Guru's Donut Tutorial, CG Fast track's Sword in Stone Tutorial, Blender Guru's Blender (Anvil) Intermediate Tutorial serie.
Modeling: CBaileyFilem Beginner Moddeling Tutorial
Sculpting: Keelan Jon Blender Sculpting Tutorial for Beginners, in2vert Blender Tutorial for beginners - creature sculpting.
Texturing & Materials: Blender Guru Texturing tutorial for beginners, SouternShotty How pros texture, Ducky 3D How to make complex materials easily in blender.
Rigging: Joey Carlino Rigging for impatient people, BlenderVitals Create a Rig in blender in 1 minute
Animation: Ryan King Art Animation for beginners (blender tutorial), ProductionCreate First steps in blender animation - A Comprehensive tutorial
Compositing: Ryan King Art Compositing in blender for beginners, Olav3D Tutorials Blender Beginner Tutorial: Compositing in 4 minutes.

Autodesk Maya:

Autodesk Maya has a youtube channel dedicated to learning you how to use their software.
It's called: Maya Learning Channel

Most of the other applications have either a build-in tutorial system in their website. If that is not the case you could probably find free tutorials online or you could look up for any paid courses / tutorials.

Have a good time learning 3D! 😉

Hopefully this article was helpful or educational. If not or if there is someting wrong with this article please leave a comment down below so I can change this article or take that information with me when making another article.

Also, sorry I did not write down all the links and I forgot to take all the links of the images from their original sources so I need to do that next time as well.

DEV Community: Vash

All about Sound effects and Music (soundtrack) creation for game-dev

Introduction

Table of contents

Soundtrack / music creation

How soundtracks are made

Composing techniques

Additional Composing Techniques:

Recording a Composition

Differences between SFX and Sound design (By AI)

Sound Effects (SFX)

Sound Design

SFX / sound creation / design

How Sound Effects Are Made

1. Identifying the Needs

2. Recording or Sourcing Sounds

3. Editing and Manipulating Sounds

4. Integrating SFX into the Game

5. Testing and Refining

Tools and Software for SFX Creation

Sound Libraries

Audio Plug-ins

Additional SFX Techniques

Recording SFX

Applications and methods for music creation

Digital Audio Workstations (DAWs)

1. What are DAWs?

2. Popular DAWs for Beginners:

Virtual Instruments and Synthesizers

1. Virtual Instruments:

2. Popular Virtual Instruments:

Sound Libraries and Sample Packs

1. What are Sound Libraries?

2. Popular Sound Libraries:

Audio Effects and Plug-ins

1. What are Audio Plug-ins?

2. Common Audio Effects:

Methods of Music Creation

1. Composing:

2. Recording:

3. Editing:

4. Mixing:

5. Mastering:

Applications and methods for SFX creation

Digital Audio Workstations (DAWs)

1. What are DAWs?

2. Popular DAWs for SFX Creation:

Sound Libraries and Resources

1. What are Sound Libraries?

2. Popular Sound Libraries:

Audio Effects and Plug-ins

1. What are Audio Plug-ins?

2. Common Audio Effects:

Methods of SFX Creation

1. Recording:

2. Sourcing:

3. Editing and Manipulating:

Integrating SFX into the Game

1. Syncing:

2. Middleware:

3. Balancing:

Testing and Refining

1. Playtesting:

2. Feedback:

3. Iteration:

References and links for educational materials

for music / soundtrack composition

for SFX creation / recording

Final conclusion

References and (external)sources

Learn about 2D art / animation (methods) / (softwares) and how to choose one

Introduction

Table of contents

Forms of 2D art / animation

Static Art:

Animation:

How traditional art is made and can be used

About traditional art

Uses of traditional art

How digital art is made and can be used