Despite the Advantages Of 3D Audio > 자유게시판

• 목록
• 답변
• 글쓰기
• 게시판 리스트 옵션
  • 수정
  • 삭제

For viewers to enjoy material such as motion pictures, sports video games and live events to the max, home TVs not just require exceptional image quality however outstanding sound quality too. Understanding this, industry leaders are pursuing 3D audio development to include a much deeper level of immersion to home entertainment experiences - bringing to life thrilling action scenes and catching the quietest details of ambient noise.

Simply put, 3D audio makes listeners feel as if they're truly in the middle of the action. Typically only supported at specific places such as film theaters or recording studios, 3D audio is making its method into homes to offer audiences a new way to experience their preferred material.

Samsung Electronics' sophisticated research institute Samsung Research has been making every effort to popularize 3D audio considering that 2020. To this end, Samsung dealt with Google to jointly develop Immersive Audio Model and Formats (IAMF) - an innovative 3D spatial audio that was adopted by the Alliance for Open Media (AOM)1 in October 2023. Samsung Newsroom took a seat with the group that developed IAMF to hear the story of how the innovation came to life.

▲ The Visual Technology Team at Samsung Research led the advancement of a standard for audio innovation. (From left) SungHee Hwang, JeongHoon Park and WooHyun Nam

A New Way To Enjoy 3D Audio in the house

Ambient sound exists all over - from the noise of shoes scraping on the walkway to the gentle hum of cars and trucks driving down the roadway. While this sound may appear unneeded in media, it's important in adding depth and a sense of realness. 3D audio works to flawlessly blend ambient noise with conversations and other sound results to create a more vibrant and genuine home entertainment experience.

"3D audio makes you feel as if you're truly in the heart of the action by changing the strength, motion and vibrance of the sound," stated WooHyun Nam from the Visual Technology Team at Samsung Research. "In this way, audiences are able to delight in a more full-bodied sound that catches the 3D elements of the world around us."

▲ SungHee Hwang from Samsung Research's Visual Technology Team

Despite the advantages of 3D audio, it has actually been tough to use the technology to home audio gadgets due to technological restrictions. "3D sound info from content can not be translated effectively by home audio systems such as TV speakers or sound bars, leading to a slightly limited audio experience that lacks information from the original material," stated SungHee Hwang from the Visual Technology Team at Samsung Research.

To fix this, Samsung worked diligently with Google to establish an audio solution that would permit audiences to experience material audio as planned. "If the 3D audio data can be checked out by device makers, they can change the noise in audio devices - permitting immersive audio experiences with basic TV speakers or sound bars in the house," said Nam. "By changing the audio to match the home gadget environment, listeners can experience audio just as the creator meant with no distortions or loss in quality."

An uniform requirement is needed to send out and receive audio data efficiently in between developers and device makers. "Samsung and Google's particular knowledge in devices and material made the companies ideal partners to produce IAMF innovation," said JeongHoon Park, Executive Vice President and Head of Visual Technology Team at Samsung Research. "By coming together to establish this unmatched technology, we are paving the way for customers to delight in 3D audio in their homes."

Three Characteristics of IAMF Technology: Vertical Audio, AI-Based Audio and Customized Audio

IAMF innovation provides three unique features that improve the audio experience.

▲ WooHyun Nam from Samsung Research's Visual Technology Team

1. Ability To Express Sound Vertically

Previous open-source audio codecs only supported horizontal noise expression. With IAMF innovation, audio can now be expressed vertically so that noise is significantly multi-directional. "IAMF makes sound more practical, by permitting listeners to hear audio in front, behind or to either side and also above or listed below them," stated Nam. "As such, when IAMF technology is used to home TV speakers and sound bars, it allows listeners to hear sounds such as birds flying over their head on their TVs in the house."

2. AI-Based Scene Analysis and 3D Audio Effects

IAMF uses AI and deep-learning innovation to evaluate scenes and highlight certain aspects of the content - changing audio levels for more improved noise throughout the seeing experience. "In TV and movie, there are particular scenes where the soundtrack or background music is the primary focus," said Nam. "IAMF will balance the noise in these instances. Similarly, the innovation will fine-tune audio when there is character discussion to enable the listener to focus on the conversation."

In addition, IAMF innovation provides optimal sound in spite of changes in the device environment. "By changing the scene analysis audio data according to the device environment, IAMF innovation allows listeners to delight in the content's original sound quality on basic home TVs," Hwang included.

3. Highly Customized Audio

Users will have the ability to freely change sound according to their preferences with IAMF innovation. Whether audiences are aiming to amplify sound impacts from an action scene or boost dialogue, IAMF offers them the versatility to customize material audio for a more tailored experience.

▲ IAMF analyzes information from material and enables viewers to adjust and tailor audio settings. When watching a sports video game, users can straight select whether to stress the commentator's voice or the noises of the video game itself.

3D Audio Across the Industry With Open-Source IAMF

Open source is crucial to developing a unified requirement throughout the market. IAMF is the very first open source-based audio innovation standard embraced by AOM - implying both business and independent material creators across the market can access the technology and broaden its use.

"In order to allow individuals to freely create material with 3D audio innovation, related technology requires to be open up to all," stated Nam. "Providing a complete open-source framework for 3D audio, from creation to delivery and playback, will enable even more diverse audio material experiences in the future."

Similarly, Park highlighted how IAMF technology will have a big influence on the audio landscape progressing. "Because we reside in a period controlled by material development, IAMF will help lead, broaden and change the 3D audio community," he said.

Success Accomplished Through Cooperation

Research on IAMF started in 2020 and took nearly 4 years to complete. Through a mix of perseverance and effort, the team was able to attain success.

"The task included lots of days of continuously work, and there were times when we required to operate at night due to the time distinction between our workplace and Google's," stated Hwang. "Despite these challenges, I was proud in the end. It was a fantastic chance to deal with developers from other countries."

The groups developed a sense of camaraderie along the method and built a strong structure of trust and understanding. "A Google worker discussed how this collaboration with Samsung has actually been the most satisfying collaboration he had completed so far," Park recalled. "We were able to achieve this task due to the fact that our teams trusted each other. I'm extremely pleased with and thankful for our employee' efforts and their cooperation."

▲ JeongHoon Park, Corporate EVP and Head of the Visual Technology Team at Samsung Research

Additionally, Park praised each employee's distinct skills and expertise which assisted add to the production of IAMF. "WooHyun Nam was instrumental in proposing the innovation development ideas while SungHee Hwang organized and documented our team's ideas in a precise manner," he said.

A Vision for 'Samsung Sound'

Upon its release, the Samsung Research team understood that the standardization of 3D spatial audio marked a new era of sound innovation.

"Thanks to IAMF, we can start looking into technologies that will open up a world of audio possibilities," stated Nam. In line with this, the Samsung Research group is currently developing an advanced variation of IAMF technology that can be used to various sectors such as mobile phones, the metaverse, computer game and more.

▲ With their combined efforts and relentless determination, the Visual Technology Team at Samsung Research had the ability to successfully create a brand-new standard for 3D audio.

Given the success of IAMF, the Samsung Research group is motivated to produce better audio technology for customers. Each of the employee shared their goals for the future of 3D audio.

Nam touched on his desire to develop audio innovation that is more immersive. "I desire to produce a more sophisticated 3D audio innovation that makes users feel like they are genuinely in the scene of a film, TV program or live occasion," he stated. "I likewise hope to continue this research up until 3D audio is used to Samsung's smart devices."

More broadly, Hwang talked about how he hopes Samsung will have the ability to develop unrivaled audio innovation that will place it among the ranks of other leading audio business. "My goal is to develop an innovation that customers will have the ability to easily identify as 'Samsung Sound' when they hear it," he stated. "I am optimistic that the IAMF requirement is a stepping stone towards this dream. "

"My hope is that Samsung's sound technology will enable consumers to enjoy an updated audio experience that is on par with that of present visual experiences," stated Park. "I hope that content creators will use Samsung's audio innovation to make 3D audio material available. Additionally, we aim to develop a supportive environment that enables researchers to take on strong and interesting difficulties such as expanding Samsung's audio technology."

Technological standards such as IAMF will make entertainment more immersive for viewers across the board. The Samsung Research team is leading the way for innovations that will alter the future of audio.

1 A non-profit market consortium formed to establish and share technology for multimedia shipment, enabling developers to utilize the innovation without fretting about expense. It is run by an alliance of 38 business including Samsung Electronics, Google, Amazon, Apple and Meta.