Tencent patents to automate live game stream commentary using AI
[ad_1]
Highlights of the story
- Tencent has published a new patent that aims to use AI to generate automated commentary during live game streams. It will take tedious manual steps to ensure players can focus on playing the game while AI handles the commentary, as the patent suggests.
- AI will use various advanced technologies to generate real-time commentary using multiple attributes and objects. Commentary will be generated when the user plays the game on the stream.
- The patent will also address issues such as high computing power and power consumption, and add automation to support streamers.
Live streaming has evolved rapidly and completely over the past few decades, reaching new horizons thanks to the demand and availability of services like Twitch. Live streaming of video games is largely community driven, with users watching other streamers play their favorite games while providing entertaining commentary.
It looks like live game streaming is about to get easier than ever with a new patent published by Tencent. We came. Throughout the patent dubbed “COMMENTARY VIDEO GENERATION METHOD AND APPARATUS, SERVER, AND STORAGE MEDIUM,Which discusses automated commentary in live streams using the wonders of AI.
The patent notes that game streamers need to engage with the community by commenting on everything that happens while playing games, which can be a tedious task. It added that for manual commentary in live streaming “Long production process and high manual operation costs.“
Tencent’s proposed system would use AI to generate commentary for streamers as they play games automatically. it will work”A computer vision technology, a speech processing technology, and natural language processingAI technology to generate seamless commentary during live game streams.
Patents contain highly technical terms and terminology, so it is difficult to understand in a reader-friendly manner. In short, it works.”Through online analysis on the game instruction frame, the commentary audio is generated, the game video is rendered, the commentary audio and the game video are linked in time to create the commentary video.
While live streaming a game, any in-game activity, “Game operation instructions,“The performance in the game will be recorded and transmitted.”Comment Server,” which one “The commentary server 120 may render the game based on the received game operation instructions.”
The patent commentary describes the server module in detail. It is a backend server behind any game that is streamed live online. The commentary server is designed to automatically generate online game commentary using AI technology and forward the live stream to client devices viewing it online.
Further patents note, “The commentary server automatically creates the relevant commentary video stream during the game, and pushes the commentary video to the live streaming terminal to play, so as to improve the generation timeline of the commentary video.”
It continues, “In a possible implementation, online game video rendering and online analysis and commentary can be applied via analysis to the game instruction frame to generate commentary video during the game in real time.“
As mentioned above, Tencent’s system can generate commentary in real-time during a live game stream, which comes with many advantages. “Generating commentary video does not require waiting for the game to end to receive and process game video, thus further improving the real-time efficiency and timeliness of commentary video generation.“
It can consider various attributes of virtual objects in games before processing to create automatic commentary. Some attributes include “Location information, health point information, speed information, level information, skill information, feat information, equipment information, score information, etc.“
Meanwhile, objects can refer to any virtual object that the user can control, for example, a building, playable and non-playable characters, and automatic commentary generation settings during live game streams.
This is beneficial as it can automate many behind-the-scenes procedures during live streaming by using artificial intelligence technologies. This will reduce computing resource and power consumption according to Tencent’s patent. Commentary will be created on the spot as the user plays the game on the stream.
Additionally, the player can focus more on the game and leave the commentary to the AI. The patent, if adopted, could change the streaming service industry as we know it.
Video games of all genres including “A sports game, a military simulation program, a multiplayer online battle arena (MOBA) game, a battle royale shooting game, a simulation game (SLG), etc.Can possibly use Tencent’s proposed method.
The patent is based on using “A virtual online commentary scenarioFor example, meaning any multiplayer experience, such as a MOBA. Tencent explores a team battle situation in a MOBA game to illustrate the patent’s function. In live streaming, the AI will use different variables to prioritize what to talk about during the game.
For example, the number of virtual objects can determine which game event is selected to be commented on by the artificial intelligence. “For example, if the game includes two teamfights, where teamfight A has 3 virtual objects and teamfight B has 7 virtual objects, the game event of teamfight B is prioritized in selecting the game event. is given“
Tencent has been at the forefront of patenting innovative schemes with Sony and Microsoft to outpace its Western competition. For example, it recently patented an intelligent virtual reality headset that attempts to solve some of the prominent problems in existing VR devices and greatly enhances it.
Tencent is very famous for having several recognized games like PUBG, League of Legends, Ring of Elysium, Path of Exile, and many more under its belt. The giant Chinese conglomerate is currently developing anticipated projects like the new AAA entry, Code: To Jin Yong.
What are your thoughts on Tencent apparently tinkering with AI to automate gaming live streams in the future? Do you think automated live streams will help streamers focus more on just gameplay? Let us know your thoughts in the comments below.
Related Read: Callisto Protocol Failure Adds Momentum to Dead Space Remake’s Success
Was this article helpful?
Thanks! Share your feedback with us. ⚡
How can we improve this post? Help us. ✍
[ad_2]
