Table of Contents
- Overview of “Play BY Live”
- Features of the “Play BY Live” system
- Decision-making AI that captures the game while being aware of the presence of the viewer
- A group dialogue AI that specializes in picking up and reacting to the voices of viewers in “one-to-many” situations
- AI that speaks while expressing emotions
Overview of “Play BY Live”
“Play BY Live” AI Character is a completely independent type of entertainment by incorporating cutting-edge AI technology, which is being researched and developed by Bandai Namco Research Institute, into entertainment such as IP metaverse, video distribution, and live venues developed by Bandai Namco Entertainment *1. This is a project to embody a new virtual character elephant.
In a game environment optimized for AI characters, AI characters equipped with a game commentary system that includes high-quality voice synthesis and cutting-edge deep learning-based AI will perform commentary and distribution as a presence that excites viewers.
In addition, as a project using Play BY Live, the channel “Go Round Game”, which has been experimental and released since June 2022, will be fully operational from this autumn.
In this channel, AI characters read comments from viewers, think and reply while expressing emotions, and capture the game based on instructions and votes from the comment section, so unpredictable developments unfold. That’s the appeal.
Currently, mahjong is being played live on an experimental basis on the Youtube channel, but in the future, in addition to introducing new AI characters, each AI character will grow into a unique play style while reflecting viewers’ comments.
In addition, we plan to expand the “fun of virtual watching and cheering on battles between AI characters” such as league games between characters.
Features of the “Play BY Live” system
Decision-making AI that captures the game while being aware of the presence of the viewer
Until now, the game strategy AI has evolved as an AI for opponents and cooperation partners who enjoy games with the player for the purpose of entertaining the game player.
On the other hand, “Play BY Live” was developed with the aim of entertaining the viewers of the video platform watching the game, so the game strategy is conscious of the play that viewers are excited about and the play that allows them to feel the character’s personality.
Thinking about In addition, it is equipped with the necessary thinking functions as a live broadcaster, such as incorporating the opinions of the viewers and flexibly changing the strategy strategy, explaining what the AI is currently thinking about and the strategy it wants to implement next. We are developing the system.
A group dialogue AI that specializes in picking up and reacting to the voices of viewers in “one-to-many” situations
Currently, AI such as chatbots used in many services uses technology that assumes one-on-one dialogue such as answering questions.
However, since the dialogue AI of “Play BY Live” is supposed to be a place where hundreds of viewers can freely post to the distribution chat for one AI character, there are many impressions, questions, and comments to the character. From among them, you can pick up comments that would be interesting to take up now or comments you would like to introduce, and return reactions that will liven up the place.
By combining the memory and rapid text analysis, the capabilities of AI are unique with the IP production capabilities cultivated by the BANDAI NAMCO Group, the actions performed by human live broadcasters can be incorporated into AI, to make possibilities to excite live broadcasts. became.
AI that speaks while expressing emotions
General text-to-speech AI aims to provide guidance as a service guide, so it is often developed with an emphasis on calmly reading characters and accurately conveying information. . On the other hand, the AI character of “Play BY Live” can speak with a live reaction voice because it is a presence that enjoys the place together. Equipped with a new emotional text-to-speech system designed to share successes and failures with viewers.