Sinsy

Last updated • 1 min readFrom Wikipedia, The Free Encyclopedia
Sinsy
Developer(s) Nagoya Institute of Technology
Stable release
0.92 / December 25, 2015;8 years ago (2015-12-25)
Preview release
3.9 / 2017/12/25
Operating system Linux
Available in Japanese, English, Chinese
Type Vocal Synthesizer Application
License Modified BSD license
Website www.sinsy.jp

Sinsy (Singing Voice Synthesis System) (しぃんしぃ) is an online Hidden Markov model (HMM)-based singing voice synthesis system by the Nagoya Institute of Technology that was created under the Modified BSD license. [1]

Contents

Overview

The online demonstrator is free to use, but will only generate tracks up to 5 minutes. The user uploads data in the MusicXML format, which the Sinsy website reads to output a WAV file of the generated voice. Gender factor, vibrato intensity, and pitch shift can be adjusted prior to output. [2]

As of December 25, 2015, the official developers of Sinsy were Keiichi Tokuda (Producer and designer), Keiichiro Oura (Design and Development), [3] Kazuhiro Nakamura (Development and Main Maintainer), and Yoshihiko Nankaku. [4]

It was originally only in Japanese and English, but Mandarin was later added; the website only supports English and Japanese despite this currently. [5] [6]

In 2016, Sinsy stated using the deep learning processing technology DNN. [7]

Products

Related Research Articles

<span class="mw-page-title-main">Nagoya University</span> National university in Nagoya, Japan

Nagoya University, abbreviated to Meidai (名大) or NU, is a Japanese national research university located in Chikusa-ku, Nagoya.

<span class="mw-page-title-main">Vocaloid</span> Singing voice synthesizer software

Vocaloid is a singing voice synthesizer software product. Its signal processing part was developed through a joint research project between Yamaha Corporation and the Music Technology Group in Universitat Pompeu Fabra, Barcelona. The software was ultimately developed into the commercial product "Vocaloid" that was released in 2004.

<i>Shima Shima Tora no Shimajirō</i> Television series

Shima Shima Tora No Shimajirō is a 1993 Japanese children's slice of life anime series primarily aimed at preschoolers and animated by Pierrot Plus based on the Kodomo Challenge Educational Learning Program created by Benesse in 1988. It is created and directed by veteran director Hisayuki Toriumi and character designs by Shigehito Tsuji. The first Shimajiro series aired at TV Setouchi and all other TXN networks in Japan from December 13, 1993, to March 31, 2008. The second aired from April 7, 2008 to March 29, 2010. The third aired from April 5, 2010 to March 26, 2012, and the fourth and current one began airing on April 2, 2012.

<span class="mw-page-title-main">Megurine Luka</span> Voice synthesizer software

Megurine Luka, codenamed "CV03", is a Vocaloid software developed by Crypton Future Media, headquartered in Sapporo, Japan. Its official moe anthropomorphism is a 20-year-old woman. She uses Yamaha Corporation's Vocaloid 2 and Vocaloid 4 singing synthesizer technology. Her voice is sampled from Yū Asakawa. She has performed alongside other Vocaloids at live concerts onstage as an animated hologram projection.

Aimi Terakawa, professionally known under the mononym Aimi (愛美) is a Japanese voice actress and singer from Kobe, Hyōgo Prefecture who is affiliated with the talent agency Hibiki. After aspiring to become an entertainer for part of her life, she started her singing career in 2011 after winning an audition to become part of the Tantei Opera Milky Holmes franchise. That same year, she made her solo music debut with the release of her first single "Tenshi no Clover"; the title song was used as the opening theme to the anime series Astarotte no Omocha!.

<span class="mw-page-title-main">Vocaloid 2</span> 2007 singing voice synthesizer

Vocaloid 2 is a singing voice synthesizer and the successor to the Vocaloid voice synthesizer application by Yamaha. Unlike the first engine, Vocaloid 2 based its output on vocal samples, rather than voice analysis. The synthesis engine and the user interface were completely revamped, with Japanese Vocaloids possessing a Japanese interface, as opposed to the previous version, which used English for both versions. It is noteworthy for introducing the popular character Hatsune Miku. It was succeeded by Vocaloid 3.

<span class="mw-page-title-main">Vocaloid 3</span> 2011 singing voice synthesizer

Vocaloid 3 is a singing voice synthesizer and successor to Vocaloid 2 in the Vocaloid series. This version of the software is a much more expansive version, containing many new features, three new languages and many more vocals than past software versions combined. It was succeeded by Vocaloid 4.

<span class="mw-page-title-main">Vocaloid 4</span> 2014 singing voice synthesizer

Vocaloid 4 is a singing voice synthesizer and successor to Vocaloid 3 in the Vocaloid series. It was succeeded by Vocaloid 5.

<span class="mw-page-title-main">Megpoid</span> Vocaloid 3 voicebank

Megpoid is a Vocaloid by Internet Co., Ltd. Her voice is sampled by Megumi Nakajima. The mascot of the software is called Gumi . She is also sometimes called Megpoid GUMI, or GUMI Megpoid.

<span class="mw-page-title-main">Sho Aoyagi</span> Japanese actor

Sho Aoyagi is a Japanese actor who is represented by the talent agency, LDH. He is a member of Gekidan Exile.

<span class="mw-page-title-main">Gackpoid</span>

Gackpoid, is a software product developed by Internet Co., Ltd. for the Vocaloid software. His voice is sampled from Japanese singer and actor Gackt. The mascot of the software is called Camui Gackpo, after Gackt's alias name. Gackpo is also known as Gakupo, and his last name is sometimes spelt as Kamui.

Marika Kouno is a Japanese voice actress and singer from Tokyo. She was affiliated with the agency Mausu Promotion before becoming affiliated with Aoni Production. Debuting as a voice actress in 2013, her first main role was in the 2015 anime television series Seiyu's Life! as Rin Kohana. She and the other main cast members of Seiyu's Life! are also members of the music group Earphones. She is known for her roles as Yua Nakajima in Hinako Note, Yumina Urnea Belfast in In Another World with My Smartphone, Mahiro Oyama in Onimai, and Silence Suzuka in Uma Musume Pretty Derby.

Keiichi Tokuda, graduate from and professor at the Nagoya Institute of Technology from 2004, doctor of engineering granted by Tokyo Institute of Technology and CEO & CTO of Techno-Speech, Inc., was named Fellow of the Institute of Electrical and Electronics Engineers (IEEE) in 2014 for contributions to hidden Markov model-based speech synthesis. He was awarded Medal with Purple Ribbon in 2020.

<span class="mw-page-title-main">RAPIS-1</span>

RAPIS-1 is a satellite launched on 18 January 2019 which for over a year was used to test seven technology demonstration projects. RAPIS-1 was developed and operated by Axelspace Corporation, under the coordination of the Japanese space agency JAXA.

Kanon Shizaki is a Japanese voice actress and musician who is currently freelance and was previously affiliated with Ace Crew Entertainment. She plays the keyboard for the band Roselia of the BanG Dream! franchise, which includes portraying the character Rinko Shirokane. She also was the keyboardist for the unit Happy Around! of D4DJ, where she voiced Rei Togetsu until 2022.

Sae Ōtsuka is a Japanese voice actress. She plays the guitar for the band Poppin'Party of the BanG Dream! franchise, which includes portraying the character Tae Hanazono.

<span class="mw-page-title-main">Paolo Andrea Di Pietro</span> Italian Japanese singer and actor

Paolo Andrea Di Pietro, better known mononymously in Japan as Paolo, is an Italian singer and actor living and working in Japan. He has appeared in a variety of Japanese commercials, TV shows and films. He also lent his singing voice to anime and video game soundtracks of internationally known franchises such as Dragon Quest, Final Fantasy and Genshin Impact.

<i>As a Reincarnated Aristocrat, Ill Use My Appraisal Skill to Rise in the World</i> Japanese light novel series

As a Reincarnated Aristocrat, I'll Use My Appraisal Skill to Rise in the World is a Japanese light novel series written by Miraijin A. The series originated on the Shōsetsuka ni Narō website, before being published in print with illustrations by Jimmy by Kodansha beginning in July 2020. As of April 2024, six volumes have been released. A manga adaptation, illustrated by Natsumi Inoue, began serialization on the Magazine Pocket website in June 2020. As of June 2024, the manga's individual chapters have been collected into fifteen tankōbon volumes. An anime television series adaptation produced by Studio Mother aired from April to June 2024, with a second season set to premiere later in Q4 of the same year.

For the debut work of anime studio Gainax, the 1987 anime film Royal Space Force: The Wings of Honnêamise, director Hiroyuki Yamaga set a goal of "natural" dialogue, which he maintained was "a first in Japanese animation." The performers chosen to portray the lead characters, Leo Morimoto as Shirotsugh and Mitsuki Yayoi as Riquinni, were professional actors who nevertheless had little to no experience working in anime. At the same time, Gainax sought out and recruited as Royal Space Force's sound director the highly experienced Atsumi Tashiro of Group TAC, known for his work on the 1974 TV series Space Battleship Yamato. Tashiro accepted the staff position on Royal Space Force despite it being the first project he had undertaken outside his own company in over 20 years, seeing it as a chance to revitalize himself professionally, and the casting of Morimoto and Yayoi as an opportunity to depict genuine emotion and honest and fresh reactions, a spirit that Tashiro remarked he had forgotten within the world of anime.

References

  1. Ju-Yun Cheng, Yi-Chin Huang, Chung-Hsien Wu (2014-12-04). "HMM-based Mandarin Singing Voice Synthesis Using Tailored Synthesis Units and Question Sets" (PDF). Association for Computational Linguistics and Chinese Language Processing. Retrieved 2017-05-17.{{cite web}}: CS1 maint: multiple names: authors list (link)
  2. Hentai (2012-12-27). "Sinsy Updates to 3.3 & Releases English Demo". Engloids.Info. Retrieved 2015-06-04.
  3. "Keiichiro Oura". Nagoya Institute of Technology. Retrieved 2017-05-17.
  4. "The HMM-Based Singing Voice Synthesis System "Sinsy" version 0.92". Sinsy.sourceforge.net. Retrieved 2016-01-28.
  5. ITmedia ニュース - 初音ミクとも簡単に対話できる「MMDAgent」、その詳細を聞いてきた. Retrieved November 23, 2013
  6. Nakamura, K.; Oura, K.; Nankaku, Y.; Tokuda, K. (May 2014). "HMM-Based singing voice synthesis and its application to Japanese and English". 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP). pp. 265–269. doi:10.1109/ICASSP.2014.6853599. ISBN   978-1-4799-2893-4. S2CID   384604.
  7. "「Ai美空ひばり」を支えた技術 「七色の声」どう再現? ヤマハ技術者に詳しく聞いた".