ð€ ã¯ããã«
ãAIã鳿¥œãäœãæä»£ããã€ãã«å°æ¥ïŒOpenAIãéçºãã Jukebox ã¯ãAIã䜿ã£ãŠãªãªãžãã«ã®æ¥œæ²ãèªåçæã§ããé©ãã®ããŒã«ã§ãðŒâš
æ¬èšäºã§ã¯ãJukeboxã®åºæ¬çãªäœ¿ãæ¹ãåå¿è åãã«ãããããã解説 ããŠãããŸãã
ãããèªãã°ãèªåã ãã®ãªãªãžãã«æ²ãAIã§äœãããšãå¯èœ ã«ãªããŸããïŒð¶
ð§ Jukeboxãšã¯ïŒAIã§é³æ¥œçæããä»çµã¿
ðŒ Jukeboxãšã¯ïŒ
Jukeboxã¯ãOpenAIãéçºãã鳿¥œçæAI ã§ãã
éå»ã®æ¥œæ²ãåŠç¿ããæ°ãã鳿¥œããŒãããäœãåºããã®ãç¹åŸŽã§ãã
ð ã©ããªããšãã§ããã®ïŒ
â AIãèªåã§é³æ¥œãäœæ ð¶
- AIãæ¢åã®é³æ¥œã¹ã¿ã€ã«ãåŠç¿ãããããå ã«æ°ããæ¥œæ²ãçæããŸããåŸæ¥ã®é³æ¥œå¶äœã®ããã«æ¥œåšãæŒå¥ããããšãªããæ°ããã¡ããã£ãŒãããŒã¢ããŒãäœãåºãããšãã§ããŸãã
â ãžã£ã³ã«ãã¢ãŒãã£ã¹ãã®ã¹ã¿ã€ã«ãæå®å¯èœ ðž
- ãŠãŒã¶ãŒã¯ç¹å®ã®ã¢ãŒãã£ã¹ãããžã£ã³ã«ãæå®ããããšã§ãåžæããã¹ã¿ã€ã«ã®é³æ¥œãçæã§ããŸããäŸãã°ãã¯ã©ã·ãã¯ããžã£ãºãããã¯ãããããªã©ã®ãžã£ã³ã«ãéžæããããšãå¯èœã§ãã
â æè©ãå ¥åãããšããŒã«ã«ä»ãã®æ²ãäœãã ð€
- Jukeboxã¯æè©ãåºã«AIãããŒã«ã«ããŒããçæããæ©èœãåããŠããŸããããã«ãããå®å šãªãªãžãã«ã®æä»ã楜æ²ãäœæã§ããŸãã
ãã ããå®å šã«èªç±ã«æäœããã«ã¯æè¡çãªç¥èãå¿ èŠ ãªã®ã§ãä»åã¯åå¿è åãã«ç°¡åãªäœ¿ãæ¹ãçŽ¹ä» ããŸãïŒ
ð Jukeboxã®äœ¿ãæ¹ãã¹ããããã€ã¹ããã解説ã
â ã¹ããã1ïŒJukeboxãåããããã®ç°å¢ãæºå
Jukeboxã¯ããŒã«ã«ç°å¢ã§ã¯ãªããGoogle Colab ã䜿ãã®ãåå¿è ã«ã¯ããããã§ãð¡
ð å¿ èŠãªãã®ïŒ
- Googleã¢ã«ãŠã³ãïŒColabãå©çšããããïŒ
- Google DriveïŒãã¡ã€ã«ä¿åçšïŒ
- Pythonã®åºæ¬ç¥èïŒã³ãŒããã³ããããã°OKïŒïŒ
ð» Google Colabãéãæé
- Google Colab ãéãïŒColabã®ããŒãžïŒ
- æ°ããããŒãããã¯ãäœæ
- GPUãæå¹å
- äžéšã¡ãã¥ãŒã®ãã©ã³ã¿ã€ã ãâãã©ã³ã¿ã€ã ã®ã¿ã€ãã倿ŽãâãããŒããŠã§ã¢ã¢ã¯ã»ã©ã¬ãŒã¿ãã GPU ã«èšå®
â ã¹ããã2ïŒJukeboxã®ã³ãŒããå®è¡
Colabã§ä»¥äžã®ã³ãŒããå®è¡ããŠãJukeboxãã»ããã¢ããããŸãã
ð¹ Jukeboxã®ã»ããã¢ããïŒColabçšïŒ
!git clone https://github.com/openai/jukebox.git
!cd jukebox && pip install -r requirements.txt
!pip install torch==1.9.0 torchvision torchaudioð¡ ã¯ã³ãã€ã³ãïŒãã®åŠçã«ã¯æéããããã®ã§ãæ°é·ã«åŸ ã¡ãŸãããâ³
â ã¹ããã3ïŒJukeboxã§é³æ¥œãäœæ
Jukeboxã® ããªã»ããã¢ãã« ã䜿ã£ãŠãç°¡åã«é³æ¥œãçæããŠã¿ãŸãããïŒ
ðŒ AIã«é³æ¥œãäœãããã³ãŒã
import torch
from jukebox.make_models import MODELS, make_vqvae, make_prior, make_decoder
# ã¢ãã«ã®èªã¿èŸŒã¿
model = make_prior("5b_lyrics") # 5b_lyricsã¯æè©ä»ãã®ã¢ãã«ð 5b_lyrics ã¢ãã«ã䜿çšãããšã AIãèªåã§æè©ãã€ããæ¥œæ²ãäœæ ããŸãð€âš
â ã¹ããã4ïŒãžã£ã³ã«ãã¢ãŒãã£ã¹ãã®ã¹ã¿ã€ã«ãæå®
Jukeboxã§ã¯ã ç¹å®ã®ã¢ãŒãã£ã¹ãã®é°å²æ°ãåçŸ ããããšãå¯èœã§ãïŒ
ðž äŸïŒããã¯èª¿ã®æ¥œæ²ãçæãã
sample_hparams = {
"artist": "The Beatles", # ã¢ãŒãã£ã¹ãã®ã¹ã¿ã€ã«
"genre": "Rock",
"lyrics": "We are dreaming in the night...", # æè©
}
# 楜æ²ãçæ
music = model.sample(**sample_hparams)ð¶ The Beatles颚ã®ããã¯æ²ãäœãããå Žåããã®ããã«æå® ããã°OKïŒ
ð¡ ãã€ã³ã
"artist"ã«å¥œããªã¢ãŒãã£ã¹ãåãå ¥å"genre"ã§ Pop, Jazz, Metal ãªã©ã®ãžã£ã³ã«ãéžæ"lyrics"ã«ãªãªãžãã«ã®æè©ãå ¥ãã
ããã ãã§ã AIãèªåã§æ¥œæ²ãçæ ããŠãããŸãðµâš
â ã¹ããã5ïŒçæãã鳿¥œãããŠã³ããŒãïŒåç
AIãäœã£ã鳿¥œã¯ãGoogle Driveã«ä¿åãããšç°¡åã«åçã§ããŸãð
ð¶ çæãã鳿¥œãä¿åããã³ãŒã
from google.colab import files
# äœæãã鳿¥œãã¡ã€ã«ãããŠã³ããŒã
files.download("generated_music.wav")â ããŠã³ããŒãããã.wavããã¡ã€ã«ã¯ãããœã³ã³ãã¹ããã§åçå¯èœïŒ ð§
ð ãŸãšãïŒJukeboxãæŽ»çšããŠAI鳿¥œå¶äœã楜ãããïŒ
ä»åã®ã¬ã€ãã§ã¯ã åå¿è åãã«Jukeboxã®åºæ¬çãªäœ¿ãæ¹ ã解説ããŸããðâš
ð¥ ãã®èšäºã®ãŸãšã
â
Jukebox㯠AIã§é³æ¥œãçæã§ããããŒã«
â
Google Colab ã§ç°¡åã«äœ¿ãã
â
ãžã£ã³ã«ãã¢ãŒãã£ã¹ãã®ã¹ã¿ã€ã«ãæå®ã§ãã
â
æè©ä»ãã®ãªãªãžãã«æ²ãäœãã ð€
AI鳿¥œå¶äœã®äžç㯠ãŸã ãŸã é²åäž ð
Jukeboxã䜿ã£ãŠãèªåã ãã®ãªãªãžãã«ãœã³ã°ãäœã£ãŠã¿ãŸãããð¶âš
ðŒ ããªããæªæ¥ã®AIäœæ²å®¶ã«ïŒ ðµð¡
