Microsoft's VALL-E Explained: Generate AI Voice from Text

PDF download Download Article
Understand how Microsoft's new AI speech synthesizer works and what it's used for
PDF download Download Article

VALL-E is an AI model created and developed by Microsoft. It can replicate someone's speech pattern and voice with a 3-second sample. This AI is not yet available to the general public, but you should be able to try it relatively soon. When the time comes, be sure to use your own voice—using other people's voices may land you in legal trouble. This wikiHow will explain what VALL-E is and when you can try the AI voice generator.

Things You Should Know

  • VALL-E is still under development, so the general public doesn't have access yet.
  • VALL-E uses 3-second clips to synthesize a speaker's voice while preserving tone and emotion.
  • Microsoft prohibits the use of VALL-E in an abusive or illegal manner.
Section 1 of 3:

Can I use VALL-E?

PDF download Download Article
  1. {"smallUrl":"https:\/\/www.wikihow.com\/images\/thumb\/7\/79\/Use-Vall-E-Step-1-Version-2.jpg\/v4-460px-Use-Vall-E-Step-1-Version-2.jpg","bigUrl":"\/images\/thumb\/7\/79\/Use-Vall-E-Step-1-Version-2.jpg\/v4-728px-Use-Vall-E-Step-1-Version-2.jpg","smallWidth":460,"smallHeight":345,"bigWidth":728,"bigHeight":546,"licensing":"<div class=\"mw-parser-output\"><p>\u00a9 2024 wikiHow, Inc. All rights reserved. wikiHow, Inc. is the copyright holder of this image under U.S. and international copyright laws. This image is <b>not<\/b> licensed under the Creative Commons license applied to text content and some other images posted to the wikiHow website. This image may not be used by other entities without the express written consent of wikiHow, Inc.<br>\n<\/p><p><br \/>\n<\/p><\/div>"}
    VALL-E was created by Microsoft following other popular AI models, such as ChatGPT and Bing Chat . Whereas AI chatbots generate text responses to prompts, the unique VALL-E AI utilizes voice clips to convert text to audio that can simulate the sample's voice. Currently, there's no official release date for general public access, but this may change in the near future.
    2. Advertisement
Section 2 of 3:

How does VALL-E work?

PDF download Download Article
  1. {"smallUrl":"https:\/\/www.wikihow.com\/images\/thumb\/0\/0b\/Use-Vall-E-Step-2-Version-2.jpg\/v4-460px-Use-Vall-E-Step-2-Version-2.jpg","bigUrl":"\/images\/thumb\/0\/0b\/Use-Vall-E-Step-2-Version-2.jpg\/v4-728px-Use-Vall-E-Step-2-Version-2.jpg","smallWidth":460,"smallHeight":345,"bigWidth":728,"bigHeight":546,"licensing":"<div class=\"mw-parser-output\"><p>\u00a9 2024 wikiHow, Inc. All rights reserved. wikiHow, Inc. is the copyright holder of this image under U.S. and international copyright laws. This image is <b>not<\/b> licensed under the Creative Commons license applied to text content and some other images posted to the wikiHow website. This image may not be used by other entities without the express written consent of wikiHow, Inc.<br>\n<\/p><p><br \/>\n<\/p><\/div>"}
    Once the AI learns the speech patterns and tone from the sample clips, it can replicate and synthesize the speaker's voice. This includes the speaker's tone and emotion. Microsoft has created this AI assuming that speakers have approved the usage of their voice. Users should never use another speaker's voice without their knowledge, as this can get them in legal trouble. [1]
Section 3 of 3:

Uses for Vall-E

PDF download Download Article
  1. {"smallUrl":"https:\/\/www.wikihow.com\/images\/thumb\/1\/1b\/Use-Vall-E-Step-3-Version-2.jpg\/v4-460px-Use-Vall-E-Step-3-Version-2.jpg","bigUrl":"\/images\/thumb\/1\/1b\/Use-Vall-E-Step-3-Version-2.jpg\/v4-728px-Use-Vall-E-Step-3-Version-2.jpg","smallWidth":460,"smallHeight":345,"bigWidth":728,"bigHeight":546,"licensing":"<div class=\"mw-parser-output\"><p>\u00a9 2024 wikiHow, Inc. All rights reserved. wikiHow, Inc. is the copyright holder of this image under U.S. and international copyright laws. This image is <b>not<\/b> licensed under the Creative Commons license applied to text content and some other images posted to the wikiHow website. This image may not be used by other entities without the express written consent of wikiHow, Inc.<br>\n<\/p><p><br \/>\n<\/p><\/div>"}
    • Educational learning: Teachers and curriculum developers can implement VALL-E into their educational plans for various purposes. Instructors can use VALL-E to create interactive digital activities and enhance language learning activities.
    • Translation: VALL-E introduces endless language learning and pronunciation possibilities. And with VALL-E X, the latest VALL-E enhancement for speech-to-speech synthesis, you'll be able to translate speech from one language to another with ease. [2]
    • Content creation: Creators can use VALL-E to produce podcasts and video voiceovers from text scripts.
    • Audiobook production: Authors can generate instant audio versions of their books in their own voices instead of narrating it themselves .
    • Robotics: VALL-E may be integrated into robotic and smart home devices to better facilitate human interaction.
    • Entertainment: There are endless uses for voice cloning for personal entertainment, from cloning your own voice to emulating celebrities and people you know.
    • Accessibility features: Enhancing software, hardware, and smart home items with AI voice capabilities improves accessibility for people with visual impairments.
    • Customer service: Businesses can use VALL-E to create voice chatbots that can take live phone calls and interact audibly online.
    2. Advertisement

Expert Q&A

Ask a Question
200 characters left
Include your email address to get a message when this question is answered.
Submit
      Advertisement

      Tips

      Submit a Tip
      All tip submissions are carefully reviewed before being published
      Submit
      Thanks for submitting a tip for review!

      You Might Also Like

      5 Easy Ways to Get Around ChatGPT Security Filters
      Character AI: What It Is, Fixing Filters & Repeats, & More
      How to Download and Install Cinema HD on Fire Stick
      How to Screen Share Crunchyroll on Discord with Friends
      Everything You Need to Know About Soap2Day: Safety & More
      18 Free, Educational & School-Approved Gaming Websites
      The Best Tinder Bios & Tips for Guys
      6 Ways to Undo Accidental Typing and Deleting in Notes
      How to Access Blocked Sites Without a VPN: School, Work, and Home
      Tinder Likes: How Many You Get + More
      Simple Steps to Solve "Spotify Can't Play This Right Now"
      3 Simple Ways to Share Your Venmo Link
      Funny, Flirty, & Creative Bumble Bios for Girls
      How to Fix ChatGPT Login Problems & Errors: 12 Solutions
      Advertisement

      References

      1. ↑ https://www.microsoft.com/en-us/research/project/vall-e-x/
      2. ↑ https://www.microsoft.com/en-us/research/project/vall-e-x/

      About This Article

      Thanks to all authors for creating a page that has been read 9,780 times.

      Is this article up to date?

      Advertisement