Project Vtube

Have you ever wanted to stream online or create YouTube videos but aren't comfortable with showing your face online? No problem! Project Vtube has you covered. Using the simple steps that I used to build Project Vtube as a part of my Principles Of Engineering SIDE Project, you can mask your face with a custom 3D avatar of your choosing that imitates your every movement. No longer does your audience have to watch your gameplay without seeing your facial expression and knowing how you feel.

Materials for this project were provided by my Principles Of Engineering teacher, Ms. Berbawy. All software used to make this project is free.

Hardware:

Microphone

Webcam

Personal Computer

Tripod

Green Screen

Software:

Steam

Vroid Studio

VSeeFace

Streamlabs OBS

Purchase a green screen, a microphone, and a tripod. Install Steam and on your computer using a browser. Once Steam is installed, open it and download VRoid Studio for free. Open your browser and search up VSeeFace, or click here. While on you browser, also search up Streamlabs OBS and make sure to download it as well.

Creating a face for your model is easy! There are 2 different methods you can use. The first method is to manipulate the base model that VRoid Studio gives you by using the sliders on the side of your screen. This does not require much time but will yield less detailed results. The other method is to head over to the textures of each part of the face provided by VRoid Studio and manipulate them however you'd like. This method takes more time but can yield a more detailed face since it gives you the opportunity to draw art such as tattoos on your model. I will explain how to use both methods. Simply open VRoid Studio and begin a new project. Select the gender of your model and begin begin by manipulating the sliders on the right side of the screen to change all of it's default facial features. Open the textures on the facial features on the left side and start drawing over them however you'd like. There will be several different brushes and colors to choose from on the right of your screen. This can be very useful when drawing features such as the eyebrows and tattoos. Once you are comfortable with a face of your choosing, you can start changing the colors of various features such as the eyes. If you want to change the color of the eyes, you'll want to export a file of the default eyes and then import them to Adobe Illustrator. Draw over the eyes in Adobe Illustrator however you'd like and then you can import them back to VRoid Studio.

Sketching the hair for your model is fun. Simply select the freehand sketch option and start drawing over the 3D grid provided. It is important to hit the symmetry button (the same one you may have pressed when making the face) in the top right if you want the hair to be identical on both sides. Make sure that you move your hand slow and concentrate while drawing the hair so it looks as detailed as possible. It is important to take your time when drawing the hair to achieve the best possible outcome. In order to change the color of your model's hair, navigate to the right side of your screen and you can manipulate the color of your hair using the grid. It is worth noting that you can change the color of different parts of the strands of hair to create a completely unique look with highlights.

Selecting an outfit for your model is an extremely streamlined process. I highly recommend picking premade clothing rather than trying to make your own as it can be an extremely tedious process. VRoid Studio comes with several default pieces of clothing. However, if you'd like to find clothing that helps you express yourself more, you can go to pixiv.net. They have several free outfits to choose from all of which are easy to download and import into VRoid Studio. I decided to go with traditional school uniforms for my vtuber models.

Using your model is easy! Simply export it out of VRoid Studio and open VSeeFace. In VSeeFace, select a new model and then click on your exported file. Once exported, the model should automatically start tracking your facial movements and you can even apply more movement constraints like I did if necessary. You can also create custom keys to change your avatar's facial expression on the fly. There are several different facial expressions to choose from and you can even create custom ones easily if you'd like. Lastly, there is the option you can select to make your background a jpg in the bottom right corner. Simply select the little square option in order to do this. With all of that done, you're ready to open Streamlabs OBS.

Once Streamlabs is open, you can set any tab as your camera. In order to do this, select the plus icon in the middle of the screen, select new camera option, and then click on the open VSeeFace tab. Once here, you should see your avatar moving around on the camera display at the top. This is where you will want to set up your greenscreen behind you. Once done, open the default camera app or a browser camera and then set that as a second camera overlay in Streamlabs making sure to put the layer under your model. Once done, set your greenscreen to any background you'd like using the plus feature again except selecting image this time. After this step, head to settings and select "New Camera Type". This is where you create the camera that you will select if you want to use your vtuber model camera on Zoom Meetings or Discord.

After this, you are done! Congratulations you have officially created your own, custom, vtuber model!