Neon Avatar v0.1 — Realistic VTuber avatar for face tracking
Pipeline: Webcam → Z-Ray Facetracker → Unity (OpenSeeFace) → Avatar → OBS Components: - avatar.blend: Blender 5.1 source (31K verts, 52 ARKit blendshapes) - avatar.fbx: FBX export for Unity - NeonAvatarDriver.cs: Unity script mapping OpenSeeFace → blendshapes - create_avatar.py: Procedural avatar generation script Avatar: Female, 22y, black hair, blue eyes, slim, winter clothing Features: Idle breathing, auto-blink, head rotation tracking, mouth/brow tracking
This commit is contained in:
@@ -0,0 +1,65 @@
|
||||
# 🎮 Neon Avatar — Realistic VTuber Avatar
|
||||
|
||||
Realistic female avatar (22y, black hair, blue eyes) for face tracking via webcam.
|
||||
|
||||
## Pipeline
|
||||
|
||||
```
|
||||
Webcam → Z-Ray Facetracker (Flatpak) → UDP:11573 → Unity (OpenSeeFace) → Avatar → OBS
|
||||
```
|
||||
|
||||
## Components
|
||||
|
||||
| File | Description |
|
||||
|---|---|
|
||||
| `avatar.blend` | Blender 5.1 source file (editable) |
|
||||
| `avatar.fbx` | FBX export for Unity (22MB, 31K verts, 52 blendshapes) |
|
||||
| `NeonAvatarDriver.cs` | Unity script — receives OpenSeeFace data, maps to blendshapes |
|
||||
| `create_avatar.py` | Blender script that generated the avatar |
|
||||
|
||||
## Setup
|
||||
|
||||
### 1. Z-Ray Facetracker
|
||||
|
||||
```bash
|
||||
flatpak install flathub de.z_ray.Facetracker
|
||||
flatpak run de.z_ray.Facetracker
|
||||
```
|
||||
|
||||
### 2. Unity Project
|
||||
|
||||
1. Install Unity Hub: `flatpak install flathub com.unity.UnityHub`
|
||||
2. Create new 3D project (Unity 2022 LTS or newer)
|
||||
3. Import `avatar.fbx` into Assets
|
||||
4. Copy `NeonAvatarDriver.cs` and OpenSeeFace `Unity/` folder into Assets
|
||||
5. Create GameObject with `OpenSee` component (listenPort: 11573)
|
||||
6. Create GameObject with `NeonAvatarDriver` component
|
||||
7. Assign OpenSee receiver + avatar SkinnedMeshRenderer
|
||||
8. Press Play
|
||||
|
||||
### 3. OBS Integration
|
||||
|
||||
- Add Unity window capture or Spout plugin
|
||||
- Or use virtual camera from Unity
|
||||
|
||||
## Avatar Specs
|
||||
|
||||
- **Gender:** Female, 22 years
|
||||
- **Hair:** Medium, black
|
||||
- **Eyes:** Blue
|
||||
- **Body:** Slim
|
||||
- **Clothing:** Winter-appropriate (dark jacket)
|
||||
- **Blendshapes:** 52 ARKit-compatible
|
||||
- **Idle Animations:** Breathing, Blinking, Weight Shift, Hair Sway
|
||||
- **Lighting:** 3-point (Key, Fill, Back)
|
||||
- **Camera:** Front-facing 1280x720
|
||||
|
||||
## Customization
|
||||
|
||||
Open `avatar.blend` in Blender to:
|
||||
- Adjust facial features
|
||||
- Change hair style/length
|
||||
- Modify body proportions
|
||||
- Add clothing details
|
||||
- Refine blendshape deformations
|
||||
- Export new FBX with `File → Export → FBX`
|
||||
Reference in New Issue
Block a user