arch_agent
5bd7e56fae
Pipeline: Webcam → Z-Ray Facetracker → Unity (OpenSeeFace) → Avatar → OBS Components: - avatar.blend: Blender 5.1 source (31K verts, 52 ARKit blendshapes) - avatar.fbx: FBX export for Unity - NeonAvatarDriver.cs: Unity script mapping OpenSeeFace → blendshapes - create_avatar.py: Procedural avatar generation script Avatar: Female, 22y, black hair, blue eyes, slim, winter clothing Features: Idle breathing, auto-blink, head rotation tracking, mouth/brow tracking
66 lines
1.8 KiB
Markdown
66 lines
1.8 KiB
Markdown
# 🎮 Neon Avatar — Realistic VTuber Avatar
|
|
|
|
Realistic female avatar (22y, black hair, blue eyes) for face tracking via webcam.
|
|
|
|
## Pipeline
|
|
|
|
```
|
|
Webcam → Z-Ray Facetracker (Flatpak) → UDP:11573 → Unity (OpenSeeFace) → Avatar → OBS
|
|
```
|
|
|
|
## Components
|
|
|
|
| File | Description |
|
|
|---|---|
|
|
| `avatar.blend` | Blender 5.1 source file (editable) |
|
|
| `avatar.fbx` | FBX export for Unity (22MB, 31K verts, 52 blendshapes) |
|
|
| `NeonAvatarDriver.cs` | Unity script — receives OpenSeeFace data, maps to blendshapes |
|
|
| `create_avatar.py` | Blender script that generated the avatar |
|
|
|
|
## Setup
|
|
|
|
### 1. Z-Ray Facetracker
|
|
|
|
```bash
|
|
flatpak install flathub de.z_ray.Facetracker
|
|
flatpak run de.z_ray.Facetracker
|
|
```
|
|
|
|
### 2. Unity Project
|
|
|
|
1. Install Unity Hub: `flatpak install flathub com.unity.UnityHub`
|
|
2. Create new 3D project (Unity 2022 LTS or newer)
|
|
3. Import `avatar.fbx` into Assets
|
|
4. Copy `NeonAvatarDriver.cs` and OpenSeeFace `Unity/` folder into Assets
|
|
5. Create GameObject with `OpenSee` component (listenPort: 11573)
|
|
6. Create GameObject with `NeonAvatarDriver` component
|
|
7. Assign OpenSee receiver + avatar SkinnedMeshRenderer
|
|
8. Press Play
|
|
|
|
### 3. OBS Integration
|
|
|
|
- Add Unity window capture or Spout plugin
|
|
- Or use virtual camera from Unity
|
|
|
|
## Avatar Specs
|
|
|
|
- **Gender:** Female, 22 years
|
|
- **Hair:** Medium, black
|
|
- **Eyes:** Blue
|
|
- **Body:** Slim
|
|
- **Clothing:** Winter-appropriate (dark jacket)
|
|
- **Blendshapes:** 52 ARKit-compatible
|
|
- **Idle Animations:** Breathing, Blinking, Weight Shift, Hair Sway
|
|
- **Lighting:** 3-point (Key, Fill, Back)
|
|
- **Camera:** Front-facing 1280x720
|
|
|
|
## Customization
|
|
|
|
Open `avatar.blend` in Blender to:
|
|
- Adjust facial features
|
|
- Change hair style/length
|
|
- Modify body proportions
|
|
- Add clothing details
|
|
- Refine blendshape deformations
|
|
- Export new FBX with `File → Export → FBX`
|