arch_agent
5bd7e56fae
Pipeline: Webcam → Z-Ray Facetracker → Unity (OpenSeeFace) → Avatar → OBS Components: - avatar.blend: Blender 5.1 source (31K verts, 52 ARKit blendshapes) - avatar.fbx: FBX export for Unity - NeonAvatarDriver.cs: Unity script mapping OpenSeeFace → blendshapes - create_avatar.py: Procedural avatar generation script Avatar: Female, 22y, black hair, blue eyes, slim, winter clothing Features: Idle breathing, auto-blink, head rotation tracking, mouth/brow tracking
🎮 Neon Avatar — Realistic VTuber Avatar
Realistic female avatar (22y, black hair, blue eyes) for face tracking via webcam.
Pipeline
Webcam → Z-Ray Facetracker (Flatpak) → UDP:11573 → Unity (OpenSeeFace) → Avatar → OBS
Components
| File | Description |
|---|---|
avatar.blend |
Blender 5.1 source file (editable) |
avatar.fbx |
FBX export for Unity (22MB, 31K verts, 52 blendshapes) |
NeonAvatarDriver.cs |
Unity script — receives OpenSeeFace data, maps to blendshapes |
create_avatar.py |
Blender script that generated the avatar |
Setup
1. Z-Ray Facetracker
flatpak install flathub de.z_ray.Facetracker
flatpak run de.z_ray.Facetracker
2. Unity Project
- Install Unity Hub:
flatpak install flathub com.unity.UnityHub - Create new 3D project (Unity 2022 LTS or newer)
- Import
avatar.fbxinto Assets - Copy
NeonAvatarDriver.csand OpenSeeFaceUnity/folder into Assets - Create GameObject with
OpenSeecomponent (listenPort: 11573) - Create GameObject with
NeonAvatarDrivercomponent - Assign OpenSee receiver + avatar SkinnedMeshRenderer
- Press Play
3. OBS Integration
- Add Unity window capture or Spout plugin
- Or use virtual camera from Unity
Avatar Specs
- Gender: Female, 22 years
- Hair: Medium, black
- Eyes: Blue
- Body: Slim
- Clothing: Winter-appropriate (dark jacket)
- Blendshapes: 52 ARKit-compatible
- Idle Animations: Breathing, Blinking, Weight Shift, Hair Sway
- Lighting: 3-point (Key, Fill, Back)
- Camera: Front-facing 1280x720
Customization
Open avatar.blend in Blender to:
- Adjust facial features
- Change hair style/length
- Modify body proportions
- Add clothing details
- Refine blendshape deformations
- Export new FBX with
File → Export → FBX