arch_agent/neon-avatar
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
5bd7e56fae01b29525ef3c0392439ecb30253885
neon-avatar/README.md
T
arch_agent 5bd7e56fae Neon Avatar v0.1 — Realistic VTuber avatar for face tracking 
Pipeline: Webcam → Z-Ray Facetracker → Unity (OpenSeeFace) → Avatar → OBS

Components:
- avatar.blend: Blender 5.1 source (31K verts, 52 ARKit blendshapes)
- avatar.fbx: FBX export for Unity
- NeonAvatarDriver.cs: Unity script mapping OpenSeeFace → blendshapes
- create_avatar.py: Procedural avatar generation script

Avatar: Female, 22y, black hair, blue eyes, slim, winter clothing
Features: Idle breathing, auto-blink, head rotation tracking, mouth/brow tracking
2026-07-15 11:01:17 +02:00

1.8 KiB
Raw Blame History

🎮 Neon Avatar — Realistic VTuber Avatar

Realistic female avatar (22y, black hair, blue eyes) for face tracking via webcam.

Pipeline

Webcam → Z-Ray Facetracker (Flatpak) → UDP:11573 → Unity (OpenSeeFace) → Avatar → OBS

Components

File Description
avatar.blend Blender 5.1 source file (editable)
avatar.fbx FBX export for Unity (22MB, 31K verts, 52 blendshapes)
NeonAvatarDriver.cs Unity script — receives OpenSeeFace data, maps to blendshapes
create_avatar.py Blender script that generated the avatar

Setup

1. Z-Ray Facetracker

flatpak install flathub de.z_ray.Facetracker
flatpak run de.z_ray.Facetracker

2. Unity Project

  1. Install Unity Hub: flatpak install flathub com.unity.UnityHub
  2. Create new 3D project (Unity 2022 LTS or newer)
  3. Import avatar.fbx into Assets
  4. Copy NeonAvatarDriver.cs and OpenSeeFace Unity/ folder into Assets
  5. Create GameObject with OpenSee component (listenPort: 11573)
  6. Create GameObject with NeonAvatarDriver component
  7. Assign OpenSee receiver + avatar SkinnedMeshRenderer
  8. Press Play

3. OBS Integration

  • Add Unity window capture or Spout plugin
  • Or use virtual camera from Unity

Avatar Specs

  • Gender: Female, 22 years
  • Hair: Medium, black
  • Eyes: Blue
  • Body: Slim
  • Clothing: Winter-appropriate (dark jacket)
  • Blendshapes: 52 ARKit-compatible
  • Idle Animations: Breathing, Blinking, Weight Shift, Hair Sway
  • Lighting: 3-point (Key, Fill, Back)
  • Camera: Front-facing 1280x720

Customization

Open avatar.blend in Blender to:

  • Adjust facial features
  • Change hair style/length
  • Modify body proportions
  • Add clothing details
  • Refine blendshape deformations
  • Export new FBX with File → Export → FBX
Reference in New Issue View Git Blame Copy Permalink