Commit Graph

10 Commits

Author SHA1 Message Date
itsamejms
b120219b4f attempting to fix rigging and asking AI to generate the images slightly differently 2026-06-07 16:54:46 +01:00
Ivar Troost
2fc6f8c476 Use pnpm instead 2026-06-07 16:26:03 +01:00
Ivar Troost
6c4781f623 Update dependencies 2026-06-07 16:12:58 +01:00
Ivar Troost
3df9a982d9 Move to pnpm 2026-06-07 16:03:12 +01:00
itsamejms
ac8d171046 finally getting a dev version functioning locally... what a mess that was 2025-11-21 22:22:53 +00:00
James Twose
5078d67d4f refactor: Improve avatar asset processing
Separates asset analysis into distinct steps to accurately capture face landmarks.
Introduces `fileToDataUrl` utility and modifies `stitchAssets` to accept image source strings, reducing redundant file processing and improving clarity.
2025-11-20 22:03:53 +01:00
James Twose
ddb2455416 feat: Add image upload and background removal
Enables users to upload custom avatar assets and automatically remove the background from the generated image.

New features:
- Avatar creation now supports uploading base, blink, and talk textures.
- Added ability to define the main body bounding box during rigging.
- Vision service now includes image segmentation for background removal.
- Studio component dynamically processes the avatar image for background removal if chroma key is enabled.
2025-11-20 21:24:22 +01:00
James Twose
3eff403fb4 feat: Generate VTuber character sheet with expression assets
The Gemini service has been updated to generate a character sheet rather than a single avatar image. This sheet includes the main character and separate assets for closed eyes and an open mouth.

The `AvatarConfig` type and `RiggingEditor` component have been extended to handle these new expression assets (`textureClosedEye`, `textureOpenMouth`). A new `Sprite` component has been added to `Studio.tsx` to correctly render these specific regions from the generated character sheet. The UI has been updated to reflect the new generation process.
2025-11-20 20:55:47 +01:00
James Twose
b6017794a5 feat: Initialize Gemini V-Studio project setup
Sets up the foundational project structure, including:
- Vite for build tooling.
- React for the UI.
- Tailwind CSS for styling.
- MediaPipe for face tracking capabilities.
- Gemini API integration for avatar generation.
- Basic configuration files (package.json, vite.config.ts, tsconfig.json).
- Initial README with local run instructions.
- Core types and a basic Gemini service for image generation.
2025-11-20 20:45:25 +01:00
James Twose
bbd1a19152
Initial commit 2025-11-20 20:45:10 +01:00