At this point I pretty much ironed out how I wanted to make this toon shader work, though pattern-based shading like hatching or halftoning etc is still beyond me as it isn't reactive to light color either, which is a bit of a challenge for me to fix in future.
I came up with my own Lightmaps to further control the lighting, following a similar method to how MiHoYo did theirs in Honkai Impact 3. A friend told me their lightmaps is similar to how people make "MREC" textures, but there's not much information about these online.
Maya toon/cel shader showcase.
Vtuber model deployment, lipsync is powered by in-game voicelines and motion is driven by realtime face tracking. BG from Arknights in-game CG, software used is VSeeFace and Unity.
feel free to check the wireframe here.
Shitpost. On a more serious note, the VRM model was plugged into VRM Live Viewer and it read MMD motion and camera movement, creating this playable video in realtime.
Video caption will have the details you need.