Action List Manager (ALM) for Voxta

Plugins Action List Manager (ALM) for Voxta

This plugin is a router that ties the VaM defined actions based on triggers and Timeline animations. You can link actions into a tree of choices to build a consistent story. It supports triggers and multi-context - location/clothes/custom injecting into Voxta.


Instructions:
  • Add the plugin to the Person atom along with Voxta and Timeline (if you want your actions to have animations)
  • Define a tree of actions like the one in my routing tutorial video below.
  • Add custom contexts for those actions. The general rule is that when a field is empty it does not substitute the value that already exists. It applies both to context fields and linked actions.
  • Context will be constructed like so: "{{char}} is feeling shy. {{char}} is in {{user}} living room. {{char}} is wearing pink blouse and jeans"
  • In Voxta plugin "On Action Trigger" call TriggerActionChange on my plugin.
  • In Voxta plugin "On State Change" call TriggerStateChange on my plugin.
  • In Voxta plugin "On Speak Trigger" call OnTriggerSpeak on my plugin.
  • There are 4 types of actions - Normal, User, Transition, Layered:
    • Normal actions are executed by Voxta w/o any special effects
    • Transition actions are just like normal except action execution will be blocked until Timeline animation finishes
    • Layered actions are executed alongside normal actions so multiple action inferences per turn are possible. It's useful for things like facial expressions where the character will do normal action like sit on the sofa and smile at the same time
    • User action is something that LLM has no access to and it's actually an action that the user will trigger from the list on the screen or on his wrist watch in VR
In order to understand the logic behind it you can start with the provided scene - ALM Starter Scene. Have a look at how actions are defined there and how they interconnect with each other. I've made a bunch of tutorials on my YouTube channel to make sure that everything is clear.

The flow is like so:
LLM infers an action -> Voxta -> OnActionTrigger -> ActionListManager -> executes triggers, plays animations, changes ActionsList according to it's routing definition and Context in Voxta.
If you defer the action until the character stops speaking (checkbox in the action definition), then ActionListManager memorizes the action and calls it on getting the idle state update from Voxta (when character stop speaking)

I produce Action Bundles that are extensions to the plugin. They contain both animations and action definitions. You can import them into the plugin to have new behaviors for the character. You can find them here:

https://hub.virtamate.com/search/10613148/?q=action+bundle&t=resource&c[users]=vaan20&o=relevance

A word of warning:
This plugin is made specifically for Voxta, which is currently a paid experience. If you want to make use of it, you need to be a patron of this initiative, which I highly encourage you to do.
If you have a hard time understanding either my plugin or Voxta just drop me a message on Discord. We can talk or even do a screen share.
If you like what I'm doing consider subscribing to my Patreon.
------------------------------------------------------------------------------------------------------------------
Character for testing action inference:
Alita.png

------------------------------------------------------------------------------------------------------------------
The LLM model I recommend:
------------------------------------------------------------------------------------------------------------------
More tutorials:
BAM!
User Actions Tutorial
Layers Tutorial
Transition Actions Tutorial
Basic Routing Tutorial
Author
vaan20
Downloads
14,272
Views
29,332
Dependencies
12
Packages
1
Total Size
0.26 MB
Version
2.3.0
First release
Last update
Rating
5.00 star(s) 7 ratings

More resources from vaan20

Credits

Creator Support Link
Acid Bubbles Acid Bubbles
hazmhox hazmhox
MonsterShinkai MonsterShinkai
Acid Bubbles Acid Bubbles
MacGruber MacGruber
CheesyFX CheesyFX
CheesyFX CheesyFX
AshAuryn AshAuryn
AshAuryn AshAuryn
AshAuryn AshAuryn

Latest updates

  1. Release 2.3.0

    Changelist: BAM (bulk action manager) module added - tutorial in the attached video. Allows...
  2. Release 2.2.1

    Changelog: User Actions functionality added Action UI rearranged a little Multiple code...
  3. Status for today and "What is Alita doing when I'm not there" - Action Bundles teaser

    Hi, If you are waiting for "User Actions" to be released then I have good news for you as the...

Latest reviews

Impressive Plugin, nice work!

btw. you can try the 7b models instead of the 13b. They are faster and performs better for chat situations as the 13b models because that is their main role.
I prefer this one: Undi95/Toppy-M-7B its also from Undi like the lewd models. Maybe you can find it also on the Blokes board as GPTQ etc. But if you can run it as the original transformer model, then it has the best interference.

You can also watch on the LLM Leaderboard for good new models.

https://huggingface.co/spaces/HuggingFaceH4/open_llm_leaderboard

The best models for this usage, have an high HellaSwag and Winogrande.
vaan20
vaan20
Well ... I need to update the main plugin page but everything just takes so much time man. Of course 7B models are snappy and good now. Back in November ... Not so much 😉
Upvote 0
great work!!
vaan20
vaan20
Thank you <3
Upvote 0
vaan - keep doing what you're doing, this is great stuff
vaan20
vaan20
thank you so much man!
Upvote 0
Probably one of the coolest game changers for creating an interactive experience. Support this dude!!! I've been playing around with it for a while now, and each time, new possibilities expose themselves. Awesome work VAAN20!!!
vaan20
vaan20
Thank you so much. It really means a lot to me.
Upvote 0
I was waiting for this tutorial video since I couldn't get the plugin to work in my custom scene. Still not sure if it's going to work, but I have to rate it for the usability. Thanks.
vaan20
vaan20
There's a demo scene now. The idea is to start from that and progress with your own stuff
Upvote 0
I had been tinkering with custom actions myself, but this is much cleaner than my mess. Thank you good sir, well done. 👏👏
Upvote 0
Excellent! This not just simplifies scene building with Voxta, it also adds nice opportunities for story telling with an AI.
Easy to use, slim and straight forward!
vaan20
vaan20
thanks man, it's really nice to hear that somebody is using stuff I've written
Upvote 1
Back
Top Bottom