This workflow demonstrates the ability to modulate spline data with features, including audio. This spline data can be used to control the trajectory of the subject in a video generated by CogVideo.
THIS IS BETA. If people are interested, comment here and on the youtube video and I will make it more robust or to specification.
GITHUB - gimmi a star
Sub on da youtube. Tutorial below.
Love,
Ryan