ModPlug Central

OpenMPT Development (Archive) => Feature Requests => Feature Request Archive => Topic started by: RG (aka AUDIOMONSTER) on January 18, 2008, 01:32:56

Title: Video Synchronisation
Post by: RG (aka AUDIOMONSTER) on January 18, 2008, 01:32:56
Hi, everyone,

I'm a french videogames and movies composer, having done several short movies soundtracks  (and many videogames OST too) with MPT, and recently worked on my first feature long movie, always with MPT(!).

But a cruel lack is felt currently: the possibility of synchronizing a video (no matter its format) with an MPT module, like a .IT, for example.

The video could be played in a shared/external window, making it possible to place it on a second screen, for a greater comfort of work.

This functionality would make MPT completely autonomous, and would complete to make of it an exploitable tool for audio-visual industry !

I am the alive proof of it, since I always definitely use it for all my games/movies OST since about 10 years : -).

I bless in advance the benefactor who will make this function possible; -)

Or maybe, at least and waiting for better, there's a way to synchronize a video using a VST trick ?

Is this request complicated to realize?

In any case, I just DREAM about it, being an inveterate fan of this software.

Thank you in advance for any answer and infos.

Best regards from Paris ;-)

RG :)
Title: Video Synchronisation
Post by: Sam_Zen on January 18, 2008, 05:55:24
An interesting request.

For synchronization both audio and video will need reference points to make links with.
Video has a 'frame' as a mathematical unit, because it represents a certain time. Another one : 'n frames'.

A tracker-module has 'one tick', 'one row' and 'one pattern' as such units, also representing some duration.

All units have the variable of global playback-speed, making the durations of the units.
Sync here means two seperate media-cycles, where one of them is forcing the other cycle in behaviour.
So a series of 15 video-frames would mean playing back 32 rows of an IT file.

It could be tuned of course, but some algoritm would be nice.
Title: Video Synchronisation
Post by: bvanoudtshoorn on January 18, 2008, 08:40:37
FLStudio has a VST Video player (http://www.flstudio.com/documents/videoplayback.html) but it's not free. :cry: There's also this offering: http://groc.org/movieplayer/index.html which I'm about to download and try... ;)

EDIT: Couldn't get that last one to work. Dunno why... I tried it straight and in Chainer. All it did is show the first frame of the movie, and give me a little bit of VU-meter action when sound came to it. :(
Title: Video Synchronisation
Post by: älskling on January 18, 2008, 21:32:30
The FL Studio videoplayer is native FL for now, tho they're promising a VSTi version in the future (aka "soon").

Apart from that I just have to say I'm really excited to see one of the greatest trackers ever here at the forums.
Title: Video Synchronisation
Post by: RG (aka AUDIOMONSTER) on January 18, 2008, 23:45:47
Thanks to everybody for your interest in my request ;-)

Indeed, I believe it would be a GREAT feature !

älskling : I agree with you, MPT is one of the greatest trackers of all times, I believe I'll never stop using it !

Best regards from Paris,



Raphaël
Title: Video Synchronisation
Post by: Saga Musix on January 18, 2008, 23:50:16
Quote from: "Raphaël Gesqua"älskling : I agree with you, MPT is one of the greatest trackers of all times, I believe I'll never stop using it !

ahehe, i think he rather meant you and not MPT :lol: (2 those who don't know, Raphaël is also known as "Audiomonster")
Title: Video Synchronisation
Post by: RG (aka AUDIOMONSTER) on January 18, 2008, 23:53:38
lol I'm so embarrased  :oops:


But thanks a lot, then.  It's a great honor and pleasure  :D



Raphaël
Title: Video Synchronisation
Post by: Saga Musix on January 18, 2008, 23:55:55
i actually think it's quite cool that you still stick to a tracker, many ppl who were active in the old days moved on to more "professional" (hah!) stuff... :)
but that goes a bit off-topic...
Title: Video Synchronisation
Post by: RG (aka AUDIOMONSTER) on January 18, 2008, 23:59:06
Well, being "professional" is not a matter of music stuffs and programs, it's just a matter of living from its own music, I think.

But I know certain people who measure talent with richness of the composer's studio  :lol:

Raphaël
Title: Video Synchronisation
Post by: Sam_Zen on January 19, 2008, 01:17:24
Maybe a complex feature like this should start with the ability of MPT to show one bitmap.
Title: Video Synchronisation
Post by: Snu on January 19, 2008, 01:38:48
hmm, does anyone know of a standard timecode sync transmition method? perhaps it would be simple enough to add a feature to mpt that would just transmit a timecode?  if that were done, it would be fairly simple to write a video player that could just recieve that code and play a video stream in one simple codec.

one question tho, does the vst standard have any timecode sync? would a vst only video player even work? or maybe even a vst that could sync an external video player...

also, what about http://groc.org/movieplayer/index.html ?
says its for 'live'? well, whatever, but its vst, so maybe it will work.
Title: Video Synchronisation
Post by: Sam_Zen on January 19, 2008, 05:55:13
Hmm.. : movieplayer needs a quicktime driver.
Title: Video Synchronisation
Post by: RG (aka AUDIOMONSTER) on January 20, 2008, 14:15:01
Indeed, at least, a video synch with external player by VST would be cool, I think. But I don't know if it exists...
Title: Video Synchronisation
Post by: RG (aka AUDIOMONSTER) on March 30, 2008, 14:42:42
Hi,

I installed "Movieplayer" on my PC, and put it into MPT VST plugins.

But how do you proceed to, at least, launch the loaded video with a MPT instruction ?

IS it a "Z" maccro or something ?

Thanks
Title: Video Synchronisation
Post by: RG (aka AUDIOMONSTER) on April 22, 2008, 00:33:53
Anybody ?

Nohing about a simple VST plugin, allowing to synchronize a video with a sequence ?
Title: Video Synchronisation
Post by: bvanoudtshoorn on April 22, 2008, 09:35:26
Sorry - I'm not sure that there really is anything that can do this. I seem to recall that CoolEdit (which is now Adobe Audition, AFAIK) had the capability to have a video stream included. I think the easiest thing (and probably all that you can do!) is to get a video player which has a very precise timer, note down all the important times, and use the "get row play time" function to match 'em up.
Title: Video Synchronisation
Post by: Sam_Zen on April 23, 2008, 01:35:38
Hmm. Cool Edit could be a workaround. Never used the video options. So I experimented with it.
So far it has the video animation, but no sound.
The soundtrack shows some vertical short lines indicating some sync points I suppose.
Title: Video Synchronisation
Post by: pelya on May 12, 2008, 16:20:35
That could be done by running VLC media player and attaching MPT to VLC Telnet interface, I'll try to do that though I don't promise anything.
Edit: I've made another Custom MPT build (http://www.4shared.com/file/47431823/d1b68f22/OpenMPT_SyncWithVideo.html) - both .EXE and sources inside. Install VLC Media Player (http://www.videolan.org/vlc/), and hit "Sync with video" menu option in MPT - the playback is re-synced to the current pattern each time you start playback - you should pause or stop it before. Also featuring half-second delay when playback starts :D though the video should be synced with MPT more or less fine.
Title: Video Synchronisation
Post by: RG (aka AUDIOMONSTER) on May 14, 2008, 00:05:29
Great ! I'll try that, thanks a lot ;-)
Title: Video Synchronisation
Post by: RG (aka AUDIOMONSTER) on May 14, 2008, 00:15:17
Pelya, this is absolutely great ! It works perfectly, I just tryed it with an AVI file.

It crashed with a mpg but no matter, I'll convert my files into AVI, if needed.

This fonction MUST be added to all new MPT versions !


B R A V O and T H A N K S again !


Best regards from Paris...
Title: Video Synchronisation
Post by: Sam_Zen on May 14, 2008, 01:46:10
Looks quite intriguing.. I will check it out.

EDIT: Since this is an investigation, I made a stand-alone dir for this 'sync with video' version of OMPT.
When installing this, it would be quite elegant if the package also contains a 'default.mkb' file.
Title: Video Synchronisation
Post by: pelya on May 15, 2008, 12:05:07
Heh, I love to be praised ;D . Update (http://www.4shared.com/file/47680489/403280ad/OpenMPT_SyncWithVideo_v2.html) - removed halfsecond delay,  video resynced with F6 and F7 keys without stopping it.
Your MPG file crashed VLC player, not MPT - post bugreports to them, though I thought it should be robust.
Title: Video Synchronisation
Post by: RG (aka AUDIOMONSTER) on May 15, 2008, 13:58:50
Absolutely ! Your prog just works great. I'll try the V2 tonight ;-)

Thanks again
Title: Video Synchronisation
Post by: RG (aka AUDIOMONSTER) on May 15, 2008, 22:57:22
Once again: excellent...

If I'd dare suggest something: if by chance there was a possibility to be synchronized wherever we are in the song, with the video (I mean, for instance, if you start row 25 of pattern 12, then the video starts from the right frame)...It would enable to check music/video synchro, without having to restart the whole module play.

Or maybe, if possible, even the possibility to have a synchro point at each first row of each pattern, that would enable to only have to replay a pattern from the beginning, to check synchro, and not the whole song...


Anyway, what has been done here is already very helpful for me, and a great step, I think, for OpenMPT...
Title: Video Synchronisation
Post by: Sam_Zen on May 15, 2008, 23:39:34
Quote...the possibility to have a synchro point at each first row of each pattern
Maybe the routines that Rewbs added to OMPT to use the "change at transition" function could be of help here.
This function not only works within a pattern, but also in the pattern-row. Where a jump for- or backwards can be made.
Title: Video Synchronisation
Post by: pelya on May 16, 2008, 11:24:09
Quote from: "Raphaël Gesqua"Once again: excellent...
If I'd dare suggest something: if by chance there was a possibility to be synchronized wherever we are in the song, with the video (I mean, for instance, if you start row 25 of pattern 12, then the video starts from the right frame)...It would enable to check music/video synchro, without having to restart the whole module play.

It is already done in v2 - stop playback, put cursor on correct row and start playing using F7 key - it should seek video to correct pos. To get stale video frame you may quickly hit F7 and F8.

Though I've found one bug in VLC - if you seek to the pos two second away from current pos it may randomly jump two seconds ahead. You should just wait until it plays for two seconds and re-sync again - it will jump to correct pos.
The possible solution to fix it is to seek each time to current pos + 2 secs, and seek to correct pos right after, but that will slow the things down, 'cause VLC needs halfsecond to react on the next command. Let's be lazy and post bugreport to VLC team instead :) .

Quote from: "Raphaël Gesqua"
Or maybe, if possible, even the possibility to have a synchro point at each first row of each pattern, that would enable to only have to replay a pattern from the beginning, to check synchro, and not the whole song...

I've tried in a such way and it wasn't good - the smooth video playback suddenly jumps back and forward because of that seeking bug in VLC. Even without it, the video gets little sloppy.

For now, you may hit F6 key even without stopping playback - video will be re-synced to the pattern beginning - but wait for two seconds before hitting F6 key again :) .

I've thought about re-syncing video each time you move cursor in MPT, but that will slow the things down considerably - MPT should seek video in VLC, play for halfsecond so it will update the screen, and pause it again.
Title: Video Synchronisation
Post by: bvanoudtshoorn on May 16, 2008, 11:45:29
Can I suggest putting a "Sync video to row" button or menu option in? That'd be a bit more elegant than the F6/F7 combo you suggest... :)
Title: Video Synchronisation
Post by: RG (aka AUDIOMONSTER) on July 14, 2008, 23:42:38
Hi again, Pelya


I'm not so sure if it comes from your program or from the VLC player, but I noticed something a little boring: when you launch a song synchronized with a video file, it starts well each time you press "Play song" BUT if you let the video file reach its end, then it can't be restarted anymore from MPT. And I have to resynchronize MPT with the video file again and again...

At least, it's what's happening on my newly bought computer, with Vista (I was on XP before)

Can you confirm that ? Or is it my system ?

Thanks again ;-)
Title: Re: Video Synchronisation
Post by: Saga Musix on November 03, 2014, 17:09:39
Closed as there are alternatives like mediavst (http://forums.jeskola.net/viewtopic.php?f=3&t=7) these days.