added notes
This commit is contained in:
expertmm
parent
5932611e99
commit
5ef5398ed7
141
README.md
141
README.md
@ -18,6 +18,7 @@ Possibly, rotoscoping applications are not considered commercially viable since
|
||||
* audit & test getLayerImagePathMostRecent
|
||||
|
||||
## Planned Features
|
||||
(!=important, ~=low-priority)
|
||||
* add markers to media OR timeline, separately (media markers are also on timeline behave differently: ghosted until media is selected, has filmstrip icon if from a clip; reversed if video is reversed, changed placement if speed is changed, etc)
|
||||
* use alpha.png for reducing opacity of parts of background layer
|
||||
* allow blocker layer type (make an animated object that seems to "undo" previous edits, such as to reveal parts of characters under the effect, without permanently erasing any part of the effect)
|
||||
@ -27,13 +28,48 @@ Possibly, rotoscoping applications are not considered commercially viable since
|
||||
Shift Alt Scrollwheel: brush hardness
|
||||
Shift Scrollwheel: brush size
|
||||
* Add exception handling in appropriate situations:
|
||||
```
|
||||
catch(std::exception& e) {
|
||||
qCritical() << "Exception thrown:" << e.what();
|
||||
}
|
||||
|
||||
```
|
||||
* Change Speed (optional frame blending to create "in-between" frames for slow, merged frames for fast!)
|
||||
* (~) Load VirtualDub plugins, possibly as cscript using their sourcecode
|
||||
* (~) Detect Light Sabers
|
||||
* auto masking behind objects
|
||||
* auto sound generation!
|
||||
* auto strike/collide generation
|
||||
* volume based on speed
|
||||
* hits with volume based on speed
|
||||
* different saber to saber & saber to target sound
|
||||
* as long as they're touching (fades into low electrical sound after initial hit)
|
||||
* allow manually adding saber-to-target hits
|
||||
* Set in-out points for saber
|
||||
* generate in-out sounds
|
||||
* (~) use G'MIC library for image processing (so GIMP plugins can be used).
|
||||
* example: Flowblade uses G'MIC, so does EKD (see http://gmic.eu/)
|
||||
* use GIMP HQRESIZE plugin (esp for resizing letterbox movies to 16:9 anamorphic, esp DVD low-res mode mpegs created by Panasonic DVDR EP mode)
|
||||
* (~) Manipulate flv directly to avoid recompression (example: Try to rerender and combine zelda fan film from youtube, using curves from Sony Vegas [see vf project file])
|
||||
* (~) Have an expandable palette of sound effects, and a depth settings (negative for behind camera), then allow clicking to add 3D placement of sound
|
||||
* also allow animation
|
||||
* eventually create Blender export of speaker objects
|
||||
* allow optional facing direction (default is track viewer [always face camera])
|
||||
* (~) Seam Carving resize (possibly via an existing G'MIC plugin)
|
||||
example: SeaMonster - Content-aware resizing FOSS (Seam Carving) http://blogs.msdn.com/b/mswanson/archive/2007/10/23/seamonster-a-net-based-seam-carving-implementation.aspx
|
||||
* (~) PAL-NTSC conversion (universal size/framerate converter) idea
|
||||
(or make VirtualDub plugin for this that writes output manually)
|
||||
* Make it universal: from any size/framerate to any size/framerate
|
||||
* Blend frames retroactively once there is enough data per frame (or do multiple at once if there is more data, if destination frame rate is higher than source)
|
||||
* Scale video as needed (is VirtualDub native scaling accessible via SDK??)
|
||||
* dump the frames into ffmpeg successively
|
||||
* test it with a PAL movie
|
||||
|
||||
## Low-priority Known Issues
|
||||
* drawLineTo (this is used for painting) should draw line instead of last point
|
||||
|
||||
## Design Directives
|
||||
* Completely customizable but good defaults for example there are three built-in views and can show any 2d or 1d parameter can be shown in any you at any time. For example you can make a difference node, and show the grey scale difference mask in any view. When you hover the mouse over a view, it shows the favorite inputs. When a node is created that has 1D or 2D output, favorite is automatically created. You can have infinite number of input or result nodes.
|
||||
* Have "Save Project" and "Save Movie". If you exit without saving movie since modifying project, it gives a warning. If you save a project, the dialog says how big of a flash drive you need (& lists which drives will work) by checkbox for "Include source files (required for using file on another computer, and also if files were opened directly from device such as camera or removable data storage)"
|
||||
|
||||
## Developer Notes
|
||||
* The RotoCanvas class is modular, with hopes that it can be used by various video editing applications in the future. The recommended use of RotoCanvas in a video editing application is for applying effects (primarily manual rotoscoping) to source videos (as frame sequences) as a preprocessing step before they are trimmed or other effects are added, since rotoscoping is highly dependent on the source frame (base layer) remaining the same. Using the RotoCanvas as a post-processing effect is possible, but accurate frame seeking must be assured somehow (such as by a frame-accurate video editing engine), and further edits to the previous layers will in some cases cause the rotoscoped parts (parts of the image edited by RotoCanvas) to no longer make sense (such as, if a lens pinch effect is added to a scene where there was a layer order error that has been rotoscoped out, instead of the error being rotoscoped out, there will be both the error and a corrected blotch that is the error's original position & shape), which in such cases would require redoing the rotoscoping.
|
||||
@ -55,9 +91,110 @@ Folder and file structure is as follows, where `<sequenceName>` is sequence name
|
||||
<layerNumber>.png
|
||||
<layerNumber>.yml [not yet implemented]
|
||||
```
|
||||
|
||||
* an older considered method:
|
||||
Storage Format
|
||||
*.rotocanvas folder with L folder under it (Layers folder) where * is base name of sequence (excluding sequential numbering)
|
||||
folder for each keyframe containing layer files (whether hand-painted movement frame or actual interpolated keyframe)
|
||||
Each layer has a png file and a yml file
|
||||
YML file specifies:
|
||||
paint_type: # can be:
|
||||
mask (use alpha as final alpha, and ignore colors)
|
||||
reveal (any transparent areas reveal background--provides a maximum alpha to all previous layers)
|
||||
plain (just paint--use normal alpha overlay)
|
||||
motion_type: # can be:
|
||||
static (non-interpolated keyframe aka paint)
|
||||
interpolated (position[and rotation & scale eventually] interpolated until next)
|
||||
interpolation_type: # can be:
|
||||
linear
|
||||
|
||||
## Credits
|
||||
* created by expertmm (see also LICENSE)
|
||||
* special thanks to the Qt team for ScribbleArea from Qt Examples
|
||||
|
||||
*DISCLAIMER: This software comes without warranty or guarantees of any kind. Use this software at your own risk.
|
||||
|
||||
## Notes on Other Programs
|
||||
* in some programs, ss;ff denotes drop frame, and ss:ff denotes NON-drop frame
|
||||
* mplayer is included in megui in the mencoder folder
|
||||
* Change aspect ratio flag:
|
||||
Use DVD Patcher, then test the result by dropping into Sony DVD Architect Studio to and playing (will play at specified aspect ratio)
|
||||
|
||||
### ffmpeg notes
|
||||
* Combine videos (this is a one-line command, however, text file works better for some reason--see <http://www.github.com/expertmm/IntroCompatiblizer>)
|
||||
"E:\Program Files\WinFF\ffmpeg.exe" -i "concat:Logo4 Animation A 1a0001-0100.avi|Logo4 Animation A 1a101-142.avi" -c copy "Logo4 Animation A 1a combined.avi"
|
||||
* even with text file, name may need to be changed automatically first to prevent ffmpeg syntax error
|
||||
* h.264 avi to mp3 container for Sony software
|
||||
"C:\Program Files (x86)\WinFF\ffmpeg.exe" -i "Logo4 Animation A 1b.avi" -acodec libfaac -b:a 128k -vcodec mpeg4 -b:v 1200k -flags +aic+mv4 "Logo4 Animation A 1b.mp4"
|
||||
* losslessly split
|
||||
E:\Progs\Video\gui4ffmpeg\ffmpeg -vcodec copy -acodec copy -ss 00:00:00 -t 00:01:00 -i in.mp4 out.mp4
|
||||
* where time after ss is start as hh:mm:ss, & time after t is duration as hh:mm:ss.
|
||||
* losslessly change container e.g. from FLV to MP4:
|
||||
E:\Progs\Video\gui4ffmpeg\ffmpeg -i VideoFile.flv -vcodec copy -acodec copy VideoFile.mp4
|
||||
* allows Premiere Elements to load it (tested where flv was AVC video with AAC audio)
|
||||
* convert video to image sequence:
|
||||
E:\Progs\Video\gui4ffmpeg\ffmpeg -i VideoFile.m2v Forensics1a%d.png
|
||||
* convert image sequence to video:
|
||||
* Tried with image sequence in folder: D:\Videos\Projects\Rebel Assault IX\RAIX2b\Scene07 (Lightsaber Duel)\forcegrab\2b4 (2013 3D Hilt flying away and back added)\
|
||||
* E:\Progs\Video\gui4ffmpeg\ffmpeg -r 29.97 -i RAIX2b4-scene-lightsaberduel-shot-forcegrab%04d.png -sameq -r 29.97 output.mp4
|
||||
* #-r forces frame rate to same so no frames are skipped (default is 25 fps, so, for example, converting to 24fps results in 1 lost per second)
|
||||
* [failed]E:\Progs\Video\gui4ffmpeg\ffmpeg -f image2 -i RAIX2b4-scene-lightsaberduel-shot-forcegrab%04d.png VideoFile.mpg
|
||||
#NOTE: only failed since "truncated or corrupted" input error occurred, due to using %d when %04d was required (for 4-digit 0-padded frame numbering)
|
||||
[failed]E:\Progs\Video\gui4ffmpeg\ffmpeg -f png -i RAIX2b4-scene-lightsaberduel-shot-forcegrab%04d.png input -acodec aac -ab 128kb -vcodec mpeg4 -b 1200kb -mbd 2 -flags +4mv+trell -aic 2 -cmp 2 -subcmp 2 -title X final_video.mp4
|
||||
#NOTE: only failed since "truncated or corrupted" input error occurred, due to using %d when %04d was required (for 4-digit 0-padded frame numbering)
|
||||
or for iPod:
|
||||
[failed]E:\Progs\Video\gui4ffmpeg\ffmpeg -f image2 -i RAIX2b4-scene-lightsaberduel-shot-forcegrab%04d.png input -acodec aac -ab 128kb -vcodec mpeg4 -b 1200kb -mbd 2 -flags +4mv+trell -aic 2 -cmp 2 -subcmp 2 -s 320x180 -title X output-ipod.mp4
|
||||
#for older ffmpeg only
|
||||
[failed]E:\Progs\Video\gui4ffmpeg\ffmpeg -r 29.97 -f image2 -i RAIX2b4-scene-lightsaberduel-shot-forcegrab%04d.png -r 29.97 -acodec aac -ab 128k -vcodec mpeg4 -b 1200k -mbd 2 -flags +mv4+aic -trellis 1 -cmp 2 -subcmp 2 -s 320x180 -metadata title=X output-ipod.mp4
|
||||
#didn't accept metadata option
|
||||
E:\Progs\Video\gui4ffmpeg\ffmpeg -r 29.97 -f image2 -i RAIX2b4-scene-lightsaberduel-shot-forcegrab%04d.png -r 29.97 -acodec aac -ab 128k -vcodec mpeg4 -b 1200k -mbd 2 -flags +mv4+aic -trellis 1 -cmp 2 -subcmp 2 -s 320x180 -metadata title=X output-ipod.mp4
|
||||
or for YouTube:
|
||||
[failed]E:\Progs\Video\gui4ffmpeg\ffmpeg -r 30 -i RAIX2b4-scene-lightsaberduel-shot-forcegrab%04d.png -s:v 1280x720 -c:v libx264 -profile:v high -crf 23 -pix_fmt yuv420p -r 30 output-YouTube.mp4
|
||||
* convert to m2ts (from IntegratorEduImport):
|
||||
(see also "Selecting codecs and container formats." mplayer.hu. <http://www.mplayerhq.hu/DOCS/HTML/en/menc-feat-selecting-codec.html>. Oct 11, 2012.)
|
||||
REM Convert to m2ts (tried using mencoder):
|
||||
REM mencoder -of help doesn't list mts, only mpeg (MPEG-1&MPEG-2 PS according to mplayerhq.hu
|
||||
), xvid (MPEG-4 ASP), and x264 (MPEG-4 AVC)
|
||||
REM lavf means that you then specify a libavformat container -- still only has mpg (MPEG-1&MPEG-2 PS according to mplayerhq.hu
|
||||
) & mp4
|
||||
REM mencoder was originally only meant for AVI so resulting file should be tested, according to mplayerhq.hu
|
||||
REM C:\Users\Jakeg7505\Documents\Projects\IntegratorEduImport\bin\MPlayer\mencoder.exe E:\Backup-school\00394.mts -vf scale=1280:720 -oac copy -fps 60 -ofps 30 -o c:\Users\Jakeg7505\Documents\1080-to-720-00394.m2ts
|
||||
REM C:\Users\Jakeg7505\Documents\Projects\IntegratorEduImport\bin\MPlayer\mencoder.exe E:\Backup-school\00394.mts -s hd720 -oac copy -fps 60 -ofps 30 -o c:\Users\Jakeg7505\Documents\1080-to-720-00394.m2ts
|
||||
* ffmpeg convert h.264 avi to mp4 container for sony
|
||||
"E:\Program Files\WinFF\ffmpeg.exe" -i "Logo4 Animation A 1b.avi" -acodec libfaac -b:a 128k -vcodec mpeg4 -b:v 1200k -flags +aic+mv4 "Logo4 Animation A 1b.mp4"
|
||||
|
||||
* Convert to m2ts (using ffmpeg):
|
||||
|
||||
* -y overwrite output files without asking
|
||||
* -loglevel 1 is OK too
|
||||
* -r doesn't seem to work before input (for forcing framerate)
|
||||
* -qscale is deprecated -- says to use -q:v (quantize video) or -q:a (quantize audio) instead
|
||||
* -async <samples per second> to resync audio is deprecated, use asyncts instead
|
||||
|
||||
* "C:\Program Files (x86)\WinFF\ffmpeg.exe" -y -r 60 -i "00394.mts" -r 30 -aspect 16:9 -qscale 4 -vcodec mpeg2video -acodec copy -f mpegts "c:\Users\Jakeg7505\Documents\1080-to-720-00394.m2ts"
|
||||
|
||||
* "C:\Program Files (x86)\WinFF\ffmpeg.exe" -y -i "00394.mts" -r 30 -s 1280x720 -qscale 4 -vcodec mpeg2video -acodec copy -f mpegts "c:\Users\Jakeg7505\Documents\1080-to-720-00394.m2ts"
|
||||
|
||||
|
||||
* "C:\Program Files (x86)\WinFF\ffmpeg.exe" -y -i "00394.mts" -r 30 -s 1280x720 -q:v 4 -vcodec mpeg2video -acodec copy -f mpegts "c:\Users\Jakeg7505\Documents\1080-to-720-00394.m2ts"
|
||||
|
||||
|
||||
* dump sound losslessly:
|
||||
PART OF SOUND e.g. 1st minute E:\Progs\Video\gui4ffmpeg\ffmpeg -vcodec copy -acodec copy -s 00:00:00 -t 00:01:00 -i in.flv intro-only1a_480p.flv
|
||||
If multiple audio streams or audio not detected, first get Audio ID: ffmpeg -i "$filename"
|
||||
E:\Progs\Video\gui4ffmpeg\ffmpeg -i "$vidbasename.mp4" -vn -f wav "$vidbasename-audio.wav"
|
||||
E:\Progs\Video\gui4ffmpeg\ffmpeg -i "$vidbasename.mp4" -vn -acodec copy "$vidbasename-audio.m4a"
|
||||
E:\Progs\Video\gui4ffmpeg\ffmpeg -i "$vidbasename.flv" -vn -acodec copy "$vidbasename-audio.mp3"
|
||||
- where .mp3 a compatible container e.g.:
|
||||
ffmpeg -i "$vidbasename.ogg" -acodec copy "$vidbasename.mkv"
|
||||
some people do:
|
||||
E:\Progs\Video\gui4ffmpeg\ffmpeg -i video.mpg -acodec copy audio.ac3
|
||||
E:\Progs\Video\megui\tools\mencoder\mplayer x.mpg -dumpaudio -dumpfile sound.ac3
|
||||
E:\Progs\Video\megui\tools\mencoder\mplayer source_file.vob -aid 129 -dumpaudio -dumpfile sound.ac3
|
||||
- where 129 is the audio id
|
||||
* extract and recompress incompatible ac3 or other audio stream (allow burning video+audio with Sony DVD Architect; works with wave file input too):
|
||||
E:\Progs\Video\gui4ffmpeg\ffmpeg -i video.mpg -ab 224k -ar 48000 -ac 2 -acodec ac3 video.ac3
|
||||
* extract and compress sound:
|
||||
E:\Progs\Video\gui4ffmpeg\ffmpeg -i "$vidbasename.mp4" -vn -ar 44100 -ac 2 -ab 192 -f mp3 "$vidbasename-audio.mp3"
|
||||
|
||||
* Manipulate video:
|
||||
* Split file i.e. ffmpeg -vcodec copy -ss 00:01:00 -t 00:03:00 -i infile.mpg outfile.mpg
|
||||
|
||||
Loading…
x
Reference in New Issue
Block a user