Editing video on Windows 7, Overlay

Goal: Q4 video(drum cover) + Q3HD video(kick only) in small window with stereo audio track recorded with R24. Video quality is just enough for YouTube.

Result: Uploaded file, YouTube Link


Input Files:
Song: 2014 Feb. Drumeo Edge collaboration

  main video -- Q4 Video file    XXXX.MOV 1080p/30fps
                   Line Input audio(mixed sound): PCM 24bit/48kHz
  sub video -- Q3HD Video file(kick only)    XXXX.MOV 1080p/30fps
                   Built-in mic input audio(drum sound): PCM 24bit/48kHz

  audio track -- Stereo mix with ZOOM R16 + R24, PCM 24bit/44.1kHz
     (10sec before count-in)

     Recording (total 8 mics input to R16):
      R16
        Pair condencer mics (overhead) --> compressor, eq(low cut)
        Kick, 3 toms, snare top, snare bottom
            ---> gate, compressor, eq(low cut)
        Reverb applied
        No mastering effect(3 band compressor) applied this time. 

      R24: Play-along stereo track + analog drum mix input from R16
        ==> stereo mix

Things to consider:
  Video/Audio sync and trimming of three equipments.
   -- 2 video camera and audio recorder (There may be some clock drift)
  Video overlay (Kick pedal video at bottom right) with an opensource tool.

0. Software

  1. WLMM(Windows Live Movie Maker) on Windows 7 -- sync. and trimming
  2. ffmpeg (command line tool on Windows or Linux) -- overlay
  3. MP4Box (optional) -- final trimming without loss of quality

1. Processing Flow

  1. normalize audio track
        ffmpeg -i input.wav -af volumedetect -f null - 
          (max_volume: -2.2dB)
    
        ffmpeg -i input.wav -af volume=2.2 master.wav
          (max 0dBFS)
    
  2. Measure time shift and trim with WLMM (Windows Live Movie Maker)
       Import MainVideo.MOV and master.wav
    
       Video is about 106.40 sec ahead (manually enter exact seconds)
       Fortunately, stretch/shrink audio is not necessary for this short period
       of time.
    
       Output file: Main-MLMM.mp4 (W 1920 x H 1080)
    
  3. Same for SubVideo.MOV and master.wav save in small size
       Video is about 118.64 sec ahead (manually enter exact seconds)
       Fortunately, stretch/shrink audio is not necessary for this short period
       of time.
    
       Make custom setting at W 640 x H 360  (1/3 size)
       *mute audio* and save. (Quick for small size video)
    
    Main: W 1920 x H 1080
    Sub:  W 1920/n x W 1080/n (n=3 or 4) at the bottom right
            640 x 360  (n=3) 
            480 x 270  (n=4)
    
       Output file: Sub-MLMM.mp4 (video only)
    
  4. Video overlay with ffmpeg http://www.ffmpeg.org/ffmpeg-filters.html#overlay-1
    Use double quote on Windows command prompt (single quote does not work)
    
    ffmpeg -i Main-WLMM.mp4 -i Sub-WLMM.mp4 
    	-filter_complex "overlay=shortest=1:x=W-w:y=H-h"
    	-acodec copy -crf 20 Output.mp4
    (type in one line. -crf is the quality. lower is better)
    (there should be the way to remove audio Sub-WLMM.mp4)
    
  5. Final trimming with MP4box(no quality loss), WLMM or editting on YouTube after uploading
    Measure time in WLMM (begin 9 sec, end 145 sec) 
     mp4box -splitx 9:145 Output.mp4 -out 8thNoteRock-DrumeoEdge201402Collab.mp4
    
  6. Upload to YouTube
    Uploaded File(ffmpeg -i inputfile)
    
      Duration: 00:02:16.70, start: 0.000000, bitrate: 5441 kb/s
      Stream #0.0(und): Video: h264, yuv420p, 1920x1080, 29.97 tbr, 29.97 tbn, 59.94 tbc
      Stream #0.1(und): Audio: aac, 48000 Hz, stereo, s16
    
      File size: 88.7 MiB (88.7*1024*1024 bytes)
    
    Downloaded File Duration: 00:02:16.71, start: 0.000000, bitrate: 2393 kb/s ********* Stream #0.0(und): Video: h264, yuv420p, 1280x720, 29.97 tbr, 29.97 tbn, 59.94 tbc Stream #0.1(und): Audio: aac, 44100 Hz, stereo, s16 ******** File size: less than 40 MiB