FFmpeg‘s setpts video filter

The command ffmpeg -vf "setpts=PTS-STARTPTS" leverages FFmpeg's setpts video filter to manipulate the Presentation Time Stamps (PTS) of video frames. This is a fundamental operation in video processing that can help reset timestamps, adjust playback speed, synchronize audio and video, and more.

Breakdown of the Command

• ffmpeg: The powerful command-line tool used for processing video and audio files.

• -vf "setpts=PTS-STARTPTS" : Applies a video filter (-vf) using the setpts filter with the expression PTS-STARTPTS.

  • setpts : Stands for Set Presentation Time Stamps, a filter that modifies the PTS of each frame based on a specified expression.

  • PTS: The current presentation timestamp of each frame.

  • STARTPTS: The PTS of the first frame in the stream.

  • PTS-STARTPTS : This expression recalculates each frame's PTS by subtracting the PTS of the first frame (STARTPTS). The result is that the first frame starts at 0, effectively resetting the timing of the video.

Common Use Cases

1. Resetting Timestamps:

   • Scenario: After editing or processing, a video might have residual delays or irregular timestamps.

   • Solution: Reset the PTS to start from zero.

   • Command :

     ffmpeg -i input.mp4 -vf "setpts=PTS-STARTPTS" output.mp4

2. Adjusting Playback Speed:

   • Doubling the Speed :

     • Command :

       ffmpeg -i input.mp4 -vf "setpts=0.5*PTS" output_fast.mp4

   • Halving the Speed :

     • Command :

       ffmpeg -i input.mp4 -vf "setpts=2.0*PTS" output_slow.mp4

3. Synchronizing Audio and Video:

   • Scenario: Audio and video streams are out of sync due to processing delays.

   • Solution: Adjust the video timestamps to align with the audio.

   • Command :

     ffmpeg -i input.mp4 -vf "setpts=PTS-STARTPTS" -af "asetpts=PTS-STARTPTS" output_synced.mp4

     (Note: The -af "asetpts=PTS-STARTPTS" adjusts audio timestamps similarly.)

4. Preparing for Concatenation:

   • Scenario: Merging multiple video clips that have different starting timestamps.

   • Solution: Normalize all clips' timestamps before concatenation.

   • Commands :

     ffmpeg -i clip1.mp4 -vf "setpts=PTS-STARTPTS" clip1_normalized.mp4
     ffmpeg -i clip2.mp4 -vf "setpts=PTS-STARTPTS" clip2_normalized.mp4
     ffmpeg -f concat -safe 0 -i list.txt -c copy output_combined.mp4

     (Where list.txt contains paths to clip1_normalized.mp4 and clip2_normalized.mp4.)

Advanced Usage and Considerations

1. Combining with Other Filters:

   • Example : Reset timestamps and scale the video.

     ffmpeg -i input.mp4 -vf "setpts=PTS-STARTPTS, scale=1280:720" output_scaled.mp4

2. Understanding Filter Order:

   • The sequence of filters matters. Ensure that setpts is positioned appropriately within the filter chain to achieve the desired effect.

3. Handling Multiple Streams:

   • If dealing with multiple video streams, apply setpts to each stream as needed.

4. Using filter_complex for Complex Scenarios:

   • For intricate operations involving multiple filters and streams, utilize -filter_complex.

     ffmpeg -i input.mp4 -filter_complex "[0:v]setpts=PTS-STARTPTS[v]" -map "[v]" output.mp4

Practical Example

Scenario: You have a video recorded with an offset start, resulting in an initial delay. You want to remove this delay by resetting the timestamps so that the video starts immediately.

Command:

ffmpeg -i delayed_start.mp4 -vf "setpts=PTS-STARTPTS" corrected_start.mp4

Explanation : This command takes delayed_start.mp4, resets the video timestamps to start from zero, and outputs the corrected video as corrected_start.mp4.

Additional Tips

• Preserving Audio Timing : When modifying video timestamps, ensure that audio streams remain in sync. You might need to adjust audio timestamps similarly using the asetpts filter.

  ffmpeg -i input.mp4 -vf "setpts=PTS-STARTPTS" -af "asetpts=PTS-STARTPTS" output_synced.mp4

• Complex Expressions : The setpts filter supports complex mathematical expressions for advanced timing adjustments.

  • Example : Slow down the video to 75% of its original speed.

    ffmpeg -i input.mp4 -vf "setpts=1.333333*PTS" output_slow.mp4

    (Since 1 / 0.75 ≈ 1.333333)

• Exploring Documentation : For a deeper understanding and more advanced use cases, refer to the FFmpeg setpts Filter Documentation.

Conclusion

The setpts filter in FFmpeg is a versatile tool for manipulating video timestamps. Whether you need to reset timestamps, adjust playback speed, synchronize streams, or prepare videos for concatenation, understanding and utilizing setpts=PTS-STARTPTS can significantly enhance your video processing workflows.

If you have specific scenarios or need further assistance with FFmpeg commands, feel free to provide more details!