Recherche avancée

Sur d’autres sites (1676)

• Synchronizing RTSP signals with FFMPEG

  3 décembre 2019, par Taits

  I have achieved to merge two RTSP signals in one with FFMPEG but in the resulting stream, the first input has a delay of between 2 and 5 seconds with respect to the second. And it is always the first input that is delayed compared to the second.

  The two RTSP signals come from the same camera model, same configuration, same room ...

  However, if I put the same RTSP signal (either of the two) as input 1 and input 2, the same thing happens. Despite being the same signal, the first input is delayed compared to the second one.

  How could I get them synchronized ?

  This is the command that I execute :

  ffmpeg -rtsp_transport tcp -thread_queue_size 512 -rtbufsize 50M -r 15 
  
  -i rtsp://XXXX -rtsp_transport tcp -thread_queue_size 512 -rtbufsize 50M -r 15 
  
  -c:a aac -i rtsp://YYYY -filter_complex "[0:v]pad=iw*2:ih,setpts=PTS-STARTPTS[bg]; 
  
  [1:v]setpts=PTS-STARTPTS[fg]; [bg][fg]overlay=w[out]" -map "[out]" -f hls 
  
  -hls_time 2 -hls_list_size 5 -use_localtime 1 -use_localtime_mkdir 1 
  
  -hls_segment_filename 'LIVE/file-%s.ts' -map a -ar 16000 -ac 1 -ab 64000 -c:a aac 
  
  -y output.m3u8

  Here you have the process informationn :

  ffmpeg version 3.4.2 Copyright (c) 2000-2018 the FFmpeg developers 
  
  built with Apple LLVM version 9.0.0 (clang-900.0.39.2) 
  
  configuration: --prefix=/usr/local/Cellar/ffmpeg/3.4.2 --enable-shared --enable-pthreads --enable-version3 --enable-hardcoded-tables --enable-avresample --cc=clang --host-cflags= --host-ldflags= --disable-jack --enable-gpl --enable-libmp3lame --enable-libx264 --enable-libxvid --enable-opencl --enable-videotoolbox --disable-lzma
  
    libavutil      55. 78.100 / 55. 78.100
  
    libavcodec     57.107.100 / 57.107.100
  
    libavformat    57. 83.100 / 57. 83.100
  
    libavdevice    57. 10.100 / 57. 10.100
  
    libavfilter     6.107.100 /  6.107.100
  
    libavresample   3.  7.  0 /  3.  7.  0
  
    libswscale      4.  8.100 /  4.  8.100
  
    libswresample   2.  9.100 /  2.  9.100
  
    libpostproc    54.  7.100 / 54.  7.100
  
  [rtsp @ 0x7fe284000e00] Missing PPS in sprop-parameter-sets, ignoring
  
  Input #0, rtsp, from 'rtsp://XXXX':
  
    Metadata:
  
      title           : Media Presentation
  
    Duration: N/A, start: 0.000000, bitrate: N/A
  
      Stream #0:0: Video: h264 (Main), yuv420p(progressive), 1280x720, 15 fps, 15 tbr, 90k tbn, 30 tbc
  
      Stream #0:1: Audio: aac (LC), 16000 Hz, mono, fltp
  
  [rtsp @ 0x7fe28484de00] Missing PPS in sprop-parameter-sets, ignoring
  
  Input #1, rtsp, from 'rtsp://XXXX':
  
    Metadata:
  
      title           : Media Presentation
  
    Duration: N/A, start: 0.000000, bitrate: N/A
  
      Stream #1:0: Video: h264 (Main), yuv420p(progressive), 1280x720, 15 fps, 15 tbr, 90k tbn, 30 tbc
  
      Stream #1:1: Audio: aac (LC), 16000 Hz, mono, fltp
  
  Stream mapping:
  
    Stream #0:0 (h264) -> pad (graph 0)
  
    Stream #1:0 (h264) -> setpts (graph 0)
  
    overlay (graph 0) -> Stream #0:0 (libx264)
  
    Stream #0:1 -> #0:1 (aac (native) -> aac (native))
  
  Press [q] to stop, [?] for help
  
  [libx264 @ 0x7fe286802000] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2
  
  [libx264 @ 0x7fe286802000] profile High, level 4.0
  
  [libx264 @ 0x7fe286802000] 264 - core 152 r2854 e9a5903 - H.264/MPEG-4 AVC codec - Copyleft 2003-2017 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=12 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=1 weightp=2 keyint=250 keyint_min=15 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
  
  [hls @ 0x7fe286800000] Opening 'LIVE/file-1524728763.ts' for writing
  
  Output #0, hls, to 'output.m3u8':
  
    Metadata:
  
      title           : Media Presentation
  
      encoder         : Lavf57.83.100
  
      Stream #0:0: Video: h264 (libx264), yuv420p, 2560x720, q=-1--1, 15 fps, 90k tbn, 15 tbc (default)
  
      Metadata:
  
        encoder         : Lavc57.107.100 libx264
  
      Side data:
  
        cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: -1
  
      Stream #0:1: Audio: aac (LC), 16000 Hz, mono, fltp, 64 kb/s
  
      Metadata:
  
        encoder         : Lavc57.107.100 aac
  
  [hls @ 0x7fe286800000] Opening 'LIVE/file-1524728782.ts' for writinged=1.09x    
  
  [hls @ 0x7fe286800000] Opening 'output.m3u8.tmp' for writing
  
  [hls @ 0x7fe286800000] Opening 'output.m3u8.tmp' for writing=N/A speed=1.07x    
  
  frame=  396 fps= 15 q=-1.0 Lsize=N/A time=00:00:27.00 bitrate=N/A speed=1.05x    
  
  video:2946kB audio:147kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown

• Ffmpeg video length is not as expected

  29 juin 2016, par Karnivaurus

  I have a folder containing 500 images, of that format image0.png, image1.png, ..., image499.png. I want to use ffmpeg to convert these images to a video with a frame rate of 50. This should meant that the total video duration is 10 seconds (= 500 / 50).

  To do this, I used the following command :

  ffmpeg -r 50 -f image2 -i image%1d.png -vcodec libx264 -crf 15 -pix_fmt yuv420p video.mp4

  However, the video which was created, had a duration of 2.5 seconds. Otherwise, the video displays the images correctly, and runs from the beginning to the end as expected.

  Why is the video length not as I would have expected ?

  ---

  The full output from the console is :

  ffmpeg version 2.7.6-0ubuntu0.15.10.1 Copyright (c) 2000-2016 the FFmpeg developers
  
    built with gcc 5.2.1 (Ubuntu 5.2.1-22ubuntu2) 20151010
  
    configuration: --prefix=/usr --extra-version=0ubuntu0.15.10.1 --build-suffix=-ffmpeg --toolchain=hardened --libdir=/usr/lib/x86_64-linux-gnu --incdir=/usr/include/x86_64-linux-gnu --enable-gpl --enable-shared --disable-stripping --enable-avresample --enable-avisynth --enable-frei0r --enable-gnutls --enable-ladspa --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libcdio --enable-libflite --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-libgme --enable-libgsm --enable-libmodplug --enable-libmp3lame --enable-libopenjpeg --enable-openal --enable-libopus --enable-libpulse --enable-librtmp --enable-libschroedinger --enable-libshine --enable-libspeex --enable-libtheora --enable-libtwolame --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libxvid --enable-libzvbi --enable-opengl --enable-x11grab --enable-libdc1394 --enable-libiec61883 --enable-libzmq --enable-libssh --enable-libsoxr --enable-libx264 --enable-libopencv --enable-libx265
  
    libavutil      54. 27.100 / 54. 27.100
  
    libavcodec     56. 41.100 / 56. 41.100
  
    libavformat    56. 36.100 / 56. 36.100
  
    libavdevice    56.  4.100 / 56.  4.100
  
    libavfilter     5. 16.101 /  5. 16.101
  
    libavresample   2.  1.  0 /  2.  1.  0
  
    libswscale      3.  1.101 /  3.  1.101
  
    libswresample   1.  2.100 /  1.  2.100
  
    libpostproc    53.  3.100 / 53.  3.100
  
  Input #0, image2, from 'image%1d.png':
  
    Duration: 00:00:10.00, start: 0.000000, bitrate: N/A
  
      Stream #0:0: Video: png, rgb24(pc), 1600x600, 50 fps, 50 tbr, 50 tbn, 50 tbc
  
  [libx264 @ 0x122c6c0] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 AVX2 LZCNT BMI2
  
  [libx264 @ 0x122c6c0] profile High, level 3.2
  
  [libx264 @ 0x122c6c0] 264 - core 146 r2555 0c21480 - H.264/MPEG-4 AVC codec - Copyleft 2003-2015 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=12 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=15.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
  
  Output #0, mp4, to 'video.mp4':
  
    Metadata:
  
      encoder         : Lavf56.36.100
  
      Stream #0:0: Video: h264 (libx264) ([33][0][0][0] / 0x0021), yuv420p, 1600x600, q=-1--1, 50 fps, 12800 tbn, 50 tbc
  
      Metadata:
  
        encoder         : Lavc56.41.100 libx264
  
  Stream mapping:
  
    Stream #0:0 -> #0:0 (png (native) -> h264 (libx264))
  
  Press [q] to stop, [?] for help
  
  frame=   84 fps=0.0 q=23.0 size=      61kB time=00:00:00.52 bitrate= 962.5kbits/frame=  161 fps=160 q=23.0 size=     216kB time=00:00:02.06 bitrate= 860.6kbits/frame=  236 fps=157 q=23.0 size=     438kB time=00:00:03.56 bitrate=1008.2kbits/frame=  315 fps=157 q=23.0 size=     658kB time=00:00:05.14 bitrate=1048.8kbits/frame=  390 fps=155 q=23.0 size=     850kB time=00:00:06.64 bitrate=1048.7kbits/frame=  461 fps=153 q=23.0 size=    1059kB time=00:00:08.06 bitrate=1076.2kbits/frame=  500 fps=145 q=-1.0 Lsize=    1292kB time=00:00:09.96 bitrate=1062.3kbits/s    
  
  video:1285kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.521096%
  
  [libx264 @ 0x122c6c0] frame I:2     Avg QP: 9.48  size: 11840
  
  [libx264 @ 0x122c6c0] frame P:223   Avg QP:16.74  size:  3729
  
  [libx264 @ 0x122c6c0] frame B:275   Avg QP:21.86  size:  1672
  
  [libx264 @ 0x122c6c0] consecutive B-frames:  1.0% 73.6% 10.2% 15.2%
  
  [libx264 @ 0x122c6c0] mb I  I16..4: 51.2% 40.0%  8.7%
  
  [libx264 @ 0x122c6c0] mb P  I16..4:  0.9%  1.7%  0.4%  P16..4:  6.2%  3.6%  2.1%  0.0%  0.0%    skip:85.0%
  
  [libx264 @ 0x122c6c0] mb B  I16..4:  0.2%  0.3%  0.0%  B16..8:  7.8%  2.9%  0.7%  direct: 0.5%  skip:87.5%  L0:44.4% L1:50.3% BI: 5.3%
  
  [libx264 @ 0x122c6c0] 8x8 transform intra:52.1% inter:38.1%
  
  [libx264 @ 0x122c6c0] coded y,uvDC,uvAC intra: 9.7% 0.0% 0.0% inter: 1.8% 0.0% 0.0%
  
  [libx264 @ 0x122c6c0] i16 v,h,dc,p: 50% 41%  3%  6%
  
  [libx264 @ 0x122c6c0] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 44% 12% 36%  2%  1%  1%  1%  4%  0%
  
  [libx264 @ 0x122c6c0] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 41% 25% 21%  3%  1%  2%  1%  5%  1%
  
  [libx264 @ 0x122c6c0] i8c dc,h,v,p: 100%  0%  0%  0%
  
  [libx264 @ 0x122c6c0] Weighted P-Frames: Y:0.0% UV:0.0%
  
  [libx264 @ 0x122c6c0] ref P L0: 69.2%  7.5% 16.7%  6.6%
  
  [libx264 @ 0x122c6c0] ref B L0: 78.0% 20.6%  1.4%
  
  [libx264 @ 0x122c6c0] ref B L1: 96.8%  3.2%
  
  [libx264 @ 0x122c6c0] kb/s:1052.00

• How to speedup image processing (e.g. resizing, jpeg compress, encode) using ffmpeg command line utility from python on windows

  28 mars 2020, par MSD Paul

  I am running ffmpeg commands to downsizing and jpeg compression of a 4K image using command prompt on windows 10. But its taking a long time. To downsize, jpeg compress and finally encode to a video file it takes more than 500 ms.

  I can’t do the processing on images on batch but I have tried -hwaccel and -threads option (also -loglevel quiet for suppressing the logs being printed) in order to speedup the ffmpeg processing. Can someone please guide me towards how can I possibly speedup the ffmpeg command processing.

  Is it possible to pass the image files already read into memory using read() API to the ffmpeg command ?

  Please also let me know if there exists any other possible speedup techniques.

  Updated log :
  ffmpeg -i pic_1_org.png -vf scale=960 :-1 -q:v 80 -c:v libx264 -qp 25 -y temp_1.mp4

  *

  ffmpeg version 3.2.4 Copyright (c) 2000-2017 the FFmpeg developers
  
    built with gcc 6.3.0 (GCC)
  
    configuration: --disable-static --enable-shared --enable-gpl --enable-version3 --enable-d3d11va --enable-dxva2 --enable-libmfx --enable-nvenc --enable-avisynth --enable-bzlib --enable-fontconfig --enable-frei0r --enable-gnutls --enable-iconv --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libfreetype --enable-libgme --enable-libgsm --enable-libilbc --enable-libmodplug --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenh264 --enable-libopenjpeg --enable-libopus --enable-librtmp --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvo-amrwbenc --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxavs --enable-libxvid --enable-libzimg --enable-lzma --enable-zlib
  
    libavutil      55. 34.101 / 55. 34.101
  
    libavcodec     57. 64.101 / 57. 64.101
  
    libavformat    57. 56.101 / 57. 56.101
  
    libavdevice    57.  1.100 / 57.  1.100
  
    libavfilter     6. 65.100 /  6. 65.100
  
    libswscale      4.  2.100 /  4.  2.100
  
    libswresample   2.  3.100 /  2.  3.100
  
    libpostproc    54.  1.100 / 54.  1.100
  
  [png_pipe @ 00000000001e7920] Stream #0: not enough frames to estimate rate; consider increasing probesize
  
  Input #0, png_pipe, from 'pic_1_org.png':
  
    Duration: N/A, bitrate: N/A
  
      Stream #0:0: Video: png, rgb24(pc), 3840x2160 [SAR 1:1 DAR 16:9], 25 tbr, 25 tbn, 25 tbc
  
  No pixel format specified, yuv444p for H.264 encoding chosen.
  
  Use -pix_fmt yuv420p for compatibility with outdated media players.
  
  [libx264 @ 000000000260dcc0] -qscale is ignored, -crf is recommended.
  
  [libx264 @ 000000000260dcc0] using SAR=1/1
  
  [libx264 @ 000000000260dcc0] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 AVX2 LZCNT BMI2
  
  [libx264 @ 000000000260dcc0] profile High 4:4:4 Predictive, level 3.1, 4:4:4 8-bit
  
  [libx264 @ 000000000260dcc0] 264 - core 148 r2762 90a61ec - H.264/MPEG-4 AVC codec - Copyleft 2003-2017 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=4 threads=17 lookahead_threads=2 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc=cqp mbtree=0 qp=25 ip_ratio=1.40 pb_ratio=1.30 aq=0
  
  Output #0, mp4, to 'temp_1.mp4':
  
    Metadata:
  
      encoder         : Lavf57.56.101
  
      Stream #0:0: Video: h264 (libx264) ([33][0][0][0] / 0x0021), yuv444p, 960x540 [SAR 1:1 DAR 16:9], q=-1--1, 25 fps, 12800 tbn, 25 tbc
  
      Metadata:
  
        encoder         : Lavc57.64.101 libx264
  
      Side data:
  
        cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: -1
  
  Stream mapping:
  
    Stream #0:0 -> #0:0 (png (native) -> h264 (libx264))
  
  Press [q] to stop, [?] for help
  
  frame=    1 fps=0.0 q=22.0 Lsize=     135kB time=00:00:00.00 bitrate=14197538.5kbits/s speed=0.000451x
  
  video:134kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.594442%
  
  [libx264 @ 000000000260dcc0] frame I:1     Avg QP:22.00  size:136966
  
  [libx264 @ 000000000260dcc0] mb I  I16..4: 13.4% 32.1% 54.5%
  
  [libx264 @ 000000000260dcc0] 8x8 transform intra:32.1%
  
  [libx264 @ 000000000260dcc0] coded y,u,v intra: 80.3% 59.0% 55.2%
  
  [libx264 @ 000000000260dcc0] i16 v,h,dc,p:  5% 70%  5% 19%
  
  [libx264 @ 000000000260dcc0] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu:  5% 38% 14%  4%  5%  4% 14%  3% 14%
  
  [libx264 @ 000000000260dcc0] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu:  8% 24% 10%  5%  6%  4% 26%  3% 14%
  
  [libx264 @ 000000000260dcc0] kb/s:27393.20
  
   time needed to execute : 478.073120 ms

  *