Recherche avancée

Sur d’autres sites (3596)

• How to to burn subtitles based image on video using 'overlay_cuda', ffmpeg video filter

  4 septembre 2020, par jgkim0518

  I have to burn subtitles based image on video using ffmpeg(v4.3) and cuda, hardware accelerator. I want to use 'overlay_cuda' in filter complex.

  


  It is my command.

  


  ./ffmpeg -init_hw_device cuda=cuda:1 -hwaccel cuda -filter_hw_device cuda -hwaccel_output_format cuda -i 2_dump.ts -filter_complex "[v:0]scale_npp=1920:1080,format=yuv420p[base_video];[base_video][s:3]overlay_cuda[resurlt_video]" -map "[resurlt_video]" -map 0:a -c:v h264_nvenc -f mpegts subtitle_test.ts


  


  But it's fail.

  


  These are output massage included error.

  


  ffmpeg version 4.3 Copyright (c) 2000-2020 the FFmpeg developers
built with gcc 4.8.5 (GCC) 20150623 (Red Hat 4.8.5-39)
configuration: --prefix=/usr/local --pkg-config-flags=--static --extra-cflags=-I/usr/local/include --extra-ldflags='-L/usr/local/lib -L/usr/local/lib64' --extra-libs='-lm -lpthread -lc' --bindir=/usr/local/bin --enable-cross-compile --enable-pic --enable-gpl --enable-libfdk_aac --enable-libfreetype --enable-libmp3lame --enable-libopus --enable-libvpx --enable-libx264 --enable-libx265 --enable-nonfree --enable-cuda-nvcc --enable-cuvid --enable-nvenc --enable-libnpp --extra-cflags=-I/usr/local/cuda/include --extra-ldflags=-L/usr/local/cuda/lib64 --enable-libass --enable-static --disable-shared
libavutil      56. 51.100 / 56. 51.100
libavcodec     58. 91.100 / 58. 91.100
libavformat    58. 45.100 / 58. 45.100
libavdevice    58. 10.100 / 58. 10.100
libavfilter     7. 85.100 /  7. 85.100
libswscale      5.  7.100 /  5.  7.100
libswresample   3.  7.100 /  3.  7.100
libpostproc    55.  7.100 / 55.  7.100
[mpegts @ 0x4971500] start time for stream 5 is not set in estimate_timings_from_pts
[mpegts @ 0x4971500] start time for stream 6 is not set in estimate_timings_from_pts
[mpegts @ 0x4971500] start time for stream 7 is not set in estimate_timings_from_pts
[mpegts @ 0x4971500] start time for stream 8 is not set in estimate_timings_from_pts
[mpegts @ 0x4971500] start time for stream 9 is not set in estimate_timings_from_pts
[mpegts @ 0x4971500] start time for stream 10 is not set in estimate_timings_from_pts
[mpegts @ 0x4971500] start time for stream 11 is not set in estimate_timings_from_pts
[mpegts @ 0x4971500] start time for stream 12 is not set in estimate_timings_from_pts
Input #0, mpegts, from '2_dump.ts':
Duration: 00:05:09.80, start: 1.400000, bitrate: 12595 kb/s
Program 1 
Metadata:
  service_name    : Service01
  service_provider: AMUZLAB
Stream #0:0[0x100](eng): Audio: ac3 ([129][0][0][0] / 0x0081), 48000 Hz, 5.1(side), fltp, 384 kb/s
Stream #0:1[0x101](ind): Audio: ac3 ([129][0][0][0] / 0x0081), 48000 Hz, stereo, fltp, 192 kb/s
Stream #0:2[0x102](zho): Audio: ac3 ([129][0][0][0] / 0x0081), 48000 Hz, stereo, fltp, 192 kb/s
Stream #0:3[0x103](kho): Audio: ac3 ([129][0][0][0] / 0x0081), 48000 Hz, stereo, fltp, 192 kb/s
Stream #0:4[0x104]: Video: h264 (High) ([27][0][0][0] / 0x001B), yuv420p(top first), 1920x1080 [SAR 1:1 DAR 16:9], 25 fps, 50 tbr, 90k tbn, 50 tbc
Stream #0:5[0x105](CHI): Subtitle: dvb_subtitle ([6][0][0][0] / 0x0006)
Stream #0:6[0x106](CHS): Subtitle: dvb_subtitle ([6][0][0][0] / 0x0006)
Stream #0:7[0x107](IND): Subtitle: dvb_subtitle ([6][0][0][0] / 0x0006)
Stream #0:8[0x108](THA): Subtitle: dvb_subtitle ([6][0][0][0] / 0x0006)
Stream #0:9[0x109](MAN): Subtitle: dvb_subtitle ([6][0][0][0] / 0x0006)
Stream #0:10[0x10a](MON): Subtitle: dvb_subtitle ([6][0][0][0] / 0x0006)
Stream #0:11[0x10b](BUR): Subtitle: dvb_subtitle ([6][0][0][0] / 0x0006)
Stream #0:12[0x10c](ENG): Subtitle: dvb_subtitle ([6][0][0][0] / 0x0006)
File 'subtitle_test.ts' already exists. Overwrite? [y/N] y
Stream mapping:
Stream #0:4 (h264) -> scale_npp (graph 0)
Stream #0:8 (dvbsub) -> overlay_cuda:overlay (graph 0)
overlay_cuda (graph 0) -> Stream #0:0 (h264_nvenc)
Stream #0:0 -> #0:1 (ac3 (native) -> mp2 (native))
Stream #0:1 -> #0:2 (ac3 (native) -> mp2 (native))
Stream #0:2 -> #0:3 (ac3 (native) -> mp2 (native))
Stream #0:3 -> #0:4 (ac3 (native) -> mp2 (native))
Press [q] to stop, [?] for help
[mpegts @ 0x4971500] sub2video: using 1920x1080 canvas
Impossible to convert between the formats supported by the filter 'Parsed_scale_npp_0' and the filter 'auto_scaler_0'
Error reinitializing filters!
Failed to inject frame into filter network: Function not implemented
Error while processing the decoded data for stream #0:4
Conversion failed!


  


  And, It is command line succeeded used 'overlay', software video filter, non_hardware accelerator.

  


  ./ffmpeg -hwaccel cuda -re -i 2_dump.ts -filter_complex "[0:v:0][0:s:3]overlay[v]" -map "[v]" -map 0:a -c:v h264_nvenc -f mpegts subtitle_test.ts


  


  How to to burn subtitles based image on video using ffmpeg(v4.3) and cuda, hardware accelerator ?

  


  Thank you.

  


• What is the pixel format of AV_PIX_FMT_CUDA in GPU memory and how to convert to BGR format in OpenCV ?

  31 janvier 2023, par cyw

  I an trying to decode a H264 RTSP stream using GPU hardware decoder and retrieve the image pointer in GPU memory and place it in cv::cuda::GpuMat to avoid CPU transfers.

  


  I received the frame and the pixel format is AV_PIX_FMT_CUDA.

  


  ret = avcodec_receive_frame(avctx, frame);
const char* gpu_pixfmt = av_get_pix_fmt_name((AVPixelFormat)frame->format); //AV_PIX_FMT_CUDA


  


  Without knowing the image format, I am unable to display the image correctly.

  


  cv::cuda::GpuMat dimage(sw_frame->height, sw_frame->width, CV_8UC2, frame->data[0]);
cv::Mat himage;
dimage.download(himage);
cv::cvtColor(himage, himage, cv::COLOR_YUV2BGR_UYVY);
cv::imshow("image", himage);


  


  Any idea what is the pixel format and how to decode it correctly to BGR using opencv ?

  


  Thanks in advance.

  


• Compile the GPU version of FFMPEG to OpenCV

  12 juillet 2018, par Dyex719

  When I try to use GPU
  FFMPEG on opencv by using a command like :

  VideoCapture cap("rtsp link");
  
  
  
  for(;;)
  
  {
  
  mat frame;
  
  cap>>frame;
  
  }

  I don’t see any output on nvidia-smi despite compiling the GPU version of FFMPEG.

  I am trying to get FFMPEG to use GPU to improve the speed of my program. I got FFMPEG from cloning this and followed the steps here to get it working.

  I have validated the results using nvidia-smi dmon -i 0 and have seen that dec% increases when I run the command ffmpeg -c:v h264_cuvid -i test_video.mp4 test_output.mkv.

  I then compiled Opencv to use the GPU enabled FFMPEG, I check this by running getBuildInformation from opencv :

  Video I/O: 
  
  DC1394 1.x: NO 
  
  DC1394 2.x: YES (ver 2.2.4) 
  
  FFMPEG: YES 
  
  codec: YES (ver 58.20.103) 
  
  format: YES (ver 58.17.100) 
  
  util: YES (ver 56.18.102) 
  
  swscale: YES (ver 5.2.100) 
  
  resample: NO 
  
  gentoo-style: YES 
  
  GStreamer: NO 
  
  OpenNI: NO 
  
  OpenNI PrimeSensor Modules: NO 
  
  OpenNI2: NO 
  
  PvAPI: NO 
  
  GigEVisionSDK: NO 
  
  UniCap: NO 
  
  UniCap ucil: NO 
  
  V4L/V4L2: NO/YES 
  
  XIMEA: NO 
  
  Xine: NO 
  
  gPhoto2: NO

  I cross-verify that I’m using the same ffmpeg (by checking the version numbers) :

  ffmpeg version N-91273-g67747c8 Copyright (c) 2000-2018 the FFmpeg developers
  
    built with gcc 5.4.0 (Ubuntu 5.4.0-6ubuntu1~16.04.9) 20160609
  
    configuration: --enable-cuda --enable-cuvid --enable-nvenc --enable-nonfree --enable-libnpp --extra-cflags=-I/usr/local/cuda/include --extra-ldflags=-L/usr/local/cuda/lib64
  
    libavutil      56. 18.102 / 56. 18.102
  
    libavcodec     58. 20.101 / 58. 20.101
  
    libavformat    58. 17.100 / 58. 17.100
  
    libavdevice    58.  4.101 / 58.  4.101
  
    libavfilter     7. 25.100 /  7. 25.100
  
    libswscale      5.  2.100 /  5.  2.100
  
    libswresample   3.  2.100 /  3.  2.100

  Please advise me on how I should compile OpenCV to use the GPU version of FFMPEG. Thank you !