Recherche avancée

Sur d’autres sites (3401)

• hardware conversion of image pixel format in ffmpeg ?

  18 janvier 2024, par dongrixinyu

  I am trying to decode an online rtmp video stream into RGB format frames, and then encoding RGB frames into an online stream.

  


  Task

  


  Here is what I do now :

  


  


  decoding a video stream to get images(RGB) ---> ai model process ---> encoding frames(RGB) to form a video stream in H264

  


  


  My scheme

  


  All my code in written in C with FFmpeg dependencies. The detailed steps are :

  


  


  rtmp/rtsp video stream ---> AVPacket ---(nvidia cuda)---> AVFrame(nv12 pix fmt) ---> AVFrame(RGB pix fmt) ---> AI process.

  


  


  


  AVFrame(RGB pix fmt) ---> AVFrame(nv12 pix fmt) ---(nvidia cuda)---> AVPacket ---> rtmp/rtsp video stream

  


  


  Now, the decoding and encoding part are run on NVIDIA GPU, which is quite fast.

  


  But the conversion of pixel format between AV_PIX_FMT_NV12 and AV_PIX_FMT_RGB is run on CPU, which is astonishingly CPU-consuming cause the size of video frame is 2k.

  


  My question

  


  So, is there any off-the-shelf method to fulfill the conversion of image pixel format on GPU (especially via cuda) directly ?

  


• How to build ffmpeg v6.0 with filter overlay_cuda ? [closed]

  6 février 2024, par yang

  My system version is ubuntu 22.04 LTS.

  


  I build ffmpeg v6.0 for tesla T4, but when I run

  


  ffmpeg -h filter=overlay_cuda


  


  the terminal output

  


  Unknown filter 'overlay_cuda'.


  


  then I tried to run

  


  ffmpeg \
    -hide_banner -y \
    -hwaccel cuda -hwaccel_output_format cuda \
    -i input \
    -filter_complex "[0:v:0]hwupload_cuda[main];[0:v:0]scale_npp=100:100,hwupload_cuda[logo];[main][logo]overlay_cuda[output]" \
    -map "[output]" -c:v h264_nvenc \
    output


  


  the terminal output

  


  [AVFilterGraph @ 0x561092fca380] No such filter: 'overlay_cuda'
Error initializing complex filters.
Filter not found


  


  Here is my build steps.

  


  1. install nvidia driver and cuda tool kit

  


  wget https://developer.download.nvidia.com/compute/cuda/12.0.0/local_installers/cuda_12.0.0_525.60.13_linux.run
sudo sh cuda_12.0.0_525.60.13_linux.run 


  


  2. download ffmpeg v6.0 source code and nv-codec-headers

  


  git clone -b release/6.0 https://git.ffmpeg.org/ffmpeg.git ffmpeg_cuda_6.0/
git clone -b sdk/12.0 https://git.videolan.org/git/ffmpeg/nv-codec-headers.git nv-codec-headers-12.0/
cd nv-codec-headers
make install


  


  3. ffmpeg configure and build

  


  PKG_CONFIG_PATH="/usr/local/lib/pkgconfig" \
./configure \
--enable-cuda \
--enable-cuvid \
--enable-nvdec \
--enable-nvenc \
--enable-nonfree \
--enable-libnpp \
--nvcc='/usr/local/cuda/bin/nvcc' \
--extra-cflags='-I/usr/local/cuda/include' \
--extra-ldflags='-L/usr/local/cuda/lib64' \
--enable-opencl \
--enable-shared \
--enable-gpl \
--enable-nonfree

make -j 8
make install


  


  4. export library

  


  export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/local/lib/
export LD_LIBRARY_PATH=$LD_LIBRARY_PATH:/usr/local/cuda/lib64


  


• FFMPEG fast quality video encoding without quality loss & less storage occupancy (maybe using GPU)

  27 mars 2024, par Diwash Mainali

  I Have written a go code but it is slow and the video compression rate is also not that impressive. I am new to FFMPEG and my entire project depends on FFMPEG. I have tried different video codecs like vp9, h264, h265, NVENC, AV1, etc. All of them were too slow (maybe I am not good enough to optimize it). My project is based on Go and the current codec that I am using is libx264. Can anyone help me optimize the video encoding part of my project.

  


  Libx264 :

  


  func encodeVideo(fileName, bitrate, crf, preset, resolution string) *exec.Cmd {
    return exec.Command("C:\\ffmpeg-6.1-full_build\\bin\\ffmpeg",
        "-i", "./userUploadDatas/videos/"+fileName,
        "-c:v", "libx264",
        "-b:v", bitrate,
        "-crf", crf,
        "-preset", preset,
        "-vf", "scale="+resolution,
        "./userUploadDatas/videos/"+fileName+"_encoded"+".mp4")
}


  


  Please provide static value of each parameters. Any codec will work for me as long as it is fast, occupies less space & doesn't loose spaces.

  


  The problems I have faces with different codecs are :

  


  

  1. NVENC : Fast but the size of video is doubled & loss of video quality.

  


  2. libx264 : Best I can find currently, but is slow.

  


  3. h264, h265 : Occupies more space

  


  4. Av1 & vp9 : Was too slow and wasn't able to encode 30sec video in 1hrs.

  


  


  The specs of hardware that I am using is Ryzen7 5000 series CPU, NVIDIA RTX 3050 Ti Laptop GPU.