Recherche avancée

Sur d’autres sites (3264)

• How to improve Desktop capture performance and quality with ffmpeg [closed]

  6 novembre 2024, par Francesco Bramato

  I'm developing a game capture feature from my Electron app. I'm working on this since a while and tried a lot of different parameters combinations, now i'm running out of ideas :)

  


  I've read tons of ffmpeg documentation, SO posts, other sites, but i'm not really a ffmpeg expert or video editing pro.

  


  This is how it works now :

  


  The app spawn an ffmpeg command based on user's settings :

  


  

  • Output format (mp4, mkv, avi)

  


  • Framerate (12, 24, 30, 60)

  


  • Codec (X264, NVidia NVENC, AMD AMF)

  


  • Bitrate (from 1000 to 10000kpbs)

  


  • Presets (for X264)

  


  • Audio output (a dshow device like StereoMix or VB-Cable) and Audio input (a dshow device like the Microphone)

  


  • Final Resolution (720p, 1080p, 2K, Original Size)

  


  


  The command executed, as far, is :

  


  ffmpeg.exe -nostats -hide_banner -hwaccel cuda -hwaccel_output_format cuda -f gdigrab -draw_mouse 0 -framerate 60 -offset_x 0 -offset_y 0 -video_size 2560x1440 -i desktop -f dshow -i audio=@device_cm_{33D9A762-90C8-11D0-BD43-00A0C911CE86}\wave_{D61FA53D-FA37-4BE7-BE2F-4005F94790BB} -ar 44100 -colorspace bt709 -color_trc bt709 -color_primaries bt709 -c:v h264_nvenc -b:v 6000k -preset slow -rc cbr -profile:v high -g 60 -acodec aac -maxrate 6000k -bufsize 12000k -pix_fmt yuv420p -f mpegts -


  


  one of the settings is the recording mode : full game session or replay buffer.
In case of full game session, the output is a file, for replay buffer is stdout.

  


  The output format is mpegts because, as far i have read in a lot of places, the video stream can be cut in any moment.

  


  Replays are cutted with different past and future duration based on game events.

  


  In full game session, the replays are cutted directly from the mpegts.

  


  In replay buffer mode, the ffmpeg stdout is redirect to the app that record the buffer (1 or 2 minutes), when the replay must be created, the app saves on the disk the buffer section according to past and future duration and with another ffmpeg command, copy it to a mp4 or mkv final file.

  


  Generally speaking, this works reliably.

  


  There are few issues :

  


  

  • nonetheless i ask ffmpeg to capture at 60fps, the final result is at 30fps (using -r 60 will speed up the final result)

  


  • some user has reported FPS drops in-game, specially when using NVidia NVENC (and having a NVIDIA GPU), using X264 seems save some FPS

  


  • colors are strange compared to original, what i see on screen, they seem washed out - i could have solved this using -colorspace bt709 -color_trc bt709 -color_primaries bt709 but don't know if is the right choice

  


  • NVIDIA NVenc with any other preset that is not slow creates videos terribly laggy

  


  


  here two examples, 60 FPS, NVIDIA NVENC (slow, 6000kbs, MP4

  


  Recorded by my app : https://www.youtube.com/watch?v=Msm62IwHdlk

  


  Recorded by OB with nearly same settings : https://youtu.be/WuHoLh26W7E

  


  Hope someone can help me

  


  Thanks !

  


• avcodec/sanm : disable left/top for fullscreen codecs

  11 mars, par Manuel Lauss

  avcodec/sanm : disable left/top for fullscreen codecs
  The block-based codecs 37/47/48 work on the full frame, and there's no
  
  existing LucasArts game video that uses left/top offsets for these,
  
  as it doesn't make sense. Ignore the left/top parameters for these codecs.
  Signed-off-by : Manuel Lauss <manuel.lauss@gmail.com>
  

  • [DH] libavcodec/sanm.c

• `ffmpeg -f concat` don't work when all input streams appear to have the same spec

  2 octobre 2024, par Roy

  My ffmpeg command :

  


  ffmpeg -safe 0 -f concat -i list.txt -c copy out.mp4


  


  My 1st input file :

  


  Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'D:\Applications\ffmpeg_6.0_full\a.mp4':
  Metadata:
    major_brand     : isom
    minor_version   : 512
    compatible_brands: isomiso2avc1mp41
    encoder         : Lavf60.3.100
  Duration: 00:00:04.97, start: 0.000000, bitrate: 40 kb/s
  Stream #0:0[0x1](und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 2 kb/s (default)
    Metadata:
      handler_name    : SoundHandler
      vendor_id       : [0][0][0][0]
  Stream #0:1[0x2](und): Video: h264 (Main) (avc1 / 0x31637661), yuv420p(tv, progressive), 1920x1080 [SAR 1:1 DAR 16:9], 27 kb/s, 30 fps, 30 tbr, 30k tbn (default)
    Metadata:
      handler_name    : VideoHandler
      vendor_id       : [0][0][0][0]
      encoder         : Lavc60.3.100 libx264


  


  My 2nd input file :

  


  Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'D:\Applications\ffmpeg_6.0_full\b.mp4':
  Metadata:
    major_brand     : mp42
    minor_version   : 0
    compatible_brands: mp41isom
    creation_time   : 2023-03-08T06:47:13.000000Z
    artist          : Microsoft Game DVR
    title           : PUBG: BATTLEGROUNDS
  Duration: 00:10:00.16, start: 0.000000, bitrate: 20885 kb/s
  Stream #0:0[0x1](und): Video: h264 (Main) (avc1 / 0x31637661), yuv420p(tv, progressive), 1920x1080 [SAR 1:1 DAR 16:9], 20739 kb/s, 30 fps, 30 tbr, 30k tbn (default)
    Metadata:
      creation_time   : 2023-03-08T06:47:13.000000Z
      handler_name    : VideoHandler
      vendor_id       : [0][0][0][0]
      encoder         : AVC Coding
  Stream #0:1[0x2](und): Audio: aac (LC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 131 kb/s (default)
    Metadata:
      creation_time   : 2023-03-08T06:47:13.000000Z
      handler_name    : SoundHandler
      vendor_id       : [0][0][0][0]


  


  The above command outputs some warning signals :

  


  [mov,mp4,m4a,3gp,3g2,mj2 @ 0000025239902d40] Auto-inserting h264_mp4toannexb bitstream filter
[mp4 @ 00000252396fe5c0] Non-monotonous DTS in output stream 0:1; previous: 218112, current: 150024; changing to 218113. This may result in incorrect timestamps in the output file.
...
a lot of them
...
frame=25992 fps=21754 q=-1.0 Lsize= 1519621kB time=00:14:49.39 bitrate=13996.8kbits/s speed= 744x
video:9649kB audio:1519216kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown


  


  The resultant video can play the first part of the video correctly, then the video players either skips directly to the end of the video (MPC-HC), or don't render anything at all while timer passes as normal (VLC).

  


  My impression of the concat is that it requires all videos to have the same spec, which I think my input achieved (all the "Steam #0:0", etc, line matches). I only see the following difference, which I assumed that should be okay :

  


  

  1. Metadata are different both for the whole input (e.g. "major_brand") and for each stream (e.g. "encoder"). I assumed that metadata won't affect the processing.

  


  2. The order of video/audio streams are different in the two inputs : the 1st input file has audio then video ; the 2nd input file has video then audio. I assumed that ffmpeg knows the difference and won't concat a video stream to an audio stream.

  


  


  The full output of the command can be found in this pastebin : https://pastebin.com/Z5q97Uyg