Recherche avancée

Sur d’autres sites (4122)

• Merge Audio with Video is not working probably using android 9 & 8

  22 juillet 2021, par ebdaa app

  I am trying to use the following code to merge audio with video,

  


      cmd = "-stream_loop -1 -i " + videoUri + " -i " + audioPath + " -shortest -map 0:v:0 -map 1:a:0 -y " + videoOutputPath;

    long executionId = FFmpeg.executeAsync(cmd, new ExecuteCallback() {

        @Override
        public void apply(final long executionId, final int returnCode) {
            if (returnCode == RETURN_CODE_SUCCESS) {
                playVedio(videoOutputPath);
            } else {
                ErrorLogger();
            }
        }
    });


  


  as you can see the above code does the following things :

  


  

  1. replace audio in video with new one.

  


  2. loop the video until the new audio ends.

  


  


  everything works perfectly when trying to run the code using both android 11 and 10 , however , when try to use android 9 or 8 , the first and the last 2 seconds of the new audio will be trimmed in the generated video and I am not able to know why

  


  I am using 4.4 version of the mobile-ffmpeg

  


   com.arthenica:mobile-ffmpeg-full:4.4


  


  please find the log from android 8/9

  


   I/mobile-ffmpeg: ffmpeg version v4.4-dev-416
      Copyright (c) 2000-2020 the FFmpeg developers
       built with Android (6454773 based on r365631c2) clang version 9.0.8 (https://android.googlesource.com/toolchain/llvm-project 98c855489587874b2a325e7a516b99d838599c6f) (based on LLVM 9.0.8svn)
       configuration: --cross-prefix=i686-linux-android- --sysroot=/files/android-sdk/ndk/21.3.6528147/toolchains/llvm/prebuilt/linux-x86_64/sysroot --prefix=/home/taner/Projects/mobile-ffmpeg/prebuilt/android-x86/ffmpeg --pkg-config=/usr/bin/pkg-config --enable-version3 --arch=i686 --cpu=i686 --cc=i686-linux-android24-clang --cxx=i686-linux-android24-clang++ --extra-libs='-L/home/taner/Projects/mobile-ffmpeg/prebuilt/android-x86/cpu-features/lib -lndk_compat' --target-os=android --disable-neon --disable-asm --disable-inline-asm --enable-cross-compile --enable-pic --enable-jni --enable-optimizations --enable-swscale --enable-shared --enable-v4l2-m2m --disable-outdev=fbdev --disable-indev=fbdev --enable-small --disable-openssl --disable-xmm-clobber-test --disable-debug --enable-lto --disable-neon-clobber-test --disable-programs --disable-postproc --disable-doc --disable-htmlpages --disable-manpages --disable-podpages --disable-txtpages --disable-static --disable-sndio --disable-schannel --disable-securetransport --disable-xlib --disable-cuda --disable-cuvid --disable-nvenc --disable-vaapi --disable-vdpau --disable-videotoolbox --disable-audiotoolbox --disable-appkit --disable-alsa --disable-cuda --disable-cuvid --disable-nvenc --disable-vaapi --disable-vdpau --enable-libfontconfig --enable-libfreetype --enable-libfribidi --enable-gmp --enable-gnutls --enable-libmp3lame --enable-libass --enable-iconv --enable-libtheora --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libxml2 --enable-libopencore-amrnb --enable-libshine --enable-libspeex --enable-libwavpack --enable-libkvazaar --enable-libilbc --enable-libopus --enable-libsnappy --enable-libsoxr --enable-libaom --enable-libtwolame --disable-sdl2 --enable-libvo-amrwbenc --enable-zlib --enable-mediacodec
       libavutil      56. 55.100 / 56. 55.100
       libavcodec     58. 96.100 / 58. 96.100
       libavformat    58. 48.100 / 58. 48.100
       libavdevice    58. 11.101 / 58. 11.101
       libavfilter     7. 87.100 /  7. 87.100
       libswscale      5.  8.100 /  5.  8.100
       libswresample   3.  8.100 /  3.  8.100
 I/mobile-ffmpeg: Input #0, mov,mp4,m4a,3gp,3g2,mj2, from '/storage/emulated/0/Download/Videoes/share_video_2.mp4':
       Metadata:
         major_brand     : 
     isom
         minor_version   : 
     512
         compatible_brands: 
     isomiso2avc1mp41
         encoder         : 
 I/mobile-ffmpeg: Lavf58.44.100
       Duration: 
     00:00:08.21
     , start: 
     0.000000
     , bitrate: 
     477 kb/s
         Stream #0:0
     (und)
     : Video: h264 (avc1 / 0x31637661), yuv420p, 640x360 [SAR 1:1 DAR 16:9], 473 kb/s
     , 
     29.97 fps, 
     29.97 tbr, 
     30k tbn, 
     59.94 tbc
      (default)
         Metadata:
           handler_name    : 
     VideoHandler
 I/mobile-ffmpeg: Input #1, mp3, from '/storage/emulated/0/Download/001001.mp3':
 I/mobile-ffmpeg:   Metadata:
         album           : 
     Mishary Alafasi Musshaf
         artist          : 
     Mishary Alafasi
         comment         : 
     www.mp3quran.net
         genre           : 
     Quran
         title           : 
     Al-Fatihah
         date            : 
     2007
         encoder         : 
     Lavf58.48.100
       Duration: 
     00:00:12.41
     , start: 
     0.011995
     , bitrate: 
     132 kb/s
         Stream #1:0
 I/mobile-ffmpeg: : Audio: mp3, 44100 Hz, stereo, fltp, 128 kb/s
         Metadata:
           encoder         : 
     Lavf
         Stream #1:1
     : Video: png, pal8(pc), 200x159 [SAR 2835:2835 DAR 200:159]
     , 
     90k tbr, 
     90k tbn, 
     90k tbc
      (attached pic)
         Metadata:
           comment         : 
     Cover (front)
 I/mobile-ffmpeg: Stream mapping:
       Stream #0:0 -> #0:0
      (h264 (native) -> mpeg4 (native))
       Stream #1:0 -> #0:1
      (mp3 (mp3float) -> aac (native))
     Press [q] to stop, [?] for help
 I/mobile-ffmpeg: frame=    0 fps=0.0 q=0.0 size=       0kB time=-577014:32:22.77 bitrate=  -0.0kbits/s speed=N/A    
 W/mobile-ffmpeg: [graph 0 input from stream 0:0 @ 0xd429d2e0] sws_param option is deprecated and ignored
 D/EGL_emulation: eglMakeCurrent: 0xf08c6ee0: ver 2 0 (tinfo 0xf08d2810)
 I/mobile-ffmpeg: Output #0, mp4, to '/storage/emulated/0/Download/v001001.mp4':
       Metadata:
         major_brand     : 
     isom
         minor_version   : 
 I/mobile-ffmpeg: 512
         compatible_brands: 
     isomiso2avc1mp41
         encoder         : 
     Lavf58.48.100
         Stream #0:0
     (und)
     : Video: mpeg4 (mp4v / 0x7634706D), yuv420p(progressive), 640x360 [SAR 1:1 DAR 16:9], q=2-31, 200 kb/s
     , 
     29.97 fps, 
     30k tbn, 
     29.97 tbc
      (default)
         Metadata:
           handler_name    : 
     VideoHandler
           encoder         : 
     Lavc58.96.100 mpeg4
         Side data:
 I/mobile-ffmpeg:       
     cpb: 
     bitrate max/min/avg: 0/0/200000 buffer size: 0 
     vbv_delay: N/A
 I/mobile-ffmpeg:     Stream #0:1
     : Audio: aac (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 128 kb/s
         Metadata:
           encoder         : 
     Lavc58.96.100 aac
 I/mobile-ffmpeg: frame=   83 fps=0.0 q=30.2 size=       0kB time=00:00:02.78 bitrate=   0.1kbits/s speed=5.54x    
 I/mobile-ffmpeg: frame=  199 fps=198 q=31.0 size=     256kB time=00:00:06.64 bitrate= 315.8kbits/s speed=6.61x    
 I/mobile-ffmpeg: frame=  300 fps=199 q=31.0 size=     512kB time=00:00:10.00 bitrate= 419.1kbits/s speed=6.65x    
 I/mobile-ffmpeg: frame=  372 fps=204 q=31.0 Lsize=     733kB time=00:00:12.39 bitrate= 484.5kbits/s speed= 6.8x    
     video:526kB audio:195kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 
     1.630239%
 I/mobile-ffmpeg: [aac @ 0xd431fc00] Qavg: 164.571


  


• AWS lambda mp4 thumbnail generator using ffmpeg - incorrect format generated

  10 avril 2021, par sam bhandu

  I am trying to create a thumbnail generator for every mp4 file uploaded to the s3 bucket. I have been following this post published by AWS. The code works fine for the transcoding video file. I changed the code to generate a thumbnail. The code does generate a file but it is an invalid image type.

  


  import json
import os
import subprocess
import shlex
import boto3
import uuid

S3_DESTINATION_BUCKET = "example-bucket"
SIGNED_URL_TIMEOUT = 60

def lambda_handler(event, context):

    # s3_source_bucket = event['Records'][0]['s3']['bucket']['name']
    # s3_source_key = event['Records'][0]['s3']['object']['key']
    # s3_source_basename = os.path.splitext(os.path.basename(s3_source_key))[0]
    # s3_destination_filename = s3_source_basename + "_cfr.ts"
    
    hex_c = uuid.uuid4()
    s3_destination_filename = '/{}/{}.{}'.format('tmp',hex_c, 'jpg')
    s3_client = boto3.client('s3')
    s3_media_url = 'https://s3-us-west-2.amazonaws.com/example-bucket/videos/presentations/testing.mp4'
    ffmpeg_cmd = "/opt/bin/ffmpeg -i \"" + s3_media_url + "\" -ss 00:00:02 -vframes 1  \"" + s3_destination_filename + "\""
    # ffmpeg_cmd = "/opt/bin/ffmpeg -i \"" + s3_source_signed_url + "\" -f mpegts -c:v copy -af aresample=async=1:first_pts=0 -"
    
    command1 = shlex.split(ffmpeg_cmd)
    p1 = subprocess.run(command1, stdout=subprocess.PIPE, stderr=subprocess.PIPE)
   
    resp = s3_client.put_object(Body=s3_destination_filename, Bucket=S3_DESTINATION_BUCKET, Key='{}{}'.format(hex_c, '.jpg'))
    return {
        'statusCode': 200,
        'body': json.dumps('Processing complete successfully')
    }


  


  Output is as :

  


  {
  "statusCode": 200,
  "body": "\"Processing complete successfully\""
}

Function Logs
START RequestId: b73aaacc-5da5-417a-9f98-5def438dee96 Version: $LATEST
ffmpeg version 4.1.3-static https://johnvansickle.com/ffmpeg/  Copyright (c) 2000-2019 the FFmpeg developers
  built with gcc 6.3.0 (Debian 6.3.0-18+deb9u1) 20170516
  configuration: --enable-gpl --enable-version3 --enable-static --disable-debug --disable-ffplay --disable-indev=sndio --disable-outdev=sndio --cc=gcc-6 --enable-fontconfig --enable-frei0r --enable-gnutls --enable-gmp --enable-gray --enable-libaom --enable-libfribidi --enable-libass --enable-libvmaf --enable-libfreetype --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-librubberband --enable-libsoxr --enable-libspeex --enable-libvorbis --enable-libopus --enable-libtheora --enable-libvidstab --enable-libvo-amrwbenc --enable-libvpx --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxml2 --enable-libxvid --enable-libzvbi --enable-libzimg
  libavutil      56. 22.100 / 56. 22.100
  libavcodec     58. 35.100 / 58. 35.100
  libavformat    58. 20.100 / 58. 20.100
  libavdevice    58.  5.100 / 58.  5.100
  libavfilter     7. 40.101 /  7. 40.101
  libswscale      5.  3.100 /  5.  3.100
  libswresample   3.  3.100 /  3.  3.100
  libpostproc    55.  3.100 / 55.  3.100
Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'https://s3-us-west-2.amazonaws.com/example-bucket/videos/presentations/testing.mp4':
  Metadata:
    major_brand     : isom
    minor_version   : 1
    compatible_brands: isomavc1mp42
    creation_time   : 2020-04-17T18:31:33.000000Z
  Duration: 00:00:33.07, start: 0.000000, bitrate: 90 kb/s
    Stream #0:0(und): Video: h264 (Main) (avc1 / 0x31637661), yuv420p(tv, bt709), 854x480 [SAR 1:1 DAR 427:240], 23 kb/s, 30 fps, 30 tbr, 30 tbn, 60 tbc (default)
    Metadata:
      creation_time   : 2020-04-17T18:31:29.000000Z
    Stream #0:1(eng): Audio: aac (HE-AAC) (mp4a / 0x6134706D), 44100 Hz, stereo, fltp, 64 kb/s (default)
    Metadata:
      creation_time   : 2020-04-17T18:31:29.000000Z
Stream mapping:
  Stream #0:0 -> #0:0 (h264 (native) -> mjpeg (native))
Press [q] to stop, [?] for help
[swscaler @ 0x67ddc40] deprecated pixel format used, make sure you did set range correctly
Output #0, image2, to '/tmp/4633bb13-4a15-49b7-a445-d910bebaddf6.jpg':
  Metadata:
    major_brand     : isom
    minor_version   : 1
    compatible_brands: isomavc1mp42
    encoder         : Lavf58.20.100
    Stream #0:0(und): Video: mjpeg, yuvj420p(pc), 854x480 [SAR 1:1 DAR 427:240], q=2-31, 200 kb/s, 30 fps, 30 tbn, 30 tbc (default)
    Metadata:
      creation_time   : 2020-04-17T18:31:29.000000Z
      encoder         : Lavc58.35.100 mjpeg
    Side data:
      cpb: bitrate max/min/avg: 0/0/200000 buffer size: 0 vbv_delay: -1
frame=    0 fps=0.0 q=0.0 size=N/A time=00:00:00.00 bitrate=N/A speed=   0x    
frame=    0 fps=0.0 q=0.0 size=N/A time=00:00:00.00 bitrate=N/A speed=   0x    
frame=    0 fps=0.0 q=0.0 size=N/A time=00:00:00.00 bitrate=N/A speed=   0x    
frame=    1 fps=0.4 q=6.3 Lsize=N/A time=00:00:00.03 bitrate=N/A speed=0.0149x    
video:14kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: unknown
END RequestId: b73aaacc-5da5-417a-9f98-5def438dee96
REPORT RequestId: b73aaacc-5da5-417a-9f98-5def438dee96  Duration: 6349.25 ms    Billed Duration: 6350 ms    Memory Size: 155 MB Max Memory Used: 123 MB Init Duration: 368.12 ms

Request ID
b73aaacc-5da5-417a-9f98-5def438dee96


  


  An image file is uploaded to the S3 folder, but when I try to open it flags an invalid file format. The file size is only 40.0 Bytes.
S3 bucket image folder
invalid file format

  


• How to pipe uncompressed video from FFMPEG subprocess to python ?

  20 mai 2022, par GottaGaming

  I got a problem with my program. It has no output. I try to make a Webcamvideostream on my raspberry pi 4 and try to use ffmpeg to handle the frame grabbing in python. My Problem is, that the output looks terrible. No real picture from my cam. Is it the wrong pixel format ? I show you the code :

  


  
    import os
    import tempfile
    import subprocess
    import cv2
    import numpy as np
    
    # To get this path execute:
    #    $ which ffmpeg
    FFMPEG_BIN = '/usr/bin/ffmpeg'
    width = 1280
    height = 720
    def run_ffmpeg():
        ffmpg_cmd = [
            FFMPEG_BIN,
            '-f', 'video4linux2',
            '-framerate', '30',
            '-input_format', 'mjpeg',
            '-video_size', f'{width}x{height}',
            '-i', '/dev/video0',
            '-filter:v', 'crop=1280:720:0:0',
            #'-an','-sn',                # disable audio processing
            '-f', 'image2pipe',
            '-',                        # output to go to stdout
        ]
        return subprocess.Popen(ffmpg_cmd, stdout = subprocess.PIPE, bufsize=10**8)
    
    def run_cv_window(process):
        while True:
            # read frame-by-frame
            raw_image = process.stdout.read(width*height*3)
            if raw_image == b'':
                raise RuntimeError("Empty pipe")
            
            # transform the bytes read into a numpy array
            frame =  np.frombuffer(raw_image, dtype='uint8')
            frame = frame.reshape((height,width,3)) # height, width, channels
            if frame is not None:
                cv2.imshow('Video', frame)
            
            if cv2.waitKey(1) & 0xFF == ord('q'):
                break
            process.stdout.flush()
        
        cv2.destroyAllWindows()
        process.terminate()
        print(process.poll())
    
    def run():
        ffmpeg_process = run_ffmpeg()
        run_cv_window(ffmpeg_process)
    
    run()



  


  This is the following output on the console :

  


  
        libavutil      56. 51.100 / 56. 51.100
      libavcodec     58. 91.100 / 58. 91.100
      libavformat    58. 45.100 / 58. 45.100
      libavdevice    58. 10.100 / 58. 10.100
      libavfilter     7. 85.100 /  7. 85.100
      libavresample   4.  0.  0 /  4.  0.  0
      libswscale      5.  7.100 /  5.  7.100
      libswresample   3.  7.100 /  3.  7.100
      libpostproc    55.  7.100 / 55.  7.100
    Input #0, video4linux2,v4l2, from '/dev/video0':
      Duration: N/A, start: 16744.936817, bitrate: N/A
        Stream #0:0: Video: mjpeg (Baseline), yuvj422p(pc, bt470bg/unknown/unknown), 1280x720, 30 fps, 30 tbr, 1000k tbn, 1000k tbc
    Stream mapping:
      Stream #0:0 -> #0:0 (mjpeg (native) -> mjpeg (native))
    Press [q] to stop, [?] for help
    Output #0, image2pipe, to 'pipe:':
      Metadata:
        encoder         : Lavf58.45.100
        Stream #0:0: Video: mjpeg, yuvj422p(pc), 1280x720, q=2-31, 200 kb/s, 30 fps, 30 tbn, 30 tbc
        Metadata:
          encoder         : Lavc58.91.100 mjpeg
        Side data:
          cpb: bitrate max/min/avg: 0/0/200000 buffer size: 0 vbv_delay: N/A
    frame=   13 fps=0.0 q=24.8 size=     557kB time=00:00:00.43 bitrate=10531.4kbits/s speed=0.846x    
    frame=   29 fps= 28 q=24.8 size=     983kB time=00:00:00.96 bitrate=8331.0kbits/s speed=0.946x    
    frame=   45 fps= 29 q=24.8 size=    1411kB time=00:00:01.50 bitrate=7706.4kbits/s speed=0.969x    
    frame=   61 fps= 29 q=24.8 size=    1840kB time=00:00:02.03 bitrate=7412.7kbits/s speed=0.98x    
    frame=   76 fps= 29 q=24.8 size=    2241kB time=00:00:02.53 bitrate=7247.8kbits/s speed=0.982x    
    frame=   91 fps= 29 q=24.8 size=    2642kB time=00:00:03.03 bitrate=7136.0kbits/s speed=0.979x    
    frame=  102 fps= 28 q=24.8 size=    2936kB time=00:00:03.40 bitrate=7074.4kbits/s speed=0.944x    
    frame=  116 fps= 28 q=24.8 size=    3310kB time=00:00:03.86 bitrate=7012.5kbits/s speed=0.937x    
    frame=  129 fps= 28 q=24.8 size=    3657kB time=00:00:04.30 bitrate=6966.9kbits/s speed=0.927x    
    frame=  142 fps= 28 q=24.8 size=    4004kB time=00:00:04.73 bitrate=6929.1kbits/s speed=0.918x    
    frame=  155 fps= 27 q=24.8 size=    4350kB time=00:00:05.16 bitrate=6897.7kbits/s speed=0.911x    
    frame=  168 fps= 27 q=24.8 size=    4697kB time=00:00:05.60 bitrate=6871.2kbits/s speed=0.904x
   #At some point it shows the output and then this happens:
frame=  321 fps= 27 q=24.8 size=   10102kB time=00:00:10.70 bitrate=7733.9kbits/s dup=2 drop=0 speed=0.899x    
frame=  335 fps= 27 q=24.8 size=   10530kB time=00:00:11.16 bitrate=7725.1kbits/s dup=4 drop=0 speed= 0.9x    
frame=  349 fps= 27 q=24.8 size=   10959kB time=00:00:11.63 bitrate=7717.0kbits/s dup=6 drop=0 speed=0.899x    
frame=  364 fps= 27 q=24.8 size=   11418kB time=00:00:12.13 bitrate=7708.9kbits/s dup=9 drop=0 speed=0.901x    
frame=  379 fps= 27 q=24.8 size=   11877kB time=00:00:12.63 bitrate=7701.7kbits/s dup=12 drop=0 speed=0.903x    
frame=  394 fps= 27 q=24.8 size=   12337kB time=00:00:13.13 bitrate=7695.5kbits/s dup=16 drop=0 speed=0.905x    
frame=  410 fps= 27 q=24.8 size=   12828kB time=00:00:13.66 bitrate=7689.2kbits/s dup=20 drop=0 speed=0.907x    
frame=  426 fps= 27 q=24.8 size=   13319kB time=00:00:14.20 bitrate=7683.7kbits/s dup=24 drop=0 speed=0.91x    
frame=  442 fps= 27 q=24.8 size=   13809kB time=00:00:14.73 bitrate=7678.1kbits/s dup=29 drop=0 speed=0.912x    
frame=  458 fps= 27 q=24.8 size=   14299kB time=00:00:15.26 bitrate=7672.9kbits/s dup=33 drop=0 speed=0.913x    
frame=  474 fps= 28 q=24.8 size=   14791kB time=00:00:15.80 bitrate=7668.9kbits/s dup=38 drop=0 speed=0.917x    
frame=  489 fps= 28 q=24.8 size=   15253kB time=00:00:16.30 bitrate=7665.6kbits/s dup=42 drop=0 speed=0.918x    
frame=  505 fps= 28 q=24.8 size=   15745kB time=00:00:16.83 bitrate=7662.4kbits/s dup=47 drop=0 speed=0.92x    
frame=  521 fps= 28 q=24.8 size=   16238kB time=00:00:17.36 bitrate=7659.5kbits/s dup=52 drop=0 speed=0.923x    
frame=  535 fps= 28 q=24.8 size=   16668kB time=00:00:17.83 bitrate=7656.9kbits/s dup=56 drop=0 speed=0.923x 

#many duplicated frames 


  


  Theres no real output picture and idk why. Can someone please help me ?

  


  Heres the output picture :


  


  ffplay command output :

  


    

    libavutil      56. 51.100 / 56. 51.100
      libavcodec     58. 91.100 / 58. 91.100
      libavformat    58. 45.100 / 58. 45.100
      libavdevice    58. 10.100 / 58. 10.100
      libavfilter     7. 85.100 /  7. 85.100
      libavresample   4.  0.  0 /  4.  0.  0
      libswscale      5.  7.100 /  5.  7.100
      libswresample   3.  7.100 /  3.  7.100
      libpostproc    55.  7.100 / 55.  7.100
    [video4linux2,v4l2 @ 0x93100630] Raw       :     yuyv422 :           YUYV 4:2:2 : 640x480 160x90 160x120 176x144 320x180 320x240 352x288 432x240 640x360 800x448 800x600 864x480 960x720 1024x576 1280x720 1600x896 1920x1080 2560x1472
    [video4linux2,v4l2 @ 0x93100630] Compressed:       mjpeg :          Motion-JPEG : 640x480 160x90 160x120 176x144 320x180 320x240 352x288 432x240 640x360 800x448 800x600 864x480 960x720 1024x576 1280x720 1600x896 1920x1080
    /dev/video0: Immediate exit requestedB vq=    0KB sq=    0B f=0/0