Recherche avancée

Sur d’autres sites (6723)

• FFMPEG Issue : Video breaks a lot hence the real time video gets distorted and gets a little delayed while streaming on a webpage from drone

  26 mars 2022, par ashiyaa nunhuck

  ****I am trying to detect a face from my drone camera in real time.The video streams successfully but it is delayed and breaks a lot. Is there any solution to this problem ? How can i have a smooth video streaming with little delay and no video breaking in order to succeed in detecting a face ? Your help will be much appreciated.
Also, this is printed while my code is running: :

  


  


  INFO:werkzeug:127.0.0.1 - - [27/May/2021 15:16:14] "GET
/video/streaming HTTP/1.1" 200 -
INFO:drone_face_recognition_and_tracking.controllers.server :'action' :
'command', 'cmd' : 'takeOff'
INFO:drone_face_recognition_and_tracking.models.manage_drone :'action' :
'send_command', 'command' : 'takeoff' [h264 @ 0x55aa924a2e40] error
while decoding MB 45 38, bytestream -6 [h264 @ 0x55aa924a2e40]
concealing 424 DC, 424 AC, 424 MV errors in I frame [h264 @
0x55aa922a9a00] concealing 687 DC, 687 AC, 687 MV errors in P frame
[h264 @ 0x55aa923f79c0] left block unavailable for requested intra
mode [h264 @ 0x55aa923f79c0] error while decoding MB 0 34, bytestream
1347 [h264 @ 0x55aa923f79c0] concealing 709 DC, 709 AC, 709 MV errors
in P frame INFO:werkzeug:127.0.0.1 - - [27/May/2021 15:16:17] "POST
/api/command/ HTTP/1.1" 200 - pipe:0 : corrupt decoded frame in stream
0
Last message repeated 2 times [h264 @ 0x55aa922a9a00] error while decoding MB 49 30, bytestream -6 [h264 @ 0x55aa922a9a00] concealing
900 DC, 900 AC, 900 MV errors in P frame pipe:0 : corrupt decoded frame
in stream 0
INFO:drone_face_recognition_and_tracking.models.manage_drone :'action' :
'receive_response', 'response' : b'ok'
INFO:drone_face_recognition_and_tracking.controllers.server :'action' :
'command', 'cmd' : 'faceDetectAndTrack' INFO:werkzeug:127.0.0.1 - -
[27/May/2021 15:16:21] "POST /api/command/ HTTP/1.1" 200 - [h264 @
0x55aa924a2e40] left block unavailable for requested intra4x4 mode -1
[h264 @ 0x55aa924a2e40] error while decoding MB 0 30, bytestream 1624
[h264 @ 0x55aa924a2e40] concealing 949 DC, 949 AC, 949 MV errors in I
frame pipe:0 : corrupt decoded frame in stream 0 [h264 @
0x55aa9244d400] left block unavailable for requested intra mode [h264
@ 0x55aa9244d400] error while decoding MB 0 12, bytestream 2936 [h264
@ 0x55aa9244d400] concealing 2029 DC, 2029 AC, 2029 MV errors in I
frame pipe:0 : corrupt decoded frame in stream 0 [h264 @
0x55aa924bf700] concealing 1632 DC, 1632 AC, 1632 MV errors in P frame
pipe:0 : corrupt decoded frame in stream 0 [h264 @ 0x55aa92414280]
concealing 1571 DC, 1571 AC, 1571 MV errors in P frame

  


  


  Here is my code :****

  


  import logging
import contextlib
import os
import socket
import subprocess
import threading
import time
import cv2 as cv
import numpy as np

from drone_face_recognition_and_tracking.models.base import Singleton

logger = logging.getLogger(__name__)

DEFAULT_DISTANCE = 0.30
DEFAULT_SPEED = 10
DEFAULT_DEGREE = 10

FRAME_X = int(320)  # try 640
FRAME_Y = int(240)  # try 480
FRAME_AREA = FRAME_X * FRAME_Y

FRAME_SIZE = FRAME_AREA * 3
FRAME_CENTER_X = FRAME_X / 2
FRAME_CENTER_Y = FRAME_Y / 2

CMD_FFMPEG = (f'ffmpeg -probesize 32 -hwaccel auto -hwaccel_device opencl -i pipe:0 '
              f'-pix_fmt bgr24 -s {FRAME_X}x{FRAME_Y} -f rawvideo pipe:1')

FACE_DETECT_XML_FILE = './drone_face_recognition_and_tracking/models/haarcascade_frontalface_default.xml'


def receive_video(stop_event, pipe_in, host_ip, video_port):
    with socket.socket(socket.AF_INET, socket.SOCK_DGRAM) as sock_video:
        sock_video.setsockopt(socket.SOL_SOCKET, socket.SO_REUSEADDR, 1)
        sock_video.settimeout(.5)
        sock_video.bind((host_ip, video_port))
        data = bytearray(2048)
        while not stop_event.is_set():
            try:
                size, addr = sock_video.recvfrom_into(data)
                # logger.info({'action': 'receive_video', 'data': data})
            except socket.timeout as ex:
                logger.warning({'action': 'receive_video', 'ex': ex})
                time.sleep(0.5)
                continue
            except socket.error as ex:
                logger.error({'action': 'receive_video', 'ex': ex})
                break

            try:
                pipe_in.write(data[:size])
                pipe_in.flush()
            except Exception as ex:
                logger.error({'action': 'receive_video', 'ex': ex})
                break


class Tello_Drone(metaclass=Singleton):
    def __init__(self, host_ip='192.168.10.2', host_port=8889,
                 drone_ip='192.168.10.1', drone_port=8889,
                 is_imperial=False, speed=DEFAULT_SPEED):
        self.host_ip = host_ip
        self.host_port = host_port
        self.drone_ip = drone_ip
        self.drone_port = drone_port
        self.drone_address = (drone_ip, drone_port)
        self.is_imperial = is_imperial
        self.speed = speed
        self.socket = socket.socket(socket.AF_INET, socket.SOCK_DGRAM)
        self.socket.bind((self.host_ip, self.host_port))

        self.response = None
        self.stop_event = threading.Event()
        self._response_thread = threading.Thread(target=self.receive_response, args=(self.stop_event, ))
        self._response_thread.start()

        self.proc = subprocess.Popen(CMD_FFMPEG.split(' '),
                                     stdin=subprocess.PIPE,
                                     stdout=subprocess.PIPE)
        self.proc_stdin = self.proc.stdin
        self.proc_stdout = self.proc.stdout

        self.video_port = 11111

        self._receive_video_thread = threading.Thread(
            target=receive_video,
            args=(self.stop_event, self.proc_stdin,
                  self.host_ip, self.video_port,))
        self._receive_video_thread.start()

        self.face_cascade = cv.CascadeClassifier(FACE_DETECT_XML_FILE)
        self._is_enable_face_detect = False

        self.send_command('command')
        self.send_command('streamon')
        self.set_speed(self.speed)

    def receive_response(self, stop_event):
        while not stop_event.is_set():
            try:
                self.response, ip = self.socket.recvfrom(3000)
                logger.info({'action': 'receive_response',
                             'response': self.response})
            except socket.error as ex:
                logger.error({'action': 'receive_response',
                             'ex': ex})
                break

    def __dell__(self):
        self.stop()

    def stop(self):
        self.stop_event.set()
        retry = 0
        while self._response_thread.is_alive():
            time.sleep(0.3)
            if retry > 30:
                break
            retry += 1
        self.socket.close()
        os.kill(self.proc.pid, 9)

    def send_command(self, command):
        logger.info({'action': 'send_command', 'command': command})
        self.socket.sendto(command.encode('utf-8'), self.drone_address)

        retry = 0
        while self.response is None:
            time.sleep(0.3)
            if retry > 3:
                break
            retry += 1

        if self.response is None:
            response = None
        else:
            response = self.response.decode('utf-8')
        self.response = None
        return response

    def takeoff(self):
        return self.send_command('takeoff')

    def land(self):
        return self.send_command('land')

    def move(self, direction, distance):
        distance = float(distance)
        if self.is_imperial:
            distance = int(round(distance * 30.48))
        else:
            distance = int(round(distance * 100))
        return self.send_command(f'{direction} {distance}')

    def up(self, distance=DEFAULT_DISTANCE):
        return self.move('up', distance)

    def down(self, distance=DEFAULT_DISTANCE):
        return self.move('down', distance)

    def left(self, distance=DEFAULT_DISTANCE):
        return self.move('left', distance)

    def right(self, distance=DEFAULT_DISTANCE):
        return self.move('right', distance)

    def forward(self, distance=DEFAULT_DISTANCE):
        return self.move('forward', distance)

    def back(self, distance=DEFAULT_DISTANCE):
        return self.move('back', distance)

    def set_speed(self, speed):
        return self.send_command(f'speed {speed}')

    def clockwise(self, degree=DEFAULT_DEGREE):
        return self.send_command(f'cw {degree}')

    def counter_clockwise(self, degree=DEFAULT_DEGREE):
        return self.send_command(f'ccw {degree}')

    def video_binary_generator(self):
        while True:
            try:
                frame = self.proc_stdout.read(FRAME_SIZE)
            except Exception as ex:
                logger.error({'action': 'video_binary_generator', 'ex': ex})
                continue

            if not frame:
                continue

            frame = np.fromstring(frame, np.uint8).reshape(FRAME_Y, FRAME_X, 3)
            yield frame

    def enable_face_detect(self):
        self._is_enable_face_detect = True

    def disable_face_detect(self):
        self._is_enable_face_detect = False

    def video_jpeg_generator(self):
        for frame in self.video_binary_generator():
            if self._is_enable_face_detect:
                gray = cv.cvtColor(frame, cv.COLOR_BGR2GRAY)
                faces = self.face_cascade.detectMultiScale(gray, 1.2, 4)
                for (x, y, w, h) in faces:
                    cv.rectangle(frame, (x, y), (x+w, y+h), (0, 0, 255), 2)
                    break

            _, jpeg = cv.imencode('.jpg', frame)
            jpeg_binary = jpeg.tobytes()
            yield jpeg_binary


  


• ffmpeg converting .vob to .mp4 --- colors are washed out

  28 mai 2021, par Blattla

  I am very new to ffmpeg. Currently I am trying to convert old family movies from vob to mp4.
After getting some help I used this command :

  


  ffmpeg -i 1998.vob -codec:v libx264 -crf 17 -pix_fmt yuv420p -codec:a aac -movflags +faststart 1998.mp4


  


  Two things that still bug me. The output is almost 20% larger than the input and the colors are washed out. Although the movies are old and of low quality (grainy, rather flat colors, ...) the colors in the output movie are less intense than in the original one. Larger file size would be ok for me but do you have any idea which part of my command might cause the color issue ?

  


  ffmpeg version 4.4 Copyright (c) 2000-2021 the FFmpeg developers
  built with Apple clang version 12.0.0 (clang-1200.0.32.29)
  configuration: --prefix=/usr/local/Cellar/ffmpeg/4.4_1 --enable-shared --enable-pthreads --enable-version3 --enable-avresample --cc=clang --host-cflags= --host-ldflags= --enable-ffplay --enable-gnutls --enable-gpl --enable-libaom --enable-libbluray --enable-libdav1d --enable-libmp3lame --enable-libopus --enable-librav1e --enable-librubberband --enable-libsnappy --enable-libsrt --enable-libtesseract --enable-libtheora --enable-libvidstab --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxml2 --enable-libxvid --enable-lzma --enable-libfontconfig --enable-libfreetype --enable-frei0r --enable-libass --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libspeex --enable-libsoxr --enable-libzmq --enable-libzimg --disable-libjack --disable-indev=jack --enable-videotoolbox
  libavutil      56. 70.100 / 56. 70.100
  libavcodec     58.134.100 / 58.134.100
  libavformat    58. 76.100 / 58. 76.100
  libavdevice    58. 13.100 / 58. 13.100
  libavfilter     7.110.100 /  7.110.100
  libavresample   4.  0.  0 /  4.  0.  0
  libswscale      5.  9.100 /  5.  9.100
  libswresample   3.  9.100 /  3.  9.100
  libpostproc    55.  9.100 / 55.  9.100
Input #0, mpeg, from '1995.vob':
  Duration: 00:00:14.64, start: 0.232178, bitrate: 1676252 kb/s
  Stream #0:0[0x1bf]: Data: dvd_nav_packet
  Stream #0:1[0x1e0]: Video: mpeg2video (Main), yuv420p(tv, bt470bg, top first), 704x576 [SAR 12:11 DAR 4:3], 25 fps, 25 tbr, 90k tbn, 50 tbc
    Side data:
      cpb: bitrate max/min/avg: 9548800/0/0 buffer size: 1835008 vbv_delay: N/A
  Stream #0:2[0x80]: Audio: ac3, 48000 Hz, stereo, fltp, 256 kb/s
File '999.mp4' already exists. Overwrite? [y/N] y
Stream mapping:
  Stream #0:1 -> #0:0 (mpeg2video (native) -> h264 (libx264))
  Stream #0:2 -> #0:1 (ac3 (native) -> aac (native))
Press [q] to stop, [?] for help
[libx264 @ 0x7ff666814400] using SAR=12/11
[libx264 @ 0x7ff666814400] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2
[libx264 @ 0x7ff666814400] profile High, level 3.0, 4:2:0, 8-bit
[libx264 @ 0x7ff666814400] 264 - core 161 r3049 55d517b - H.264/MPEG-4 AVC codec - Copyleft 2003-2021 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=6 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=17.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00
Output #0, mp4, to '999.mp4':
  Metadata:
    encoder         : Lavf58.76.100
  Stream #0:0: Video: h264 (avc1 / 0x31637661), yuv420p(tv, bt470bg, top coded first (swapped)), 704x576 [SAR 12:11 DAR 4:3], q=2-31, 25 fps, 12800 tbn
    Metadata:
      encoder         : Lavc58.134.100 libx264
    Side data:
      cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A
  Stream #0:1: Audio: aac (LC) (mp4a / 0x6134706D), 48000 Hz, stereo, fltp, 128 kb/s
    Metadata:
      encoder         : Lavc58.134.100 aac
frame=    1 fps=0.0 q=0.0 size=       0kB time=00:00:00.00 bitrate=N/A speed=   frame=   59 fps=0.0 q=22.0 size=     256kB time=00:00:02.04 bitrate=1024.2kbits/frame=   75 fps= 72 q=22.0 size=    1024kB time=00:00:02.68 bitrate=3120.9kbits/frame=   95 fps= 61 q=22.0 size=    2048kB time=00:00:03.45 bitrate=4854.6kbits/frame=  112 fps= 54 q=22.0 size=    2816kB time=00:00:04.18 bitrate=5517.2kbits/frame=  131 fps= 51 q=22.0 size=    4096kB time=00:00:04.92 bitrate=6809.0kbits/frame=  149 fps= 48 q=22.0 size=    4864kB time=00:00:05.65 bitrate=7048.3kbits/frame=  169 fps= 47 q=22.0 size=    6144kB time=00:00:06.42 bitrate=7838.3kbits/frame=  183 fps= 44 q=22.0 size=    6912kB time=00:00:07.04 bitrate=8043.1kbits/frame=  203 fps= 43 q=22.0 size=    7936kB time=00:00:07.80 bitrate=8326.3kbits/frame=  221 fps= 42 q=22.0 size=    8960kB time=00:00:08.51 bitrate=8623.2kbits/frame=  240 fps= 42 q=22.0 size=    9984kB time=00:00:09.28 bitrate=8813.5kbits/frame=  261 fps= 41 q=22.0 size=   11264kB time=00:00:10.06 bitrate=9164.0kbits/frame=  278 fps= 40 q=22.0 size=   12288kB time=00:00:10.81 bitrate=9306.9kbits/frame=  294 fps= 40 q=22.0 size=   13568kB time=00:00:11.45 bitrate=9702.3kbits/frame=  311 fps= 39 q=22.0 size=   14592kB time=00:00:12.09 bitrate=9882.4kbits/frame=  329 fps= 39 q=22.0 size=   15616kB time=00:00:12.86 bitrate=9944.5kbits/frame=  347 fps= 39 q=22.0 size=   16640kB time=00:00:13.56 bitrate=10046.8kbitsframe=  366 fps= 38 q=22.0 size=   17920kB time=00:00:14.33 bitrate=10240.0kbitsframe=  385 fps= 38 q=22.0 size=   19200kB time=00:00:15.12 bitrate=10398.9kbitsframe=  400 fps= 38 q=22.0 size=   20224kB time=00:00:15.63 bitrate=10594.9kbitsframe=  418 fps= 38 q=22.0 size=   21504kB time=00:00:16.34 bitrate=10780.1kbitsframe=  431 fps= 37 q=22.0 size=   22528kB time=00:00:16.89 bitrate=10922.7kbitsframe=  447 fps= 37 q=22.0 size=   23808kB time=00:00:17.53 bitrate=11122.0kbitsframe=  466 fps= 37 q=22.0 size=   25088kB time=00:00:18.26 bitrate=11254.5kbitsframe=  479 fps= 36 q=22.0 size=   25856kB time=00:00:18.81 bitrate=11257.1kbitsframe=  497 fps= 36 q=22.0 size=   27136kB time=00:00:19.54 bitrate=11375.8kbitsframe=  513 fps= 36 q=22.0 size=   28416kB time=00:00:20.16 bitrate=11546.8kbitsframe=  530 fps= 36 q=22.0 size=   29440kB time=00:00:20.92 bitrate=11523.9kbitsframe=  546 fps= 36 q=22.0 size=   30464kB time=00:00:21.56 bitrate=11570.9kbitsframe=  564 fps= 36 q=22.0 size=   31744kB time=00:00:22.10 bitrate=11766.1kbitsframe=  580 fps= 36 q=19.0 size=   32512kB time=00:00:22.80 bitrate=11678.8kbitsframe=  598 fps= 36 q=22.0 size=   33792kB time=00:00:23.57 bitrate=11743.1kbitsframe=  614 fps= 35 q=22.0 size=   34560kB time=00:00:24.25 bitrate=11672.0kbitsframe=  630 fps= 35 q=22.0 size=   35328kB time=00:00:24.85 bitrate=11644.6kbitsframe=  646 fps= 35 q=22.0 size=   36096kB time=00:00:25.42 bitrate=11628.3kbitsframe=  662 fps= 35 q=22.0 size=   37376kB time=00:00:26.17 bitrate=11697.1kbitsframe=  682 fps= 35 q=22.0 size=   38400kB time=00:00:26.90 bitrate=11693.6kbitsframe=  699 fps= 35 q=22.0 size=   39424kB time=00:00:27.66 bitrate=11672.2kbitsframe=  719 fps= 35 q=22.0 size=   40704kB time=00:00:28.41 bitrate=11734.5kbitsframe=  736 fps= 35 q=22.0 size=   41728kB time=00:00:29.14 bitrate=11730.3kbitsframe=  753 fps= 35 q=22.0 size=   42752kB time=00:00:29.71 bitrate=11785.2kbitsframe=  764 fps= 35 q=22.0 size=   43520kB time=00:00:30.20 bitrate=11802.0kbitsframe=  776 fps= 35 q=22.0 size=   44544kB time=00:00:30.72 bitrate=11878.4kbitsframe=  786 fps= 34 q=22.0 size=   45312kB time=00:00:31.06 bitrate=11950.4kbitsframe=  799 fps= 34 q=22.0 size=   46080kB time=00:00:31.57 bitrate=11955.9kbitsframe=  815 fps= 34 q=22.0 size=   47104kB time=00:00:32.14 bitrate=12002.6kbitsframe=  830 fps= 34 q=22.0 size=   48128kB time=00:00:32.78 bitrate=12024.2kbitsframe=  839 fps= 33 q=22.0 size=   48640kB time=00:00:33.15 bitrate=12019.2kbitsframe=  847 fps= 33 q=22.0 size=   49152kB time=00:00:33.49 bitrate=12021.9kbitsframe=  858 fps= 33 q=22.0 size=   49920kB time=00:00:33.98 bitrate=12033.5kbitsframe=  867 fps= 32 q=22.0 size=   50688kB time=00:00:34.30 bitrate=12104.6kbitsframe=  880 fps= 32 q=22.0 size=   51456kB time=00:00:34.88 bitrate=12085.1kbitsframe=  898 fps= 32 q=22.0 size=   52480kB time=00:00:35.54 bitrate=12096.2kbitsframe=  913 fps= 32 q=22.0 size=   53504kB time=00:00:36.18 bitrate=12114.1kbitsframe=  923 fps= 32 q=22.0 size=   54016kB time=00:00:36.54 bitrate=12108.7kbitsframe=  940 fps= 32 q=22.0 size=   55040kB time=00:00:37.20 bitrate=12118.9kbitsframe=  958 fps= 32 q=22.0 size=   55808kB time=00:00:37.90 bitrate=12059.8kbitsframe=  975 fps= 32 q=22.0 size=   56832kB time=00:00:38.61 bitrate=12057.2kbitsframe=  994 fps= 32 q=22.0 size=   58112kB time=00:00:39.38 bitrate=12088.3kbitsframe= 1012 fps= 32 q=22.0 size=   59136kB time=00:00:40.02 bitrate=12104.6kbitsframe= 1026 fps= 32 q=22.0 size=   59904kB time=00:00:40.64 bitrate=12075.1kbitsframe= 1038 fps= 31 q=22.0 size=   60928kB time=00:00:41.21 bitrate=12109.9kbitsframe= 1046 fps= 31 q=22.0 size=   61440kB time=00:00:41.53 bitrate=12117.6kbitsframe= 1057 fps= 31 q=22.0 size=   61952kB time=00:00:41.87 bitrate=12119.0kbitsframe= 1071 fps= 31 q=22.0 size=   62976kB time=00:00:42.45 bitrate=12152.2kbitsframe= 1083 fps= 31 q=22.0 size=   63488kB time=00:00:42.90 bitrate=12123.0kbitsframe= 1096 fps= 31 q=22.0 size=   64256kB time=00:00:43.41 bitrate=12125.0kbitsframe= 1110 fps= 31 q=22.0 size=   65280kB time=00:00:44.09 bitrate=12127.5kbitsframe= 1126 fps= 31 q=22.0 size=   66048kB time=00:00:44.62 bitrate=12123.5kbitsframe= 1131 fps= 30 q=19.0 size=   66560kB time=00:00:44.86 bitrate=12153.6kbitsframe= 1147 fps= 30 q=22.0 size=   67584kB time=00:00:45.46 bitrate=12178.4kbitsframe= 1155 fps= 30 q=22.0 size=   68096kB time=00:00:45.88 bitrate=12156.6kbitsframe= 1167 fps= 30 q=22.0 size=   68864kB time=00:00:46.33 bitrate=12174.9kbitsframe= 1175 fps= 30 q=22.0 size=   69376kB time=00:00:46.59 bitrate=12198.0kbitsframe= 1184 fps= 30 q=22.0 size=   70144kB time=00:00:46.93 bitrate=12243.3kbitsframe= 1196 fps= 30 q=22.0 size=   70912kB time=00:00:47.44 bitrate=12243.8kbitsframe= 1211 fps= 30 q=22.0 size=   71936kB time=00:00:48.06 bitrate=12260.7kbitsframe= 1226 fps= 30 q=22.0 size=   73216kB time=00:00:48.66 bitrate=12325.7kbitsframe= 1240 fps= 29 q=22.0 size=   73984kB time=00:00:49.17 bitrate=12325.3kbitsframe= 1256 fps= 29 q=22.0 size=   75264kB time=00:00:49.85 bitrate=12366.9kbitsframe= 1271 fps= 29 q=22.0 size=   76032kB time=00:00:50.43 bitrate=12350.4kbitsframe= 1280 fps= 29 q=22.0 size=   76800kB time=00:00:50.81 bitrate=12380.9kbitsframe= 1288 fps= 29 q=22.0 size=   77312kB time=00:00:51.13 bitrate=12385.4kbitsframe= 1295 fps= 29 q=22.0 size=   77824kB time=00:00:51.39 bitrate=12405.3kbitsframe= 1303 fps= 29 q=22.0 size=   78080kB time=00:00:51.73 bitrate=12364.0kbitsframe= 1316 fps= 29 q=22.0 size=   78848kB time=00:00:52.28 bitrate=12353.2kbitsframe= 1331 fps= 29 q=22.0 size=   79872kB time=00:00:52.86 bitrate=12377.3kbitsframe= 1349 fps= 29 q=22.0 size=   80896kB time=00:00:53.56 bitrate=12371.2kbitsframe= 1364 fps= 29 q=22.0 size=   81920kB time=00:00:54.14 bitrate=12394.5kbitsframe= 1379 fps= 29 q=22.0 size=   82944kB time=00:00:54.74 bitrate=12412.5kbitsframe= 1396 fps= 29 q=22.0 size=   83968kB time=00:00:55.38 bitrate=12420.5kbitsframe= 1417 fps= 29 q=22.0 size=   84992kB time=00:00:56.27 bitrate=12371.9kbitsframe= 1438 fps= 29 q=22.0 size=   86016kB time=00:00:57.10 bitrate=12338.5kbitsframe= 1458 fps= 29 q=22.0 size=   87040kB time=00:00:57.92 bitrate=12310.6kbitsframe= 1478 fps= 29 q=22.0 size=   88064kB time=00:00:58.64 bitrate=12301.4kbitsframe= 1498 fps= 29 q=22.0 size=   89088kB time=00:00:59.47 bitrate=12270.4kbits[mp4 @ 0x7ff666813200] Starting second pass: moving the moov atom to the beginning of the file
frame= 1500 fps= 28 q=-1.0 Lsize=   91853kB time=00:00:59.98 bitrate=12543.2kbits/s speed=1.13x    
video:90866kB audio:941kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.049858%
[libx264 @ 0x7ff666814400] frame I:12    Avg QP:18.57  size:116766
[libx264 @ 0x7ff666814400] frame P:426   Avg QP:20.52  size: 87768
[libx264 @ 0x7ff666814400] frame B:1062  Avg QP:23.56  size: 51088
[libx264 @ 0x7ff666814400] consecutive B-frames:  2.5%  6.4%  9.0% 82.1%
[libx264 @ 0x7ff666814400] mb I  I16..4:  1.0% 87.7% 11.3%
[libx264 @ 0x7ff666814400] mb P  I16..4:  0.5% 23.0%  4.2%  P16..4: 25.2% 30.8% 16.1%  0.0%  0.0%    skip: 0.1%
[libx264 @ 0x7ff666814400] mb B  I16..4:  0.1%  1.3%  0.6%  B16..8: 37.5% 21.2%  9.4%  direct:28.6%  skip: 1.4%  L0:31.5% L1:22.8% BI:45.8%
[libx264 @ 0x7ff666814400] 8x8 transform intra:80.8% inter:75.0%
[libx264 @ 0x7ff666814400] coded y,uvDC,uvAC intra: 97.5% 95.0% 63.3% inter: 90.0% 62.4% 12.3%
[libx264 @ 0x7ff666814400] i16 v,h,dc,p: 36% 46%  6% 12%
[libx264 @ 0x7ff666814400] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu: 14% 16% 25%  5%  6%  7%  7%  8% 12%
[libx264 @ 0x7ff666814400] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 10% 29% 12%  6%  7%  6% 10%  7% 13%
[libx264 @ 0x7ff666814400] i8c dc,h,v,p: 36% 30% 20% 14%
[libx264 @ 0x7ff666814400] Weighted P-Frames: Y:29.3% UV:14.1%
[libx264 @ 0x7ff666814400] ref P L0: 39.8% 15.4% 21.2% 19.9%  3.8%
[libx264 @ 0x7ff666814400] ref B L0: 76.4% 19.1%  4.5%
[libx264 @ 0x7ff666814400] ref B L1: 90.7%  9.3%
[libx264 @ 0x7ff666814400] kb/s:12406.19
[aac @ 0x7ff666815c00] Qavg: 181.322


  


• FFMPEG in an AWS Lambda will only output 5 seconds of converted video [duplicate]

  5 juin 2021, par beerandsmiles

  I've been looking for a solution for this issue, but I can't seem to find what's going wrong.

  


  In short, I'm using an AWS Lambda to convert video captured from an raspberry pi in a raw .h264 format to .mp4. The problem is that the output file is always, only 5 seconds long.

  


  So I input a video of say 500mb, that is 10 minutes long, and the output is an mp4 that is exactly the first 5 seconds of the source video.

  


  The lambda has been setup following the tutorial from Amazon that is shown here :
https://aws.amazon.com/blogs/media/processing-user-generated-content-using-aws-lambda-and-ffmpeg/

  


  It is triggered by an upload from one s3 buckets, transcodes, and puts it in a different bucket. The purpose is to store a high quality copy of the video that is smaller to save costs. (this is a personal project, so I'm paying personally)

  


  I've put the full code of the lambda down below.
I had trouble using their recommended stdout method as that resulted in a file being created with a size of 0 bytes.

  


  You'll see a few commented lines where I tried different things to solve it. I thought it best to leave that in while asking the questions so you can see what I've done. Firstly the method of using stdout piped directly into the output S3 did not work, so I stored the output file in lambda's /tmp directory.

  


  However, when I first did this using the signed link as the input it gave me 5 seconds of the input video.

  


  Thinking this had to do with an issue in the stream that FFMPEG was getting, I tried instead to download the file from the first S3 bucket into the temp folder, then convert it, and then upload it.

  


  The actual FFMPEG command is quite simple

  


  f"/opt/bin/ffmpeg -framerate 25 -i {s3_source_key} output.mp4"

  


  But this outputs a 5 second video.

  


  I have also tried using different versions of FFMPEG for the layer with lambda and no help. Also, I have set and execution timeout of 2 minutes with 2gb or ram for this lambda.

  


  The last thing, is that running this command on a linux machine, such as a raspberry pi directly, results in an mp4 of the correct length, only in the lambda am I having this problem.

  


  I'm completely lost, and I can't seem to find any documentation on this happening to anyone else.

  


  import os
import subprocess
import shlex
import boto3
from time import sleep

S3_DESTINATION_BUCKET = "dashcam-duncan"
SIGNED_URL_TIMEOUT = 600

def lambda_handler(event, context):
    print(event)
    os.chdir('/tmp')
    s3_source_bucket = event['Records'][0]['s3']['bucket']['name']
    s3_source_key = event['Records'][0]['s3']['object']['key']

    s3_source_basename = os.path.splitext(os.path.basename(s3_source_key))[0]
    s3_destination_filename = s3_source_basename + ".mp4"

    s3_client = boto3.client('s3')
    s3_source_signed_url = s3_client.generate_presigned_url('get_object',
        Params={'Bucket': s3_source_bucket, 'Key': s3_source_key},
        ExpiresIn=SIGNED_URL_TIMEOUT)
    print(s3_source_signed_url)
    s3_client.download_file(s3_source_bucket,s3_source_key,s3_source_key)
    # ffmpeg_cmd = "/opt/bin/ffmpeg -framerate 25 -i \"" + s3_source_signed_url + "\" output.mp4 "
    ffmpeg_cmd = f"/opt/bin/ffmpeg -framerate 25 -i {s3_source_key} output.mp4 "
    # command1 = shlex.split(ffmpeg_cmd)
    # print(command1)
    os.system(ffmpeg_cmd)
    # os.system('ls')
    # p1 = subprocess.run(command1, stdout=subprocess.PIPE, stderr=subprocess.PIPE)
    file = 'output.mp4'
    resp = s3_client.put_object(Body=open(file,"rb"), Bucket=S3_DESTINATION_BUCKET, Key=s3_destination_filename)
    # resp = s3_client.put_object(Body=p1.stdout, Bucket=S3_DESTINATION_BUCKET, Key=s3_destination_filename)
    s3 = boto3.resource('s3')
    s3.Object(s3_source_bucket,s3_source_key).delete()
    return {
        'statusCode': 200,
        'body': json.dumps('Processing complete successfully')
    }


  


  The cloudwatch logs on the last execution of this :

  


  built with gcc 8 (Debian 8.3.0-6)&#xA;configuration: --enable-gpl --enable-version3 --enable-static --disable-debug --disable-ffplay --disable-indev=sndio --disable-outdev=sndio --cc=gcc --enable-fontconfig --enable-frei0r --enable-gnutls --enable-gmp --enable-libgme --enable-gray --enable-libaom --enable-libfribidi --enable-libass --enable-libvmaf --enable-libfreetype --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-librubberband --enable-libsoxr --enable-libspeex --enable-libsrt --enable-libvorbis --enable-libopus --enable-libtheora --enable-libvidstab --enable-libvo-amrwbenc --enable-libvpx --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxml2 --enable-libdav1d --enable-libxvid --enable-libzvbi --enable-libzimg&#xA;libavutil      56. 70.100 / 56. 70.100&#xA;libavcodec     58.134.100 / 58.134.100&#xA;libavformat    58. 76.100 / 58. 76.100&#xA;libavdevice    58. 13.100 / 58. 13.100&#xA;libavfilter     7.110.100 /  7.110.100&#xA;libswscale      5.  9.100 /  5.  9.100&#xA;libswresample   3.  9.100 /  3.  9.100&#xA;libpostproc    55.  9.100 / 55.  9.100&#xA;Input #0, h264, from &#x27;video00087.h264&#x27;:&#xA;Duration: N/A, bitrate: N/A&#xA;Stream #0:0: Video: h264 (High), yuv420p(progressive), 1280x720, 25 fps, 25 tbr, 1200k tbn, 50 tbc&#xA;Stream mapping:&#xA;Stream #0:0 -> #0:0 (h264 (native) -> h264 (libx264))&#xA;Press [q] to stop, [?] for help&#xA;[libx264 @ 0x6aaf500] using cpu capabilities: MMX2 SSE2Fast SSSE3 SSE4.2 AVX FMA3 BMI2 AVX2&#xA;[libx264 @ 0x6aaf500] profile High, level 3.1, 4:2:0, 8-bit&#xA;[libx264 @ 0x6aaf500] 264 - core 161 r3048 b86ae3c - H.264/MPEG-4 AVC codec - Copyleft 2003-2021 - http://www.videolan.org/x264.html - options: cabac=1 ref=3 deblock=1:0:0 analyse=0x3:0x113 me=hex subme=7 psy=1 psy_rd=1.00:0.00 mixed_ref=1 me_range=16 chroma_me=1 trellis=1 8x8dct=1 cqm=0 deadzone=21,11 fast_pskip=1 chroma_qp_offset=-2 threads=3 lookahead_threads=1 sliced_threads=0 nr=0 decimate=1 interlaced=0 bluray_compat=0 constrained_intra=0 bframes=3 b_pyramid=2 b_adapt=1 b_bias=0 direct=1 weightb=1 open_gop=0 weightp=2 keyint=250 keyint_min=25 scenecut=40 intra_refresh=0 rc_lookahead=40 rc=crf mbtree=1 crf=23.0 qcomp=0.60 qpmin=0 qpmax=69 qpstep=4 ip_ratio=1.40 aq=1:1.00&#xA;Output #0, mp4, to &#x27;output.mp4&#x27;:&#xA;Metadata:&#xA;encoder         : Lavf58.76.100&#xA;Stream #0:0: Video: h264 (avc1 / 0x31637661), yuv420p(progressive), 1280x720, q=2-31, 25 fps, 12800 tbn&#xA;Metadata:&#xA;encoder         : Lavc58.134.100 libx264&#xA;Side data:&#xA;cpb: bitrate max/min/avg: 0/0/0 buffer size: 0 vbv_delay: N/A&#xA;frame=    1 fps=0.0 q=0.0 size=       0kB time=00:00:00.00 bitrate=N/A speed=   0x    &#xA;frame=   47 fps=0.0 q=0.0 size=       0kB time=00:00:00.00 bitrate=N/A speed=   0x    &#xA;frame=   56 fps= 44 q=28.0 size=       0kB time=00:00:00.24 bitrate=   1.6kbits/s speed=0.187x    &#xA;frame=   65 fps= 35 q=28.0 size=       0kB time=00:00:00.60 bitrate=   0.6kbits/s speed=0.325x    &#xA;frame=   74 fps= 31 q=28.0 size=       0kB time=00:00:00.96 bitrate=   0.4kbits/s speed=0.399x    &#xA;Enter command: <target>|all <time>|-1 <command>[ <argument>]&#xA;Parse error, at least 3 arguments were expected, only 1 given in string &#x27;V����Ҿ�#I���bv��oF��LxE��{��y5Jx�X�-f?2k�E~ہ��L��Y?�w���9?S�?�(q?��y��V8�=)�9&#x27;�?�-j?��?�3���Ŧ$��r���\��r}?zb?E��?��B}b4��2��[z�&amp;�逋�Qk�ar�=y���&#x27;&#xA;frame=   82 fps= 28 q=28.0 size=     256kB time=00:00:01.28 bitrate=1638.6kbits/s speed=0.434x    &#xA;frame=   90 fps= 25 q=28.0 size=     256kB time=00:00:01.60 bitrate=1310.9kbits/s speed=0.442x    &#xA;frame=   98 fps= 23 q=28.0 size=     256kB time=00:00:01.92 bitrate=1092.4kbits/s speed=0.458x    &#xA;frame=  107 fps= 23 q=28.0 size=     256kB time=00:00:02.28 bitrate= 919.9kbits/s speed=0.48x    &#xA;frame=  115 fps= 22 q=28.0 size=     512kB time=00:00:02.60 bitrate=1613.3kbits/s speed=0.495x    &#xA;frame=  122 fps= 21 q=28.0 size=     512kB time=00:00:02.88 bitrate=1456.4kbits/s speed=0.499x    &#xA;[h264 @ 0x6b68c80] left block unavailable for requested intra mode&#xA;[h264 @ 0x6b68c80] error while decoding MB 0 19, bytestream 37403&#xA;[h264 @ 0x6b68c80] concealing 2129 DC, 2129 AC, 2129 MV errors in P frame&#xA;video00087.h264: corrupt decoded frame in stream 0&#xA;[h264 @ 0x6ab4080] left block unavailable for requested intra4x4 mode -1&#xA;[h264 @ 0x6ab4080] error while decoding MB 0 37, bytestream 13222&#xA;[h264 @ 0x6ab4080] concealing 689 DC, 689 AC, 689 MV errors in P frame&#xA;video00087.h264: corrupt decoded frame in stream 0&#xA;[h264 @ 0x6b68c80] concealing 1347 DC, 1347 AC, 1347 MV errors in P frame&#xA;frame=  130 fps= 21 q=28.0 size=     512kB time=00:00:03.20 bitrate=1310.8kbits/s speed=0.509x    &#xA;video00087.h264: corrupt decoded frame in stream 0&#xA;frame=  131 fps= 15 q=-1.0 Lsize=    1081kB time=00:00:05.12 bitrate=1729.6kbits/s speed=0.575x    &#xA;video:1079kB audio:0kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.220914%&#xA;[libx264 @ 0x6aaf500] frame I:1     Avg QP:21.61  size: 37761&#xA;[libx264 @ 0x6aaf500] frame P:34    Avg QP:22.25  size: 18066&#xA;[libx264 @ 0x6aaf500] frame B:96    Avg QP:24.46  size:  4706&#xA;[libx264 @ 0x6aaf500] consecutive B-frames:  2.3%  0.0%  0.0% 97.7%&#xA;[libx264 @ 0x6aaf500] mb I  I16..4: 15.2% 61.2% 23.6%&#xA;[libx264 @ 0x6aaf500] mb P  I16..4:  8.4% 15.6%  1.2%  P16..4: 39.2% 13.7%  6.9%  0.0%  0.0%    skip:15.0%&#xA;[libx264 @ 0x6aaf500] mb B  I16..4:  0.7%  1.8%  0.0%  B16..8: 44.5%  4.5%  0.5%  direct: 3.6%  skip:44.4%  L0:46.9% L1:48.0% BI: 5.1%&#xA;[libx264 @ 0x6aaf500] 8x8 transform intra:63.5% inter:83.1%&#xA;[libx264 @ 0x6aaf500] coded y,uvDC,uvAC intra: 22.1% 25.4% 2.8% inter: 11.6% 19.3% 1.2%&#xA;[libx264 @ 0x6aaf500] i16 v,h,dc,p:  4% 63%  8% 25%&#xA;[libx264 @ 0x6aaf500] i8 v,h,dc,ddl,ddr,vr,hd,vl,hu:  9% 26% 53%  1%  2%  1%  3%  1%  3%&#xA;[libx264 @ 0x6aaf500] i4 v,h,dc,ddl,ddr,vr,hd,vl,hu: 16% 44% 16%  4%  4%  3%  5%  4%  4%&#xA;[libx264 @ 0x6aaf500] i8c dc,h,v,p: 66% 24%  9%  1%&#xA;[libx264 @ 0x6aaf500] Weighted P-Frames: Y:0.0% UV:0.0%&#xA;[libx264 @ 0x6aaf500] ref P L0: 57.5% 16.8% 18.2%  7.5%&#xA;[libx264 @ 0x6aaf500] ref B L0: 89.8%  8.0%  2.2%&#xA;[libx264 @ 0x6aaf500] ref B L1: 96.0%  4.0%&#xA;[libx264 @ 0x6aaf500] kb/s:1685.21&#xA;END RequestId: 96e1031a-b1a2-4480-a59d-68de487671bd&#xA;REPORT RequestId: 96e1031a-b1a2-4480-a59d-68de487671bd  Duration: 11721.77 ms   Billed Duration: 11722 ms   Memory Size: 2048 MB    Max Memory Used: 494 MB Init Duration: 353.14 ms&#xA;</argument></command></time></target>

  


  I've been struggling with this for a couple days now, any help would be amazing.