Recherche avancée

Sur d’autres sites (3914)

• Compiling FFmpeg with Libass using MSVC

  2 avril 2019, par maxhap

  First a bit of background.

  I’m trying to compile ffmpeg on windows with the libass extensions/configuration option.

  Using the visual studio project libass-msvc I built libass using Visual Studio as a static lib.

  I then installed MinGW with MSYS and pkg-config. Following the instructions on the ffmpeg MSVC installation guide I configured the environment to build with the MSVC linker and to build in x64.

  When I try to configure libass for compilation using ./configure —enable-libass —toolchain=msvc I get the following error in the log file :

  File not found ass/ass.h

  pkg-config can not find libass

  I have tried the following to fix this.

  1. Create a .pc file for libass and add this to the PKG_CONFIG_PATH environment variable. See file content below. (After doing this pkg-config libass —version prints 0.81, not the right version number but at least something.)

  2. Copy libass .h files into a MinGW/include/ass folder and the .lib file into the MinGW/libs folder.

  3. Add libass include and bin folders to PATH environment variable

  4. Download libass and dependencies source then try to build it using MSYS with MSVC compiler. My aim here was to be able to use "make install" and let MinGW install libass to the correct locations. After hours of trying to fix linker errors, I abandoned this idea as some of the libass dependencies make files only work with the GCC GNU compiler.

  5. Compile libass with GCC GNU using MinGW make/make install then try and install libass using the GNU libs. Again this led to linker errors (I know this was a bad idea but was worth a try).

  6. Tried using extra lib and include build configuration options —extra-cflags="ffmpeg-dir/extra/include" \
     — extra-ldflags="ffmped-dir/extra/ffmpeg_build/lib" then adding the libs and .h files into those locations

  .pc file

  libass.pc:
  
  prefix=/MinGW
  
  includedir=libass-directory/include
  
  libdir=libass-director/x64/bin/
  
  
  
  Name: libass
  
  Description: Libass project
  
  Version: 0.13.7

  I am now completely stuck and out of ideas if anyone could give any insight or suggestions into what I’m doing wrong that would be fantastic.

  Update

  I created INCLUDE and LIBDIR environment path variable containing the libass paths. Which now correctly includes libass. However, I now get the following linker error for the function check_ass_library_init.

  check_func_headers ass/ass.h ass_library_init
  check_ld cc
  check_cc
  BEGIN ./ffconf.RZMYFWdc/test.c
  1 #include
  2 #include
  3 long check_ass_library_init(void) return (long)
  ass_library_init ;
  4 int main(void) int ret = 0 ;
  5 ret |= ((intptr_t)check_ass_library_init) & 0xFFFF ;
  6 return ret ;
  END ./ffconf.RZMYFWdc/test.c
  cl -D_ISOC99_SOURCE -D_FILE_OFFSET_BITS=64 -D_LARGEFILE_SOURCE -
  D_USE_MATH_DEFINES -D_CRT_SECURE_NO_WARNINGS -D_CRT_NONSTDC_NO_WARNINGS -
  D_WIN32_WINNT=0x0502 -nologo -c -Fo./ffconf.RZMYFWdc/test.o
  ./ffconf.RZMYFWdc/test.c
  test.c
  ./ffconf.RZMYFWdc/test.c(3) : warning C4311 : ’type cast’ : pointer truncation
  from ’ASS_Library *(__cdecl *)(void)’ to ’long’
  ./compat/windows/mslink -nologo -out :./ffconf.RZMYFWdc/test.exe
  ./ffconf.RZMYFWdc/test.o psapi.lib advapi32.lib shell32.lib ole32.lib
  test.o : error LNK2019 : unresolved external symbol ass_library_init
  referenced in function check_ass_library_init
  ./ffconf.RZMYFWdc/test.exe : fatal error LNK1120 : 1 unresolved externals
  ERROR : libass not found using pkg-config

  The libass test project which uses ass_library_init compiles fine using the same lib files, the libs appear to be fine.

  From what I see from this line "./compat/windows/mslink -nologo -out:./ffconf.RZMYFWdc/test.exe ./ffconf.RZMYFWdc/test.o psapi.lib advapi32.lib shell32.lib ole32.lib" libass is not being passed to the linker.
  I suspect that the configuration file is not creating the link to libass in the make file when compiling with MSVC.

  Am I correct or am I going about compiling this in the wrong way ?

• libav ffmpeg - streaming from both a mkv and input stream

  20 janvier 2020, par kealist

  I am trying to use ffmpeg libraries in C# with AutoGen bindings. The overall issue is that I am taking a collection of sources, some streams, and some .mkv containing recordings of a stream. As for now, they are all h264 and only video. For input streams, I am able to adjust the packets and broad cast them and that works fine, but any time I try to call av_interleaved_write_frame with packets from the MKV file, I get the error Error occurred: Invalid data found when processing input.

  Here is the main loop, where the error happens for mkv files. Is there an extra step ?

  /* read all packets */
  
  while (true)
  
  {
  
      if ((ret = ffmpeg.av_read_frame(ifmt_ctx, &packet)) < 0)
  
      {
  
          Console.WriteLine("Unable to read packet");
  
          break;
  
      }
  
      stream_index = (uint)packet.stream_index;
  
      type = ifmt_ctx->streams[packet.stream_index]->codecpar->codec_type;
  
      Console.WriteLine($"Demuxer gave frame of stream_index %{stream_index}");
  
  
  
  
  
      /* remux this frame without reencoding */
  
      ffmpeg.av_packet_rescale_ts(&packet,
  
          ifmt_ctx->streams[stream_index]->time_base,
  
          ofmt_ctx->streams[stream_index]->time_base);
  
  
  
      if (packet.stream_index < 0)
  
      {
  
          Console.WriteLine("Packet stream error");
  
      }
  
  
  
  
  
  
  
      ret = ffmpeg.av_write_frame(ofmt_ctx, &packet);
  
      if (ret < 0)
  
      {
  
          goto end;
  
      }
  
      else
  
      {
  
          ffmpeg.av_packet_unref(&packet);
  
      }
  
  }

  Anything need to be different for MKV files ?

  I get some contradictory error output where it claims it is annex b but also isn’t :

  [AVBSFContext @ 00000220eb657080] The input looks like it is Annex B already
  
  Automatically inserted bitstream filter 'h264_mp4toannexb'; args=''
  
  [mpegts @ 00000220ebace300] H.264 bitstream malformed, no startcode found, use the video bitstream filter 'h264_mp4toannexb' to fix it ('-bsf:v h264_mp4toannexb' option with ffmpeg)

  Verbose output from ffplay from an MKV file :

  ffplay version git-2020-01-13-7225479 Copyright (c) 2003-2020 the FFmpeg developers
  
    built with gcc 9.2.1 (GCC) 20200111
  
    configuration: --enable-gpl --enable-version3 --enable-sdl2 --enable-fontconfig --enable-gnutls --enable-iconv --enable-libass --enable-libdav1d --enable-libbluray --enable-libfreetype --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libopus --enable-libshine --enable-libsnappy --enable-libsoxr --enable-libtheora --enable-libtwolame --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxml2 --enable-libzimg --enable-lzma --enable-zlib --enable-gmp --enable-libvidstab --enable-libvorbis --enable-libvo-amrwbenc --enable-libmysofa --enable-libspeex --enable-libxvid --enable-libaom --enable-libmfx --enable-ffnvcodec --enable-cuvid --enable-d3d11va --enable-nvenc --enable-nvdec --enable-dxva2 --enable-avisynth --enable-libopenmpt --enable-amf
  
    libavutil      56. 38.100 / 56. 38.100
  
    libavcodec     58. 65.103 / 58. 65.103
  
    libavformat    58. 35.102 / 58. 35.102
  
    libavdevice    58.  9.103 / 58.  9.103
  
    libavfilter     7. 71.100 /  7. 71.100
  
    libswscale      5.  6.100 /  5.  6.100
  
    libswresample   3.  6.100 /  3.  6.100
  
    libpostproc    55.  6.100 / 55.  6.100
  
  Initialized direct3d renderer.
  
  [h264 @ 00000165ed18d140] Reinit context to 640x480, pix_fmt: yuv444p
  
  Input #0, matroska,webm, from '.\webcam_14_Test1.mkv':   0B f=0/0
  
    Metadata:
  
      ENCODER         : Lavf58.12.100
  
    Duration: 00:00:39.30, start: 0.000000, bitrate: 1943 kb/s
  
      Stream #0:0: Video: h264 (High 4:4:4 Predictive), 1 reference frame, yuv444p(progressive, left), 640x480 [SAR 1:1 DAR 4:3], 1k fps, 30 tbr, 1k tbn, 60 tbc (default)
  
      Metadata:
  
        DURATION        : 00:00:39.299000000
  
  [h264 @ 00000165f424e200] Reinit context to 640x480, pix_fmt: yuv444p
  
  [ffplay_buffer @ 00000165f52ea840] w:640 h:480 pixfmt:yuv444p tb:1/1000 fr:30/1 sar:1/1
  
  [auto_scaler_0 @ 00000165ed1d2c80] w:iw h:ih flags:'bicubic' interl:0
  
  [ffplay_buffersink @ 00000165f424ef00] auto-inserting filter 'auto_scaler_0' between the filter 'ffplay_buffer' and the filter 'ffplay_buffersink'
  
  [auto_scaler_0 @ 00000165ed1d2c80] w:640 h:480 fmt:yuv444p sar:1/1 -> w:640 h:480 fmt:yuv420p sar:1/1 flags:0x4
  
  Created 640x480 texture with SDL_PIXELFORMAT_IYUV.
  
  [AVIOContext @ 00000165ed179a40] Statistics: 9547965 bytes read, 0 seeks

• How do I write to a file in Golang using a pointer to the C data ?

  20 juillet 2020, par nevernew

  I'm writing an app for the windows platform using FFmpeg and it's golang wrapper goav, but I'm having trouble understanding how to use the C pointers to gain access to an array.

  



  I'm trying to write the frame data, pointed to by a uint8 pointer from C, to a .ppm file in golang.

  



  Once I have this done, for proof of concept that FFmpeg is doing what I expect it to, I want to set the frames to a texture in OpenGl to make a video player with cool transitions ; any pointers to do that nice and efficiently would be so very helpful ! I'm guessing I need to write some shader code to draw the ppm as a texture...

  



  The PPM file structure looks pretty simple just the header and then a byte of data for each red, green and blue value of each pixel in the frame from top left to bottom right

  



  I'm starting to understanding how to cast the pointers between C and Go types, but how can I access the data and write it in Go with the same result as C ? In C I just have to set the pointer offset for the data and state how much of it to write :

  



  for (y = 0; y < height; y++) {
    fwrite(pFrame->data[0]+y*pFrame->linesize[0], 1, width*3, pFile);
}


  



  I've stripped out all the relevant parts of the C code, the wrapper and my code, shown below :

  



  C code - libavutil/frame.h

  



  #include 

typedef struct AVFrame {
#define AV_NUM_DATA_POINTERS 8
    uint8_t *data[AV_NUM_DATA_POINTERS];
    int linesize[AV_NUM_DATA_POINTERS];
}


  



  Golang goav wrapper

  



  package avutil&#xA;&#xA;/*&#xA;    #cgo pkg-config: libavutil&#xA;    #include <libavutil></libavutil>frame.h>&#xA;    #include &#xA;*/&#xA;import "C"&#xA;import (&#xA;    "unsafe"&#xA;)&#xA;&#xA;type Frame C.struct_AVFrame&#xA;&#xA;func Data(f *Frame) *uint8 {&#xA;    return (*uint8)(unsafe.Pointer((*C.uint8_t)(unsafe.Pointer(&amp;f.data))))&#xA;}&#xA;func Linesize(f *Frame) int {&#xA;    return int(*(*C.int)(unsafe.Pointer(&amp;f.linesize)))&#xA;}&#xA;

  



  My Golang code

  



  package main

import "github.com/giorgisio/goav/avutil"

func saveFrame(videoFrame *avutil.Frame, width int, height int, iFrame int) {
    var szFilename string
    var y int
    var file *os.File
    var err error

    szFilename = ""

    // Open file
    szFilename = fmt.Sprintf("frame%d.ppm", iFrame)

    if file, err = os.Create(szFilename); err != nil {
        log.Println("Error Reading")
    }

    // Write header
    fh := []byte(fmt.Sprintf("P6\n%d %d\n255\n", width, height))
    file.Write(fh)
    var b byte = 0
    // Write pixel data
    for y = 0; y < height; y++ {
        d := avutil.Data(videoFrame) // d should be a pointer to the first byte of data
        l := avutil.Linesize(videoFrame)

        // I'm basically lost trying to figure out how to correctly write
        // this to a file, the file is created, but when I open it in GIMP
        // the image is mostly black with glitchy fuzz - so it's not being
        // written properly; the header seems to be ok, it knows the height
        // and width at least.

        data := make([]byte, l*3)

        ptr := unsafe.Pointer(d)
        for i := 0; i < l; i++ {
            datum := (*uint8)(unsafe.Pointer(uintptr(ptr) + (uintptr(i)+(uintptr(y)*uintptr(l)))*unsafe.Sizeof(*d)))
            data = append(data, *datum)
            //fmt.Println(*datum)
        }

        n, err := file.Write(data)
        if err != nil {
            log.Println("Error Writing:", szFilename, "-", n)
        }
    }

    file.Close()
}


  



  So, how can I write to a file using a pointer to the data, like you can do in C, and get the same result ?

  



  The first frame should be black so all 0's but I'm getting a glitchy fuzz, so it must be accessing some random data

  



  Update : My fix using a C function to save :

  



  package avutil&#xA;&#xA;/*&#xA;    #cgo pkg-config: libavutil&#xA;    #include <libavutil></libavutil>frame.h>&#xA;    #include &#xA;    #include &#xA;&#xA;    void SaveFrame(const char* location, AVFrame *pFrame, int width, int height) {&#xA;        FILE *pFile;&#xA;        int  y;&#xA;&#xA;        // Open file&#xA;        pFile=fopen(location, "wb");&#xA;        if(pFile==NULL)&#xA;            return;&#xA;&#xA;        // Write header&#xA;        fprintf(pFile, "P6\n%d %d\n255\n", width, height);&#xA;&#xA;        // Write pixel data&#xA;        for(y=0; ydata[0]&#x2B;y*pFrame->linesize[0], 1, width*3, pFile);&#xA;&#xA;        // Close file&#xA;        fclose(pFile);&#xA;    }&#xA;    uint8_t* GetData(AVFrame *pFrame) {&#xA;        return pFrame->data[0];&#xA;    }&#xA;*/&#xA;import "C"&#xA;

  



  I updated the avutil file, in the goav wrapper package, with this save function at the top, then pass it the frame context so it can get the data pointer from it. I also added this Go function to that avutil file to call the C function

  



  func SaveFrame(location string, f *Frame, width int, height int) {
    csLoc := C.CString(location)
    C.SaveFrame(csLoc, (*C.struct_AVFrame)(unsafe.Pointer(f)), C.int(width), C.int(height))
    C.free(unsafe.Pointer(csLoc))
}