Sur d’autres sites (4161)

• How to use ffmpeg in JavaScript to decode H.264 frames into RGB frames

  17 juin 2020, par noel

  I'm trying to compile ffmpeg into javascript so that I can decode H.264 video streams using node. The streams are H.264 frames packed into RTP NALUs so any solution has to be able to accept H.264 frames rather than a whole file name. These frames can't be in a container like MP4 or AVI because then the demuxer needs to needs the timestamp of every frame before demuxing can occur, but I'm dealing with a real time stream, no containers.

  



  Streaming H.264 over RTP

  



  Below is the basic code I'm using to listen on a udp socket. Inside the 'message' callback the data packet is an RTP datagram. The data portion of the data gram is an H.264 frame (P-frames and I-frames).

  



  var PORT = 33333;
var HOST = '127.0.0.1';

var dgram = require('dgram');
var server = dgram.createSocket('udp4');

server.on('listening', function () {
    var address = server.address();
    console.log('UDP Server listening on ' + address.address + ":" + address.port);
});

server.on('message', function (message, remote) {
    console.log(remote.address + ':' + remote.port +' - ' + message);
    frame = parse_rtp(message);

    rgb_frame = some_library.decode_h264(frame); // This is what I need.

});

server.bind(PORT, HOST);  


  



  I found the Broadway.js library, but I couldn't get it working and it doesn't handle P-frames which I need. I also found ffmpeg.js, but could get that to work and it needs a whole file not a stream. Likewise, fluent-ffmpeg doesn't appear to support file streams ; all of the examples show a filename being passed to the constructor. So I decided to write my own API.

  



  My current solution attempt

  



  I have been able to compile ffmpeg into one big js file, but I can't use it like that. I want to write an API around ffmpeg and then expose those functions to JS. So it seems to me like I need to do the following :

  



  

  1. Compile ffmpeg components (avcodec, avutil, etc.) into llvm bitcode.

  


  2. Write a C wrapper that exposes the decoding functionality and uses EMSCRIPTEN_KEEPALIVE.

  


  3. Use emcc to compile the wrapper and link it to the bitcode created in step 1.

  


  



  I found WASM+ffmpeg, but it's in Chinese and some of the steps aren't clear. In particular there is this step :

  



  emcc web.c process.c ../lib/libavformat.bc ../lib/libavcodec.bc ../lib/libswscale.bc ../lib/libswresample.bc ../lib/libavutil.bc \


  



   :( Where I think I'm stuck

  



  I don't understand how all the ffmpeg components get compiled into separate *.bc files. I followed the emmake commands in that article and I end up with one big .bc file.

  



  2 questions

  



  1. Does anyone know the steps to compile ffmpeg using emscripten so that I can expose some API to javascript ?
  
 2. Is there a better way (with decent documentation/examples) to decode h264 video streams using node ?

  


• i am getting when i am trying to run Ffmpegrabberframe on alpine image [closed]

  18 mars 2020, par avinash tiwari

  # # A fatal error has been detected by the Java Runtime Environment :

  # SIGSEGV (0xb) at pc=0x000000000000dc56, pid=446, tid=0x00007fd3c478db20 # # JRE version : OpenJDK Runtime Environment

  (8.0_242-b08) (build 1.8.0_242-b08) # Java VM : OpenJDK 64-Bit Server
  VM (25.242-b08 mixed mode linux-amd64 compressed oops) # Derivative :
  IcedTea 3.15.0 # Distribution : Custom build (Wed Jan 29 10:43:50 UTC
  2020) # Problematic frame : # C 0x000000000000dc56 # # Failed to
  write core dump. Core dumps have been disabled. To enable core
  dumping, try "ulimit -c unlimited" before starting Java again # # An
  error report file with more information is saved as : #
  /builds/had/tip/asset-delivery/firstgen-ingestion---backend/hs_err_pid446.log

  # If you would like to submit a bug report, please include # instructions on how to reproduce the bug and visit : #

  https://icedtea.classpath.org/bugzilla # Exception in thread
  "Thread-8" java.io.EOFException at
  java.io.ObjectInputStream$BlockDataInputStream.peekByte(ObjectInputStream.java:3015)
  at java.io.ObjectInputStream.readObject0(ObjectInputStream.java:1576)
  at java.io.ObjectInputStream.readObject(ObjectInputStream.java:465)
  at java.io.ObjectInputStream.readObject(ObjectInputStream.java:423)
  at
  org.scalatest.tools.Framework$ScalaTestRunner$Skeleton$1$React.react(Framework.scala:818)
  at
  org.scalatest.tools.Framework$ScalaTestRunner$Skeleton$1.run(Framework.scala:807)

  def extractAVI(rawDrivePath: String): List[String] = {
  
      var errorList: List[String] = List.empty
  
      FileUtils.listFiles(new File(rawDrivePath), new SuffixFileFilter(".avi"), TrueFileFilter.INSTANCE)
  
        .asScala.toList.foreach(aviFile => {
  
        var grabber: FFmpegFrameGrabber = null
  
        var aviStream: InputStream = null
  
        var isFailedExtraction: Boolean = false
  
        try {
  
          LOGGER.info(s"--------inside try----------${aviFile.getAbsolutePath}")
  
          aviStream = new FileInputStream(aviFile.getAbsolutePath)
  
          LOGGER.info("--------create grabber----------")
  
          grabber = new FFmpegFrameGrabber(aviStream)
  
          LOGGER.info("--------created grabber extraction of drives----------")
  
          grabber.start()
  
          LOGGER.info("--------start grabber of drives----------")
  
          var count: Int = 1
  
          for (frame <- Iterator.continually(grabber.grabImage()).takeWhile(_ != null)) {
  
            ImageIO.write(converter.convert(frame), "jpg", new File(aviFile.getParent, "capture-" + count + ".jpg"))
  
            count += 1
  
          }
  
          grabber.stop()
  
        } catch {
  
          case ex: Exception => {
  
            LOGGER.info(s"Error while extracting images for ${aviFile.getAbsolutePath} {}", ex)
  
            errorList :+= s"${aviFile.getAbsolutePath.replace(rawDrivePath, "")} -> ${ex.getMessage}"
  
            isFailedExtraction = true
  
            LOGGER.info("last inside catch")
  
          }
  
        } finally {
  
          // Close the video file
  
          LOGGER.info(s"inside finally ")
  
          if (grabber != null)
  
            grabber.release()
  
          if (aviStream != null)
  
            aviStream.close()
  
          if (aviFile.exists() && !isFailedExtraction) {
  
            LOGGER.debug(s"Deleting ${aviFile.getAbsolutePath}")
  
            FileUtils.deleteQuietly(aviFile)
  
          }
  
        }
  
      })

• Stopping Referrer Spam

  13 mai 2015, par Piwik Core Team — Community

  In this blog post we explain what is Referrer spam, this new kind of spam that has recently appeared on the Internet. We also provide solutions to stop it and preserve the quality of your analytics data.

  What is Referrer Spam ?

  Referrer spam (also known as log spam or referrer bombing) is a kind of spamming aimed at web analytics tools. A spammer bot makes repeated web site requests using a fake referrer URL to the site the spammer wishes to advertise.

  Here is an example of referrer spam in action :

  

  Half of those referrers are spams, here are some well know spammers that you may have seen in your logs : buttons-for-you-website.com, best-seo-offer.com, semalt.com…

  The benefit for spammers is that their website will appear in analytics tools like Piwik or Google Analytics :

  • public analytics reports (or logs) will be indexed by search engines : links to the spammer’s website will improve its ranking
  • curious webmasters are likely to visit their referrers, thus bringing traffic to the spammer’s website

  How to deal with Referrer Spam ?

  Referrer spam is still new and analytics tools are all handling it differently.

  Referrer Spam in Piwik

  At Piwik we started working on mitigating Referrer spam more than a year ago. If you use Piwik and keep it up to date, you do not need to do anything.

  Referrer spammers are automatically excluded from your reports to keep your data clean and useful.

  New spammers are continuously detected and added to Piwik’s blacklist on each update. If you find a new spammer in your analytics data, you can even report it so that it is added to the Piwik’s open referrer blacklist and blocked for everyone.

  Referrer Spam in Google Analytics

  Google Analytics doesn’t offer any spam protection by default. It can however be configured manually using a custom Filter.

  To create a filter in Google Analytics go to the Admin section and click on All Filters. Create a new custom filter that excludes based on the Campaign Source field. In the Filter pattern enter the spammers domains you want to exclude (this is a regular expression) :

  

  If new spammers arise you will need to update this list. You can also use Piwik’s referrer blacklist to exclude all the spammers currently detected.

  Other Analytics Tools

  Many web analytics tools do not yet handle Referrer spam and when using these tools, you will often find a lot of spam data in your Referrer Websites analytics reports.

  If you use an analytics tool that does not exclude Referrer spam, we recommend to contact the vendor and ask them to implement a mechanism to remove these referrer spammers. As of today many analytics vendors still have not mitigated this issue.

  Public List of Referrer Spammers

  At Piwik with the help of our large community we have decided to tackle this growing spam issue. We have created a list of up to date referrer spammers that anyone can edit.

  The list is available in a simple text file on Github : github.com/piwik/referrer-spam-blacklist.

  The list is released under the Public Domain and anyone can use it within their applications to exclude referrer spammers.

  Many people have already contributed new spammers to the list. We invite you to use the list in your apps and websites and help us keep the list up to date !

  Let’s unite and fight the spammers together.

  Happy Analytics !