Sur d’autres sites (4729)

• Muxing in audio to gstreamer RTMP stream kills both video and Audio

  1er avril 2015, par Adam

  I need some genius help here - I’m trying to set up a live stream for my upcoming wedding... and I have it ALMOST working - audio seems to be the problem.

  This is my setup

  • Raspberry Pi Model B+
  • Logitech C920 (with onboard h264 encoding that I am utilising)
  • on-camera (C920) microphone
  • USB wifi to iPhone 4G connection
  • gstreamer1.0
  • Amazon EC2 Wowza RTMP server

  I have it all set up, but as soon as I mux in the audio, the streams wont play by any player.

  What Works :
  - my gstreamer pipeline WITHOUT the audio muxed in
  - Wowza receives a consistent stream, no failures
  - The various Flash players / iOS / Android and VLC all play back the video

  What doesnt :
  - enabling audio in the mux (using the pipeline below)
  - BUT gstreamer doesnt complain
  - BUT Wowza receives a consistent stream, no failures
  - The various flash players fail to play both Audio and Video. some just display the first video frame
  - VLC plays 1 video frame, and about 100ms of audio, then stops

  Ideally I’d like the muxed audio/video FLV stored on the SD card too in case the network goes down - but if the ’tee’ needs to be sacrificed to make it work, so be it.

  This is my current FAILING pipeline - I assume there’s something really stupid in it because I know practically nothing about gstreamer.... The first frame loads in all the players (except iOS.. which never shows anything)

  # set camera resolution to 720p, and the data format to H264 (alternatives are YUV and JPG)
  
  v4l2-ctl --device=/dev/video0 --set-fmt-video=width=1280,height=720,pixelformat=1
  
  # set the frame rate
  
  v4l2-ctl --device=/dev/video0 --set-parm=10
  
  
  
  gst-launch-1.0 -v -e uvch264src initial-bitrate=300000 average-bitrate=300000 device=/dev/video0 name=src auto-start=true src.vidsrc \
  
                  ! queue \
  
                  ! video/x-h264,width=1280,height=720,framerate=10/1 \
  
                  ! h264parse \
  
                  ! flvmux streamable=true name=mux \
  
                  ! queue \
  
                  ! tee name=t \
  
                  ! queue \
  
                  ! filesink location=/home/pi/wedding.flv t. \
  
                  ! queue \
  
                  ! rtmpsink location='rtmp://wowzaserver/live/wedding live=1' >>/home/pi/wedding.log 2>&1

  Some of the things I can’t really afford to change at this late stage are the encapsulation (FLV) and wowza RTMP because I’ve built everything around that...

  Please Help !! Thanks !

  UPDATE

  Given that I am also saving the FLV file, I have found that if I use ffmpeg to send that FLV file (using audio copy, video copy) to the RTMP server, everything works (but obviously its not live) ! So I am now starting to believe this is a problem with the way Gstreamer encapsulates RTMP - and by putting ffmpeg in the middle it fixes it... but it’s not live of course.
  Is it possible to pipe my output to ffmpeg and using ffmpeg’s RTMP ?

• AWS Lambda function for modify video

  4 février 2017, par Gold Fish

  I want to create a Lambda function that invoked whenever someone uploads to the S3 bucket. The purpose of the function is to take the uploaded file and if its a video file (mp4) so make a new file which is a preview of the last one (using ffmpeg). The Lambda function is written in nodejs.
  I took the code here for reference, but I do something wrong for I get an error saying that no input specified for SetStartTime :

  //dependecies
  
  var async = require('async');
  
  var AWS = require('aws-sdk');
  
  var util = require('util');
  
  var ffmpeg = require('fluent-ffmpeg');
  
  
  
  // get reference to S3 client 
  
  var s3 = new AWS.S3();
  
  
  
  
  
  exports.handler = function(event, context, callback) {
  
      // Read options from the event.
  
      console.log("Reading options from event:\n", util.inspect(event, {depth: 5}));
  
      var srcBucket = event.Records[0].s3.bucket.name;
  
      // Object key may have spaces or unicode non-ASCII characters.
  
      var srcKey    =
  
      decodeURIComponent(event.Records[0].s3.object.key.replace(/\+/g, " "));  
  
      var dstBucket = srcBucket;
  
      var dstKey    = "preview_" + srcKey;
  
  
  
      // Sanity check: validate that source and destination are different buckets.
  
      if (srcBucket == dstBucket) {
  
          callback("Source and destination buckets are the same.");
  
          return;
  
      }
  
  
  
      // Infer the video type.
  
      var typeMatch = srcKey.match(/\.([^.]*)$/);
  
      if (!typeMatch) {
  
          callback("Could not determine the video type.");
  
          return;
  
      }
  
      var videoType = typeMatch[1];
  
      if (videoType != "mp4") {
  
          callback('Unsupported video type: ${videoType}');
  
          return;
  
      }
  
  
  
      // Download the video from S3, transform, and upload to a different S3 bucket.
  
      async.waterfall([
  
          function download(next) {
  
              // Download the video from S3 into a buffer.
  
              s3.getObject({
  
                      Bucket: srcBucket,
  
                      Key: srcKey
  
                  },
  
                  next);
  
              },
  
          function transform(response, next) {
  
          console.log("response.Body:\n", response.Body);
  
          ffmpeg(response.Body)
  
              .setStartTime('00:00:03')
  
              .setDuration('10')   //.output('public/videos/test/test.mp4')
  
          .toBuffer(videoType, function(err, buffer) {
  
                          if (err) {
  
                              next(err);
  
                          } else {
  
                              next(null, response.ContentType, buffer);
  
                          }
  
                   });
  
          },
  
          function upload(contentType, data, next) {
  
              // Stream the transformed image to a different S3 bucket.
  
              s3.putObject({
  
                      Bucket: dstBucket,
  
                      Key: dstKey,
  
                      Body: data,
  
                      ContentType: contentType
  
                  },
  
                  next);
  
              }
  
          ], function (err) {
  
              if (err) {
  
                  console.error(
  
                      'Unable to modify ' + srcBucket + '/' + srcKey +
  
                      ' and upload to ' + dstBucket + '/' + dstKey +
  
                      ' due to an error: ' + err
  
                  );
  
              } else {
  
                  console.log(
  
                      'Successfully modify ' + srcBucket + '/' + srcKey +
  
                      ' and uploaded to ' + dstBucket + '/' + dstKey
  
                  );
  
              }
  
  
  
              callback(null, "message");
  
          }
  
      );
  
  };

  So what am I doing wrong ?

• Rails using stremio-ffmpeg gem to watermark a movie while uploading

  16 juin 2016, par Felix

  I am using carrierwave to upload a movie to amazon s3 that works perfect.

  Now I want to add a watermark to the movie while uploading or after uploading, I don’t know, what’s the best way ?

  I tried this :

  movie_controller.rb action uploadVideo

  movie = FFMPEG::Movie.new(@vid.video.url)
  
  
  
  puts "........................................"
  
  puts movie.inspect
  
  
  
  if @vid.save

  Just to find out if the video is catched from stremio.

  But then I got the error that the movie is not found, the problem is that it doesn’t look in the amazon s3 bucket, it looks on my local server

  No such file or directory - the file '/uploads/tmp/1462954331-3471-8766/VID-20160424-WA0013.mp4' does not exist

  What could be the solution ? or should I do this in carrierwave uploader ?

  UPDATE :

  When I do this after the .save action it looks at amazon s3 bucket .. but also says that the movie isn’t there. But if I call it directly in browser it’s displayed.

  UPDATE Code :

  #Laedt ein Video hoch
  
  def uploadMovie
  
    @user = User.find_by_id session[:user_id]
  
    #Holt alle Channels für die er eine Berechtigung hat (Eingeloggter user)
  
    @user = User.find_by_id session[:user_id]
  
    @knowledgeproviderList = @user.knowledgeprovider
  
    @channels = Channel.where(knowledgeprovider_id:     @knowledgeproviderList.pluck(:id))
  
    @vid = Movie.new(movies_params)
  
    @channel = Channel.find(params[:vid][:channel_id])
  
    @vid.channel = @channel
  
  
  
    #Fügt dem Movie einen Tag hinzu
  
    createTag params
  
    createCategory params
  
  
  
  
  
  
  
    if @vid.save
  
      flash[:notice] = t("flash.saved")
  
  
  
      #movie = FFMPEG::Movie.new(@vid.video.url)
  
  
  
      #puts "........................................"
  
      #puts movie.inspect
  
  
  
      redirect_to :action => :add
  
     else
  
       redirect_to :action => :add
  
    end
  
   end

  Update error :

  movie = FFMPEG::Movie.new(@vid.video.current_path)
  
  
  
  options = {watermark: "mages/header.png", resolution: "640x360", watermark_filter: { position: "RT", padding_x: 10, padding_y: 10 } }
  
  movie.transcode("movie.flv", options)

  

  Update :
  Added the code in the uploader :

    process :watermark_movie
  
  
  
       def watermark_movie
  
         if self.file.path
  
               options = {watermark: "images/header.png", resolution: "640x360", watermark_filter: { position: "RT", padding_x: 10, padding_y: 10 } }
  
               self.model.file = FFMPEG::Movie.new(self.file.path).transcode("#{root}/#{cache_dir}/#{self.cache_id}/file.mp4", options)
  
          end
  
        end

  Error :

  multi_json (1.12.0) lib/multi_json/adapter.rb:19:in `load'
  
  multi_json (1.12.0) lib/multi_json.rb:122:in `load'
  
  streamio-ffmpeg (2.0.0) lib/ffmpeg/movie.rb:28:in `initialize'
  
  app/uploaders/movie_uploader.rb:40:in `new'
  
  app/uploaders/movie_uploader.rb:40:in `watermark_movie'
  
  carrierwave (0.11.2) lib/carrierwave/uploader/processing.rb:84:in `block in process!'
  
  carrierwave (0.11.2) lib/carrierwave/uploader/processing.rb:76:in `each'
  
  carrierwave (0.11.2) lib/carrierwave/uploader/processing.rb:76:in `process!'
  
  carrierwave_backgrounder (0.4.2) lib/backgrounder/delay.rb:14:in `process!'
  
  carrierwave (0.11.2) lib/carrierwave/uploader/callbacks.rb:18:in `block in with_callbacks'
  
  carrierwave (0.11.2) lib/carrierwave/uploader/callbacks.rb:18:in `each'
  
  carrierwave (0.11.2) lib/carrierwave/uploader/callbacks.rb:18:in `with_callbacks'
  
  carrierwave (0.11.2) lib/carrierwave/uploader/cache.rb:134:in `cache!'
  
  carrierwave (0.11.2) lib/carrierwave/mount.rb:329:in `cache'
  
  carrierwave (0.11.2) lib/carrierwave/mount.rb:163:in `video='
  
  carrierwave (0.11.2) lib/carrierwave/orm/activerecord.rb:39:in `video='
  
  activerecord (4.2.1) lib/active_record/attribute_assignment.rb:54:in `public_send'
  
  activerecord (4.2.1) lib/active_record/attribute_assignment.rb:54:in `_assign_attribute'
  
  activerecord (4.2.1) lib/active_record/attribute_assignment.rb:41:in `block in assign_attributes'
  
  actionpack (4.2.1) lib/action_controller/metal/strong_parameters.rb:183:in `each_pair'
  
  actionpack (4.2.1) lib/action_controller/metal/strong_parameters.rb:183:in `each_pair'
  
  activerecord (4.2.1) lib/active_record/attribute_assignment.rb:35:in `assign_attributes'
  
  activerecord (4.2.1) lib/active_record/core.rb:559:in `init_attributes'
  
  activerecord (4.2.1) lib/active_record/core.rb:281:in `initialize'
  
  activerecord (4.2.1) lib/active_record/inheritance.rb:61:in `new'
  
  activerecord (4.2.1) lib/active_record/inheritance.rb:61:in `new'
  
  app/controllers/movies_controller.rb:71:in `uploadMovie'
  
  actionpack (4.2.1) lib/action_controller/metal/implicit_render.rb:4:in `send_action'
  
  actionpack (4.2.1) lib/abstract_controller/base.rb:198:in `process_action'
  
  actionpack (4.2.1) lib/action_controller/metal/rendering.rb:10:in `process_action'
  
  actionpack (4.2.1) lib/abstract_controller/callbacks.rb:20:in `block in process_action'
  
  activesupport (4.2.1) lib/active_support/callbacks.rb:117:in `call'
  
  activesupport (4.2.1) lib/active_support/callbacks.rb:117:in `call'
  
  activesupport (4.2.1) lib/active_support/callbacks.rb:555:in `block (2 levels) in compile'
  
  activesupport (4.2.1) lib/active_support/callbacks.rb:505:in `call'
  
  activesupport (4.2.1) lib/active_support/callbacks.rb:505:in `call'
  
  activesupport (4.2.1) lib/active_support/callbacks.rb:92:in `_run_callbacks'
  
  activesupport (4.2.1) lib/active_support/callbacks.rb:776:in `_run_process_action_callbacks'
  
  activesupport (4.2.1) lib/active_support/callbacks.rb:81:in `run_callbacks'
  
  actionpack (4.2.1) lib/abstract_controller/callbacks.rb:19:in `process_action'
  
  actionpack (4.2.1) lib/action_controller/metal/rescue.rb:29:in `process_action'
  
  actionpack (4.2.1) lib/action_controller/metal/instrumentation.rb:32:in `block in process_action'
  
  activesupport (4.2.1) lib/active_support/notifications.rb:164:in `block in instrument'
  
  activesupport (4.2.1) lib/active_support/notifications/instrumenter.rb:20:in `instrument'
  
  activesupport (4.2.1) lib/active_support/notifications.rb:164:in `instrument'
  
  actionpack (4.2.1) lib/action_controller/metal/instrumentation.rb:30:in `process_action'
  
  actionpack (4.2.1) lib/action_controller/metal/params_wrapper.rb:250:in `process_action'
  
  activerecord (4.2.1) lib/active_record/railties/controller_runtime.rb:18:in `process_action'
  
  actionpack (4.2.1) lib/abstract_controller/base.rb:137:in `process'
  
  actionview (4.2.1) lib/action_view/rendering.rb:30:in `process'
  
  actionpack (4.2.1) lib/action_controller/metal.rb:196:in `dispatch'
  
  actionpack (4.2.1) lib/action_controller/metal/rack_delegation.rb:13:in `dispatch'
  
  actionpack (4.2.1) lib/action_controller/metal.rb:237:in `block in action'
  
  actionpack (4.2.1) lib/action_dispatch/routing/route_set.rb:74:in `call'
  
  actionpack (4.2.1) lib/action_dispatch/routing/route_set.rb:74:in `dispatch'
  
  actionpack (4.2.1) lib/action_dispatch/routing/route_set.rb:43:in `serve'
  
  actionpack (4.2.1) lib/action_dispatch/journey/router.rb:43:in `block in serve'
  
  actionpack (4.2.1) lib/action_dispatch/journey/router.rb:30:in `each'
  
  actionpack (4.2.1) lib/action_dispatch/journey/router.rb:30:in `serve'
  
  actionpack (4.2.1) lib/action_dispatch/routing/route_set.rb:819:in `call'
  
  rack (1.6.4) lib/rack/etag.rb:24:in `call'
  
  rack (1.6.4) lib/rack/conditionalget.rb:38:in `call'
  
  rack (1.6.4) lib/rack/head.rb:13:in `call'
  
  actionpack (4.2.1) lib/action_dispatch/middleware/params_parser.rb:27:in `call'
  
  actionpack (4.2.1) lib/action_dispatch/middleware/flash.rb:260:in `call'
  
  rack (1.6.4) lib/rack/session/abstract/id.rb:225:in `context'
  
  rack (1.6.4) lib/rack/session/abstract/id.rb:220:in `call'
  
  actionpack (4.2.1) lib/action_dispatch/middleware/cookies.rb:560:in `call'
  
  activerecord (4.2.1) lib/active_record/query_cache.rb:36:in `call'
  
  activerecord (4.2.1) lib/active_record/connection_adapters/abstract/connection_pool.rb:649:in `call'
  
  activerecord (4.2.1) lib/active_record/migration.rb:378:in `call'
  
  actionpack (4.2.1) lib/action_dispatch/middleware/callbacks.rb:29:in `block in call'
  
  activesupport (4.2.1) lib/active_support/callbacks.rb:88:in `call'
  
  activesupport (4.2.1) lib/active_support/callbacks.rb:88:in `_run_callbacks'
  
  activesupport (4.2.1) lib/active_support/callbacks.rb:776:in `_run_call_callbacks'
  
  activesupport (4.2.1) lib/active_support/callbacks.rb:81:in `run_callbacks'
  
  actionpack (4.2.1) lib/action_dispatch/middleware/callbacks.rb:27:in `call'
  
  actionpack (4.2.1) lib/action_dispatch/middleware/reloader.rb:73:in `call'
  
  actionpack (4.2.1) lib/action_dispatch/middleware/remote_ip.rb:78:in `call'
  
  actionpack (4.2.1) lib/action_dispatch/middleware/debug_exceptions.rb:17:in `call'
  
  web-console (2.3.0) lib/web_console/middleware.rb:20:in `block in call'
  
  web-console (2.3.0) lib/web_console/middleware.rb:18:in `catch'
  
  web-console (2.3.0) lib/web_console/middleware.rb:18:in `call'
  
  actionpack (4.2.1) lib/action_dispatch/middleware/show_exceptions.rb:30:in `call'
  
  railties (4.2.1) lib/rails/rack/logger.rb:38:in `call_app'
  
  railties (4.2.1) lib/rails/rack/logger.rb:20:in `block in call'
  
  activesupport (4.2.1) lib/active_support/tagged_logging.rb:68:in `block in tagged'
  
  activesupport (4.2.1) lib/active_support/tagged_logging.rb:26:in `tagged'
  
  activesupport (4.2.1) lib/active_support/tagged_logging.rb:68:in `tagged'
  
  railties (4.2.1) lib/rails/rack/logger.rb:20:in `call'
  
  actionpack (4.2.1) lib/action_dispatch/middleware/request_id.rb:21:in `call'
  
  rack (1.6.4) lib/rack/methodoverride.rb:22:in `call'
  
  rack (1.6.4) lib/rack/runtime.rb:18:in `call'
  
  activesupport (4.2.1) lib/active_support/cache/strategy/local_cache_middleware.rb:28:in `call'
  
  rack (1.6.4) lib/rack/lock.rb:17:in `call'
  
  actionpack (4.2.1) lib/action_dispatch/middleware/static.rb:113:in `call'
  
  rack (1.6.4) lib/rack/sendfile.rb:113:in `call'
  
  railties (4.2.1) lib/rails/engine.rb:518:in `call'
  
  railties (4.2.1) lib/rails/application.rb:164:in `call'
  
  rack (1.6.4) lib/rack/lock.rb:17:in `call'
  
  rack (1.6.4) lib/rack/content_length.rb:15:in `call'
  
  rack (1.6.4) lib/rack/handler/webrick.rb:88:in `service'
  
  /home/felix/.rvm/rubies/ruby-2.0.0-p643/lib/ruby/2.0.0/webrick/httpserver.rb:138:in `service'
  
  /home/felix/.rvm/rubies/ruby-2.0.0-p643/lib/ruby/2.0.0/webrick/httpserver.rb:94:in `run'
  
  /home/felix/.rvm/rubies/ruby-2.0.0-p643/lib/ruby/2.0.0/webrick/server.rb:295:in `block in start_thread'

  UPDATE — Movie Uploader

  # encoding: utf-8
  
  class MovieUploader < CarrierWave::Uploader::Base
  
  
  
    # Include RMagick or MiniMagick support:
  
    # include CarrierWave::RMagick
  
    include CarrierWave::MiniMagick
  
    include CarrierWave::Video
  
    include CarrierWave::Video::Thumbnailer
  
    include CarrierWave::Backgrounder::Delay
  
  
  
    require 'rubygems'
  
    require 'streamio-ffmpeg'
  
  
  
    # Choose what kind of storage to use for this uploader:
  
    storage :fog
  
  
  
    # Override the directory where uploaded files will be stored.
  
    # This is a sensible default for uploaders that are meant to be mounted:
  
    def store_dir
  
      "uploads/#{model.class.to_s.underscore}/#{mounted_as}/#{model.id}"
  
    end
  
  
  
    process :watermark_movie
  
  
  
    def watermark_movie
  
      puts "ssssssssssssssssssssssssssssssssss"
  
      puts self.file.inspect
  
  
  
      if self.file.path
  
        options = {watermark: "http://felix-hohlwegler.de/holz-soft/include/designs/design13/images/header.png", resolution: "640x360", watermark_filter: { position: "RT", padding_x: 10, padding_y: 10 } }
  
        self.model.file = FFMPEG::Movie.new(self.file.path).transcode("#{root}/#{cache_dir}/#{self.cache_id}/file.mp4", options)
  
      end
  
    end
  
  
  
    version :thumb do
  
      process thumbnail: [{format: 'png', quality: 10, size: 1200, strip: false, seek: 10, logger: Rails.logger}]
  
      def full_filename for_file
  
        png_name for_file, version_name
  
      end
  
    end
  
  
  
    def png_name for_file, version_name
  
      %Q{#{version_name}_#{for_file.chomp(File.extname(for_file))}.png}
  
    end
  
  
  
  
  
    # Add a white list of extensions which are allowed to be uploaded.
  
    # For images you might use something like this:
  
     def extension_white_list
  
       %w(mov avi mkv mpeg mpeg2 mp4 3gp)
  
     end
  
  end