Recherche avancée

Sur d’autres sites (4999)

• ffmpeg filename output format

  10 janvier 2017, par Yuval Adam

  When using ffmpeg to output a series of frames as images, the only format I can find documentation for is frame_%d.jpg. The %d identifier is replaced by the sequential frame count.

  Are there other parameters I can use in the output file format ? Specifically, I need the ability to add the timestamp of the specific frame.

• Setting up audio queue for ffmpeg rtsp stream playing

  20 novembre 2011, par illew

  I'm working on an rtsp streaming(AAC format) client for iOS using ffmpeg. Right now I can only say my app is workable, but the streaming sound is very noisy and even a little distorted, far worse than when it's played by vlc or mplayer.

  The stream is read by av_read_frame(), decoded by avcodec_decode_audio3(). Then I just send the decoded raw audio to Audio Queue.

  When decoding a local aac file with my app, the sound seemed not so noisy at all. I know initial encoding would dramatically affect the result. However at least I should try to have it sounded like other streaming clients...

  Many parts in my implementation/modification actually came from try and error. I believe I'm doing something wrong in setting up Audio Queue, and the callback function for filling Audio Buffer.

  Any hints, suggestions or help are greatly appreciated.

  // —info of test materials dumped by av_dump_format() —

  Metadata:
  
      title           : /demo/test.3gp
  
    Duration: 00:00:30.11, start: 0.000000, bitrate: N/A
  
      Stream #0:0: Audio: aac, 32000 Hz, stereo, s16
  
  aac  Advanced Audio Coding 

  // — the Audio Queue setup procedure —

  - (void) startPlayback
  
  {
  
      OSStatus err = 0;
  
      if(playState.playing) return;
  
  
  
      playState.started = false;
  
  
  
      if(!playState.queue) 
  
      {
  
  
  
          UInt32 bufferSize;
  
  
  
  
  
          playState.format.mSampleRate = _av->audio.sample_rate;
  
          playState.format.mFormatID = kAudioFormatLinearPCM;
  
          playState.format.mFormatFlags = kAudioFormatFlagsCanonical;
  
          playState.format.mChannelsPerFrame = _av->audio.channels_per_frame;
  
          playState.format.mBytesPerPacket = sizeof(AudioSampleType) *_av->audio.channels_per_frame;
  
          playState.format.mBytesPerFrame = sizeof(AudioSampleType) *_av->audio.channels_per_frame;
  
          playState.format.mBitsPerChannel = 8 * sizeof(AudioSampleType);
  
  
  
          playState.format.mFramesPerPacket = 1;        
  
          playState.format.mReserved = 0;
  
  
  
  
  
          pauseStart = 0;
  
          DeriveBufferSize(playState.format,playState.format.mBytesPerPacket,BUFFER_DURATION,&bufferSize,&numPacketsToRead);
  
          err= AudioQueueNewOutput(&playState.format, aqCallback, &playState, NULL, kCFRunLoopCommonModes, 0, &playState.queue);
  
  
  
          if(err != 0)
  
          {
  
              printf("AQHandler.m startPlayback: Error creating new AudioQueue: %d \n", (int)err);
  
          }
  
  
  
          for(int i = 0 ; i < NUM_BUFFERS ; i ++)
  
          {
  
              err = AudioQueueAllocateBufferWithPacketDescriptions(playState.queue, bufferSize, numPacketsToRead , &playState.buffers[i]);
  
  
  
              if(err != 0)
  
                  printf("AQHandler.m startPlayback: Error allocating buffer %d", i);
  
              fillAudioBuffer(&playState,playState.queue, playState.buffers[i]);
  
          }
  
  
  
      }
  
  
  
      startTime = mu_currentTimeInMicros();
  
  
  
      err=AudioQueueStart(playState.queue, NULL);
  
  
  
      if(err)
  
      {
  
  
  
          char sErr[4];
  
          printf("AQHandler.m startPlayback: Could not start queue %ld %s.", err, FormatError(sErr,err));
  
  
  
          playState.playing = NO;
  
      } 
  
      else
  
      {
  
          AudioSessionSetActive(true);
  
          playState.playing = YES;
  
      }           
  
  }

  // — callback for filling audio buffer —

  static int ct = 0;
  
  static void fillAudioBuffer(void *info,AudioQueueRef queue, AudioQueueBufferRef buffer)
  
  {
  
  
  
      int lengthCopied = INT32_MAX;
  
      int dts= 0;
  
      int isDone = 0;
  
  
  
      buffer->mAudioDataByteSize = 0;
  
      buffer->mPacketDescriptionCount = 0;
  
  
  
      OSStatus err = 0;
  
      AudioTimeStamp bufferStartTime;
  
  
  
      AudioQueueGetCurrentTime(queue, NULL, &bufferStartTime, NULL);
  
  
  
  
  
      PlayState *ps = (PlayState *)info;
  
  
  
      if (!ps->started)
  
          ps->started = true;
  
  
  
      while(buffer->mPacketDescriptionCount < numPacketsToRead && lengthCopied > 0)
  
      {
  
          lengthCopied = getNextAudio(_av,
  
                          buffer->mAudioDataBytesCapacity-buffer->mAudioDataByteSize,
  
                          (uint8_t*)buffer->mAudioData+buffeg->mAudioDataByteSize,
  
                          &dts,&isDone);
  
  
  
          ct+= lengthCopied;
  
  
  
          if(lengthCopied < 0 || isDone) 
  
          {
  
              printf("nothing to read....\n\n");
  
              PlayState *ps = (PlayState *)info;
  
              ps->finished = true;
  
              ps->started = false;
  
              break;
  
          }
  
  
  
          if(aqStartDts < 0) aqStartDts = dts;
  
  
  
          if(buffer->mPacketDescriptionCount ==0)
  
          {
  
              bufferStartTime.mFlags = kAudioTimeStampSampleTimeValid;
  
              bufferStartTime.mSampleTime = (Float64)(dts-aqStartDts);//* _av->audio.frame_size;
  
  
  
              if (bufferStartTime.mSampleTime <0 ) 
  
                  bufferStartTime.mSampleTime = 0;
  
  
  
              printf("AQHandler.m fillAudioBuffer: DTS for %x: %lf time base: %lf StartDTS: %d\n", 
  
                      (unsigned int)buffer, 
  
                      bufferStartTime.mSampleTime, 
  
                      _av->audio.time_base, 
  
                      aqStartDts);
  
  
  
          }
  
  
  
          buffer->mPacketDescriptions[buffer->mPacketDescriptionCount].mStartOffset = buffer->mAudioDataByteSize;
  
          buffer->mPacketDescriptions[buffer->mPacketDescriptionCount].mDataByteSize = lengthCopied;
  
  
  
  
  
  
  
          buffer->mPacketDescriptions[buffer->mPacketDescriptionCount].mVariableFramesInPacket = 0;
  
  
  
          buffer->mPacketDescriptionCount++;
  
  
  
          buffer->mAudioDataByteSize += lengthCopied;
  
      }
  
  
  
      int audioBufferCount, audioBufferTotal,  videoBufferCount, videoBufferTotal;
  
      bufferCheck(_av,&videoBufferCount, &videoBufferTotal, &audioBufferCount, &audioBufferTotal);
  
  
  
      if(buffer->mAudioDataByteSize)
  
      {
  
  
  
          err = AudioQueueEnqueueBufferWithParameters(queue, buffer, 0, NULL, 0, 0, 0, NULL, &bufferStartTime, NULL);
  
  
  
          if(err)
  
          {
  
              char sErr[10];
  
              printf("AQHandler.m fillAudioBuffer: Could not enqueue buffer 0x%x: %d %s.", buffer, err, FormatError(sErr, err));
  
  
  
          }
  
  
  
      }
  
  
  
  }
  
  
  
  
  
  
  
  
  
  int getNextAudio(video_data_t* vInst, int maxlength, uint8_t* buf, int* pts, int* isDone) 
  
  {
  
  
  
      struct video_context_t  *ctx = vInst->context;
  
      int    datalength            = 0;
  
  
  
      while(ctx->audio_ring.lock || (ctx->audio_ring.count <= 0 && ((ctx->play_state & STATE_DIE) != STATE_DIE)))
  
      {
  
  
  
          if (ctx->play_state & STATE_EOF) return -1;        
  
          usleep(100);
  
      }
  
  
  
      *pts = 0;
  
      ctx->audio_ring.lock = kLocked;
  
  
  
      if(ctx->audio_ring.count>0 && maxlength > ctx->audio_buffer[ctx->audio_ring.read].size)
  
      {    
  
          memcpy(buf, ctx->audio_buffer[ctx->audio_ring.read].data,ctx->audio_buffer[ctx->audio_ring.read].size);
  
  
  
          *pts = ctx->audio_buffer[ctx->audio_ring.read].pts;
  
  
  
          datalength = ctx->audio_buffer[ctx->audio_ring.read].size;
  
  
  
          ctx->audio_ring.read++;        
  
          ctx->audio_ring.read %= ABUF_SIZE;        
  
          ctx->audio_ring.count--;
  
  
  
      }
  
      ctx->audio_ring.lock = kUnlocked;
  
  
  
      if((ctx->play_state & STATE_EOF) == STATE_EOF && ctx->audio_ring.count == 0) *isDone = 1;
  
  
  
      return datalength;
  
  }

• Methods For Retaining State

  26 décembre 2011, par Multimedia Mike — General, evernote, organization

  I jump around between projects. A lot. Over the years, I have employed various methods for retaining state or context as I switch to a different project. Here’s a quick survey and a general classification of their effectiveness.

  Good

  • Evernote : This is a cloud-based note-taking service that has a web client, Mac and Windows clients, and clients for just about ever mobile platform out there. I have an account and access it via the web interface as as the Windows, iOS, and Android clients. I really like it.

  
  
  

  Okay

  • Series of text files : I have been doing this for a very long time. I have many little note-filled directories here and there that are consistently migrated to new machines but generally forgotten about. This isn’t a terrible method but can be unwieldy when you work on lots of different machines. I’m still tracking down all these directories and importing them into Evernote.

  Bad

  • Layout of desktop windows : I have a habit of working on one project in a set of windows on one desktop space and another project in a second set of windows in another space, etc. Oh, this makes me shudder just thinking about it, mostly because of living in constant fear of a power failure or some other inadvertent reset (darn you, default config’d Windows Update) that wipes the state clean (sure, all of the work might have been saved, but I was relying on those windows to be set up in just the right manner to remind me of all the things I was working on). These days, I force myself to reboot at least once a week so I can’t get too deep into this habit. When it’s time to change projects, I write up exactly what I was doing and where I left off and stick it in Evernote.
  • Open browser windows : I guess it’s common to have many, many tabs open in one’s web browser in this day and age. Like many, I use open tabs as a stack of items to read. The state problem comes when a few of the open tabs represent TODO items. Then I start living in fear that the browser might crash or be restarted in an unexpected way and I struggle to recall what 3-5 important TODO items were that I had opened in separate tabs (on top of a stack of less important items). Again, I try to shut down the browser frequently in order to break this tendency. TODO items are better filed in Evernote.
  • Unsaved data in a text editor : Okay, this is just sloppy on my part, shoving temporary data into a text editor window thinking it’s supremely ephemeral. The problem comes when it’s linked to one of the many tasks on my desktop that might be bumped down a few priority levels ; when finally returning to the context-free data, I’m at a loss to explain what it’s for. Evernote gets it, once more, with a more thorough description of what was going on.
  • Email inbox : I make an effort to ensure that my email inbox has the fewest number of messages possible. Once things are dealt with, they get filed away elsewhere. This implies that things in my inbox require action. Some things have a habit of hanging around, though. Longer items now get described in better detail and filed away in Evernote.
  • Classic paper : Thanks to Derek in the comments for reminding me of this one. Paper is a reliable standby but it can get unwieldy when Post-It Notes litter your work area. Further, it can be problematic when you have multiple physical work areas.
  • Shell history : Another method I rely on entirely too often. This is when I count on a recipe of command line incantations living on in the history buffer of my Unix shell (generally Bash). What sequence of git commands allowed me to do XYZ ? Let’s check the shell history– I sure hope it’s still in there.

  Conclusion
  I guess what I’m trying to say here is that I really like Evernote. If you have similar troubles with retaining state, try it out. I hear there are many other services similar to it with slightly varying feature sets (people rave about Microsoft OneNote). So there are plenty of options and something out there is surely a fit.

  Evernote has a free tier and a premium tier. For my meager note-taking needs, I don’t come anywhere close to the free tier’s limit but I decided to pay for a premium subscription simply because I feel like I derive so much value from the service.

  One downside, however, is that I seem to be doing a lot less blogging since I got on Evernote earlier this year (though it is where I author most of these posts nowadays ; I especially like that I have a notebook labeled “Posted” whose incrementing count reminds me that I am getting some stuff out there). I originally started this blog as a sort of technical journal in order to organize notes and projects in a central location. It’s strange to think that if Evernote existed in 2005, I might never have had a reason to start this blog.