
Recherche avancée
Médias (1)
-
Revolution of Open-source and film making towards open film making
6 octobre 2011, par
Mis à jour : Juillet 2013
Langue : English
Type : Texte
Autres articles (95)
-
Amélioration de la version de base
13 septembre 2013Jolie sélection multiple
Le plugin Chosen permet d’améliorer l’ergonomie des champs de sélection multiple. Voir les deux images suivantes pour comparer.
Il suffit pour cela d’activer le plugin Chosen (Configuration générale du site > Gestion des plugins), puis de configurer le plugin (Les squelettes > Chosen) en activant l’utilisation de Chosen dans le site public et en spécifiant les éléments de formulaires à améliorer, par exemple select[multiple] pour les listes à sélection multiple (...) -
Contribute to a better visual interface
13 avril 2011MediaSPIP is based on a system of themes and templates. Templates define the placement of information on the page, and can be adapted to a wide range of uses. Themes define the overall graphic appearance of the site.
Anyone can submit a new graphic theme or template and make it available to the MediaSPIP community. -
Support de tous types de médias
10 avril 2011Contrairement à beaucoup de logiciels et autres plate-formes modernes de partage de documents, MediaSPIP a l’ambition de gérer un maximum de formats de documents différents qu’ils soient de type : images (png, gif, jpg, bmp et autres...) ; audio (MP3, Ogg, Wav et autres...) ; vidéo (Avi, MP4, Ogv, mpg, mov, wmv et autres...) ; contenu textuel, code ou autres (open office, microsoft office (tableur, présentation), web (html, css), LaTeX, Google Earth) (...)
Sur d’autres sites (9407)
-
Révision 18200 : Résoud #1442 : Gestion automatisée et généralisée de la sauvegarde automatique e...
7 juillet 2011, par cedric -En pratique, il suffit de fournir dans le charger() d’un CVT un identifiant unique dans _autosave_id pour que le formulaire soit automatiquement sauvegardé quand on quitte la page sans le soumettre. On reprend ce qui a été introduit dans l’extension forum, et on generalise via les pipeline (...)
-
Anomalie #3920 (Nouveau) : sur Sauvegarde SQLite (SPIP 3.1.3 et 3.1.4 mini)
11 mars 2017, par YannX DYXEn SPIP 3 la sauvegarde standard pose parfois des problèmes, que j’ai trop souvent vus...
Cette fois j’ai investigué sur un SPIP 3.1.4 OVH (avec prefix spécifique), toutes les tables ne sont pas sauvegardées, au contraire de la sauvegarde SQL : certes un message existe mais !
- d’une part des tables vides ou non déclarées dans un plugin activé sont omises : pourquoi ?
(encore une fois au contraire de la sauvegarde SQL encore disponible en plugin !)
=> est-il possible d’apporter un lien vers une aide plus détaillée, explicitant les causes possibles ?
(cf. http://forum.spip.net/fr_262960.html & http://forum.spip.net/fr_266342.html par exemple).
- le long libellé affiché<:dump:texte_sauvegarde:>
ne signale aucunement ces aspects et indications ; le lien vers http://www.spip.net/fr_article1489.html est-il encore pertinent (je n’ai jamais tenté une restauration d’une autre version SQLite : comment se passerait une table non déclarée ou non connue dans le SPIP cible ? ) ?
- d’autre part la lecture du message en fin des erreurs est peu explicite à la lecture (cf. ci-dessous),
il me semblerait plus significatif d’afficher :Nombre de tables non sauvegardées : 12/58
- d’ailleurs l’affichage est incorrect, car il n’indique pas le bon préfixe (en cas de préfixe non-standard !!)
(et de ce fait, je vais avouer avoir jusqu’à présent négligé ces erreurs incomprises, et... patatras !)
_ S’il est intéressant de faire une sauvegarde dé-préfixée (ce que j’ai parfois trouvé utile), peut-etre serait-il intéressant de faire apparaitre (dans un commentaire ou une meta) le préfixe d’origine, à titre de documentation !En recherchant de la documentation, je n’ai trouvé que http://www.spip.net/fr_article3418.html qui mériterait peut-etre d’etre complété avec les informations/explications ci-dessus (et leurs conséquences)...
En complément, le site exemple ayant été migré d’anciennes versions SPIP 2, montre encore les anciennes tables@ spip_mots_xx@
je ne me souviens pas d’un plugin qui éliminerait ces anciennes tables résiduelles (pour ceux qui ne savent utiliser phpMyAdmin ou Adminer)... ce qui supprimerait ensuite ces erreurs / voir par exemple sur les forums SPIP) -
ffmpeg : cannot save HLS stream to MKV
15 juillet 2021, par MasterAlerI am trying to achieve something straightforward : writing the code that captures a video stream and saves it into an *.mkv file "as-is" (yeah, no demuxing or reencoding or whatever). Just want to store those
AVPacket
-s and the MKV container looks ready for that.

Note that the question is about ffmpeg library usage, the ffmpeg binary works fine and can be used to save the HLS steam data via the following :

ffmpeg -i https://bitdash-a.akamaihd.net/content/sintel/hls/playlist.m3u8 -c:v copy out.ts

I know that but the goal is to save any (or almost any) stream, thus the MKV. Actually, there is some code that already can save the streams' data, it fails specifically when trying it with HLS.

After some efforts to provide a short but readable MCVE, here's a sample code that reproduces the problem. The focus is on making the output codec work with HLS streams, thus it may lack a lot of things and details, like extra error checks, corner-cases, optimizations, proper timestamp handling, etc.


#include <atomic>
#include 
#include <deque>
#include <functional>
#include <iostream>
#include <memory>
#include <mutex>
#include <thread>

extern "C" {
#include "libavcodec/avcodec.h"
#include "libavfilter/avfilter.h"
#include "libavfilter/buffersink.h"
#include "libavfilter/buffersrc.h"
#include <libavcodec></libavcodec>avcodec.h>
#include <libavdevice></libavdevice>avdevice.h>
#include <libavformat></libavformat>avformat.h>
#include <libswscale></libswscale>swscale.h>
}

// Some public stream. The code works with RTSP, RTMP, MJPEG, etc.
// static const char SOURCE_NAME[] = "http://81.83.10.9:8001/mjpg/video.mjpg"; // works!

// My goal was an actual cam streaming via HLS, but here are some random HLS streams
// that reproduce the problem quite well. Playlists may differ, but the error is exactly the same
static const char SOURCE_NAME[] = "http://qthttp.apple.com.edgesuite.net/1010qwoeiuryfg/sl.m3u8"; // fails!
// static const char SOURCE_NAME[] = "https://bitdash-a.akamaihd.net/content/MI201109210084_1/m3u8s/f08e80da-bf1d-4e3d-8899-f0f6155f6efa.m3u8"; // fails!

using Pkt = std::unique_ptr;
std::deque<pkt> frame_buffer;
std::mutex frame_mtx;
std::condition_variable frame_cv;
std::atomic_bool keep_running{true};

AVCodecParameters *common_codecpar = nullptr;
std::mutex codecpar_mtx;
std::condition_variable codecpar_cv;

void read_frames_from_source(unsigned N)
{
 AVFormatContext *fmt_ctx = avformat_alloc_context();

 int err = avformat_open_input(&fmt_ctx, SOURCE_NAME, nullptr, nullptr);
 if (err < 0) {
 std::cerr << "cannot open input" << std::endl;
 avformat_free_context(fmt_ctx);
 return;
 }

 err = avformat_find_stream_info(fmt_ctx, nullptr);
 if (err < 0) {
 std::cerr << "cannot find stream info" << std::endl;
 avformat_free_context(fmt_ctx);
 return;
 }

 // Simply finding the first video stream, preferrably H.264. Others are ignored below
 int video_stream_id = -1;
 for (unsigned i = 0; i < fmt_ctx->nb_streams; i++) {
 auto *c = fmt_ctx->streams[i]->codecpar;
 if (c->codec_type == AVMEDIA_TYPE_VIDEO) {
 video_stream_id = i;
 if (c->codec_id == AV_CODEC_ID_H264)
 break;
 }
 }

 if (video_stream_id < 0) {
 std::cerr << "failed to find find video stream" << std::endl;
 avformat_free_context(fmt_ctx);
 return;
 }

 { // Here we have the codec params and can launch the writer
 std::lock_guard locker(codecpar_mtx);
 common_codecpar = fmt_ctx->streams[video_stream_id]->codecpar;
 }
 codecpar_cv.notify_all();

 unsigned cnt = 0;
 while (++cnt <= N) { // we read some limited number of frames
 Pkt pkt{av_packet_alloc(), [](AVPacket *p) { av_packet_free(&p); }};

 err = av_read_frame(fmt_ctx, pkt.get());
 if (err < 0) {
 std::cerr << "read packet error" << std::endl;
 continue;
 }

 // That's why the cycle above, we write only one video stream here
 if (pkt->stream_index != video_stream_id)
 continue;

 {
 std::lock_guard locker(frame_mtx);
 frame_buffer.push_back(std::move(pkt));
 }
 frame_cv.notify_one();
 }

 keep_running.store(false);
 avformat_free_context(fmt_ctx);
}

void write_frames_into_file(std::string filepath)
{
 AVFormatContext *out_ctx = nullptr;
 int err = avformat_alloc_output_context2(&out_ctx, nullptr, "matroska", filepath.c_str());
 if (err < 0) {
 std::cerr << "avformat_alloc_output_context2 failed" << std::endl;
 return;
 }

 AVStream *video_stream = avformat_new_stream(out_ctx, avcodec_find_encoder(common_codecpar->codec_id)); // the proper way
 // AVStream *video_stream = avformat_new_stream(out_ctx, avcodec_find_encoder(AV_CODEC_ID_H264)); // forcing the H.264
 // ------>> HERE IS THE TROUBLE, NO CODEC WORKS WITH HLS <<------

 int video_stream_id = video_stream->index;

 err = avcodec_parameters_copy(video_stream->codecpar, common_codecpar);
 if (err < 0) {
 std::cerr << "avcodec_parameters_copy failed" << std::endl;
 }

 if (!(out_ctx->flags & AVFMT_NOFILE)) {
 err = avio_open(&out_ctx->pb, filepath.c_str(), AVIO_FLAG_WRITE);
 if (err < 0) {
 std::cerr << "avio_open fail" << std::endl;
 return;
 }
 }

 err = avformat_write_header(out_ctx, nullptr); // <<--- ERROR WITH HLS HERE
 if (err < 0) {
 std::cerr << "avformat_write_header failed" << std::endl;
 return; // here we go with hls
 }

 unsigned cnt = 0;
 while (true) {
 std::unique_lock locker(frame_mtx);
 frame_cv.wait(locker, [&] { return !frame_buffer.empty() || !keep_running; });

 if (!keep_running)
 break;

 Pkt pkt = std::move(frame_buffer.front());
 frame_buffer.pop_front();
 ++cnt;
 locker.unlock();

 pkt->stream_index = video_stream_id; // mandatory
 err = av_write_frame(out_ctx, pkt.get());
 if (err < 0) {
 std::cerr << "av_write_frame failed " << cnt << std::endl;
 } else if (cnt % 25 == 0) {
 std::cout << cnt << " OK" << std::endl;
 }
 }

 av_write_trailer(out_ctx);
 avformat_free_context(out_ctx);
}

int main()
{
 std::thread reader(std::bind(&read_frames_from_source, 1000));
 std::thread writer;

 // Writer wont start until reader's got AVCodecParameters
 // In this example it spares us from setting writer's params properly manually

 { // Waiting for codec params to be set
 std::unique_lock locker(codecpar_mtx);
 codecpar_cv.wait(locker, [&] { return common_codecpar != nullptr; });
 writer = std::thread(std::bind(&write_frames_into_file, "out.mkv"));
 }

 reader.join();
 keep_running.store(false);
 writer.join();

 return 0;
}

</pkt></thread></mutex></memory></iostream></functional></deque></atomic>


What happens here ? Simply put :


- 

- Two threads are spawned, one reads packets from source and stores them in a buffer
- The writer waits for the reader to get the
AVCodecParameters
, so that you can see they are the same being used, almost no manual param setting here - The reader is supposed to read N packets and finish, then the writer follows him. That's how it works with RTSP, RTMP, MJPEG, etc.








What's the problem ? Once an HLS stream is tried, there goes the following error :




Tag [27][0][0][0] incompatible with output codec id '27' (H264)




After that
the writer segfaults on any write attempt via it's context (that isavformat_write_header
here)avformat_write_header
fails with an error (see UPD2 below) and thus no successfull write operation is possible.

What's been tried :


- 

- Forcing arbitrary codecs (ex. :
AV_CODEC_ID_H264
). No luck there. - Trying the
AV_CODEC_ID_MPEGTS
. No way, it's documented as a "fake" codec for internal needs. - Switching some of the multiple options for input or output contexts, no luck there








I'm currenly confused a lot 'coz the error sounds like "Tag H264 is not compatible with codec H264". The ffmpeg logs look like the library managed to comprehend it's dealing with MPEG-TS being sent via HLS, reading is fine but writing into the chosen media container fails :


[hls @ 0x7f94b0000900] Opening 'https://bitdash-a.akamaihd.net/content/MI201109210084_1/video/540_1200000/hls/segment_0.ts' for reading
[hls @ 0x7f94b0000900] Opening 'https://bitdash-a.akamaihd.net/content/MI201109210084_1/video/540_1200000/hls/segment_1.ts' for reading
[hls @ 0x7f94b0000900] Opening 'https://bitdash-a.akamaihd.net/content/MI201109210084_1/video/720_2400000/hls/segment_0.ts' for reading
[hls @ 0x7f94b0000900] Opening 'https://bitdash-a.akamaihd.net/content/MI201109210084_1/video/720_2400000/hls/segment_1.ts' for reading
[hls @ 0x7f94b0000900] Opening 'https://bitdash-a.akamaihd.net/content/MI201109210084_1/video/1080_4800000/hls/segment_0.ts' for reading
[hls @ 0x7f94b0000900] Opening 'https://bitdash-a.akamaihd.net/content/MI201109210084_1/video/1080_4800000/hls/segment_1.ts' for reading
[hls @ 0x7f94b0000900] Could not find codec parameters for stream 0 (Audio: aac ([15][0][0][0] / 0x000F), 0 channels, 112 kb/s): unspecified sample rate
Consider increasing the value for the 'analyzeduration' and 'probesize' options
[matroska @ 0x7f94a8000900] Tag [27][0][0][0] incompatible with output codec id '27' (H264)
avformat_write_header failed
Segmentation fault (core dumped)



No hard googling helped, I'm a bit desperate.

Plz, share your ideas, would be grateful for any.

UPD


- 

ffmpeg -i https://bitdash-a.akamaihd.net/content/sintel/hls/playlist.m3u8 out.mkv
works fineffmpeg -i http://qthttp.apple.com.edgesuite.net/1010qwoeiuryfg/sl.m3u8 -c:v copy out.mkv
also works fine






... which means ffmpeg can do the trick and the desired result can be achieved


UPD2


It occured that the tag error can be suppressed via

out_ctx->strict_std_compliance = FF_COMPLIANCE_UNOFFICIAL;

I assume it's smth about spelling the "h264" properly in a string tag, doesn't look serious.

Also, after a closer look it occured that it's
av_write_frame
that actually segfaults. No wonder — with HLS streamsavformat_write_header
fails and returns error :



Invalid data found when processing input




That still leaves me with no clues, where's the problem here =((