
Recherche avancée
Autres articles (48)
-
Supporting all media types
13 avril 2011, parUnlike most software and media-sharing platforms, MediaSPIP aims to manage as many different media types as possible. The following are just a few examples from an ever-expanding list of supported formats : images : png, gif, jpg, bmp and more audio : MP3, Ogg, Wav and more video : AVI, MP4, OGV, mpg, mov, wmv and more text, code and other data : OpenOffice, Microsoft Office (Word, PowerPoint, Excel), web (html, CSS), LaTeX, Google Earth and (...)
-
List of compatible distributions
26 avril 2011, parThe table below is the list of Linux distributions compatible with the automated installation script of MediaSPIP. Distribution nameVersion nameVersion number Debian Squeeze 6.x.x Debian Weezy 7.x.x Debian Jessie 8.x.x Ubuntu The Precise Pangolin 12.04 LTS Ubuntu The Trusty Tahr 14.04
If you want to help us improve this list, you can provide us access to a machine whose distribution is not mentioned above or send the necessary fixes to add (...) -
Gestion des droits de création et d’édition des objets
8 février 2011, parPar défaut, beaucoup de fonctionnalités sont limitées aux administrateurs mais restent configurables indépendamment pour modifier leur statut minimal d’utilisation notamment : la rédaction de contenus sur le site modifiables dans la gestion des templates de formulaires ; l’ajout de notes aux articles ; l’ajout de légendes et d’annotations sur les images ;
Sur d’autres sites (3012)
-
ffmpeg Transcoding Stops After Few Seconds [migrated]
15 avril 2018, par Salem FI’m trying to do this over week now with no success,
What’s I’m trying to do is transcoding video from live streaming source and downscale it with FFmpeg, but every time I start transcoding it broadcasting for 11 sec and stop.The last command I tried :
ffmpeg -re -i 'http://source.com/1034.ts' -preset ultrafast http://localhost:2052/feed1.ffm
I tried to download the .ts file with IDM and it finish downloading the file on the exact 12 Sec that FFmpeg stop trans coding on it.
Does that means that FFmpeg download that file as one segment and not continued reading the source video As what video players does usually. By the way, I tried with source with VLC player and it didn’t stop playing the the same source video.
I decided to pass FFmpeg command via FFserver config file
ffserver.conf
Launch ffmpeg -i 'http://source.com/1.ts' -copyinkf -codec copy
The stream works fine for a while but after testing couple sources I notice it’s struggle to trans-coding HD videos.
I guess the issue with my VPS KVM server being very limited CPU and RAM ( 128MB only) ! Since I tried using
ultrafast
preset but din’t solve the issue, another thing, I notice when I enableAVOptionVideo crf
setting onffserver.conf
trans-coding runs bit smoothly without frame-rate dropping.
Las my server usesXeon L5520
CPU which is outdated CPU specially I gout 1/4 power of V single core (if they count HT it will be 1/8 of the real core) : (# vlc -I dummy 'https://source.com/1034.ts' --sout '#standard{access=http,mux=flv,dst=localhost:2052}'
VLC media player 2.2.8 Weatherwax (revision 2.2.7-14-g3cc1d8cba9)
[09d3fdf0] pulse audio output error: PulseAudio server connection failure: Connection refused
[09d279c0] core interface error: no suitable interface module
[09c9b8f8] core libvlc error: interface "globalhotkeys,none" initialization failed
[09d279c0] dbus interface error: Failed to connect to the D-Bus session daemon: Unable to autolaunch a dbus-daemon without a $DISPLAY for X11
[09d279c0] core interface error: no suitable interface module
[09c9b8f8] core libvlc error: interface "dbus,none" initialization failed
[09d279c0] dummy interface: using the dummy interface module...
[b5e04ae0] access_output_http access out: Consider passing --http-host=IP on the command line instead.
[b5e38ab8] ts demux: MPEG-4 descriptor not found for pid 0x101 type 0xf
[b5e90ae0] packetizer_mpeg4audio decoder: AAC channels: 2 samplerate: 48000
[flv @ 0xb5e33b40] dimensions not set
[b5e06360] avformat mux error: could not write header: Invalid argument
[b5e88ef0] core decoder error: cannot continue streaming due to errors
[b5e90ae0] core decoder error: cannot continue streaming due to errorsHere output with
-loglevel verbose
:~# ffmpeg -i http://source.com/1.ts -copyinkf -codec copy -loglevel verbose http://127.0.0.1:8090/feed1.ffm
ffmpeg version 2.6.9 Copyright (c) 2000-2016 the FFmpeg developers
built with gcc 4.9.2 (Debian 4.9.2-10)
configuration: --prefix=/usr --extra-cflags='-g -O2 -fstack-protector-strong -Wformat -Werror=format-security ' --extra-ldflags='-Wl,-z,relro' --cc='ccache cc' --enable-shared --enable-libmp3lame --enable-gpl --enable-nonfree --enable-libvorbis --enable-pthreads --enable-libfaac --enable-libxvid --enable-postproc --enable-x11grab --enable-libgsm --enable-libtheora --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libx264 --enable-libspeex --enable-nonfree --disable-stripping --enable-libvpx --enable-libschroedinger --disable-encoder=libschroedinger --enable-version3 --enable-libopenjpeg --enable-librtmp --enable-avfilter --enable-libfreetype --enable-libvo-aacenc --disable-decoder=amrnb --enable-libvo-amrwbenc --enable-libaacplus --libdir=/usr/lib/i386-linux-gnu --disable-vda --enable-libbluray --enable-libcdio --enable-gnutls --enable-frei0r --enable-openssl --enable-libass --enable-libopus --enable-fontconfig --enable-libpulse --disable-mips32r2 --disable-mipsdspr1 --disable-mipsdspr2 --enable-libvidstab --enable-libzvbi --enable-avresample --disable-htmlpages --disable-podpages --enable-libutvideo --enable-libfdk-aac --enable-libx265 --enable-libiec61883 --enable-vaapi --enable-libdc1394 --disable-altivec --shlibdir=/usr/lib/i386-linux-gnu
libavutil 54. 20.100 / 54. 20.100
libavcodec 56. 26.100 / 56. 26.100
libavformat 56. 25.101 / 56. 25.101
libavdevice 56. 4.100 / 56. 4.100
libavfilter 5. 11.102 / 5. 11.102
libavresample 2. 1. 0 / 2. 1. 0
libswscale 3. 1.101 / 3. 1.101
libswresample 1. 1.100 / 1. 1.100
libpostproc 53. 3.100 / 53. 3.100
Invalid UE golomb code
Last message repeated 2 times
Input #0, mpegts, from 'http://source.com/1.ts':
Duration: N/A, start: 30472.768167, bitrate: N/A
Program 1
Metadata:
service_name : Service01
service_provider: FFmpeg
Stream #0:0[0x100]: Video: h264 (High) ([27][0][0][0] / 0x001B), yuv420p, 960x540 (960x544) [SAR 1:1 DAR 16:9], 50 fps, 50 tbr, 90k tbn, 100 tbc
Stream #0:1[0x101]: Audio: aac (LC) ([15][0][0][0] / 0x000F), 48000 Hz, stereo, fltp, 105 kb/s
[graph 0 input from stream 0:1 @ 0x971f2c0] tb:1/48000 samplefmt:fltp samplerate:48000 chlayout:0x3
[audio format for output stream 0:0 @ 0x9844de0] auto-inserting filter 'auto-inserted resampler 0' between the filter 'Parsed_anull_0' and the filter 'audio format for output stream 0:0'
[auto-inserted resampler 0 @ 0x97115e0] ch:2 chl:stereo fmt:fltp r:48000Hz -> ch:1 chl:mono fmt:fltp r:22050Hz
[graph 1 input from stream 0:0 @ 0x96f5d00] w:960 h:540 pixfmt:yuv420p tb:1/90000 fr:50/1 sar:1/1 sws_param:flags=2
[scaler for output stream 0:1 @ 0x96f5e80] w:352 h:240 flags:'0x4' interl:0
[scaler for output stream 0:1 @ 0x96f5e80] w:960 h:540 fmt:yuv420p sar:1/1 -> w:352 h:240 fmt:yuv420p sar:40/33 flags:0x4
Output #0, ffm, to 'http://127.0.0.1:8090/feed1.ffm':
Metadata:
creation_time : now
encoder : Lavf56.25.101
Stream #0:0: Audio: wmav2, 22050 Hz, mono, fltp, 64 kb/s
Metadata:
encoder : Lavc56.26.100 wmav2
Stream #0:1: Video: msmpeg4v3 (msmpeg4), yuv420p, 352x240 [SAR 40:33 DAR 16:9], q=2-31, 256 kb/s, 50 fps, 1000k tbn, 15 tbc
Metadata:
encoder : Lavc56.26.100 msmpeg4
Stream mapping:
Stream #0:1 -> #0:0 (aac (native) -> wmav2 (native))
Stream #0:0 -> #0:1 (h264 (native) -> msmpeg4v3 (msmpeg4))
Press [q] to stop, [?] for help
Invalid UE golomb code
*** dropping frame 3 from stream 1 at ts 1
Last message repeated 1 times
[msmpeg4 @ 0x970f060] warning, clipping 1 dct coefficients to -127..127
*** dropping frame 4 from stream 1 at ts 2
Last message repeated 1 times
*** dropping frame 5 from stream 1 at ts 3
Last message repeated 1 times
*** dropping frame 5 from stream 1 at ts 4
*** dropping frame 6 from stream 1 at ts 4
Last message repeated 1 times
*** dropping frame 7 from stream 1 at ts 5
Last message repeated 1 times
[msmpeg4 @ 0x970f060] warning, clipping 1 dct coefficients to -127..127
*** dropping frame 8 from stream 1 at ts 6
Last message repeated 1 times
*** dropping frame 8 from stream 1 at ts 7
*** dropping frame 9 from stream 1 at ts 7
Last message repeated 1 times
*** dropping frame 10 from stream 1 at ts 8
Last message repeated 1 times
*** dropping frame 11 from stream 1 at ts 9
Last message repeated 1 times
*** dropping frame 11 from stream 1 at ts 10
*** dropping frame 12 from stream 1 at ts 10
Last message repeated 1 times
*** dropping frame 13 from stream 1 at ts 11
Last message repeated 1 times
*** dropping frame 14 from stream 1 at ts 12
Last message repeated 1 times
*** dropping frame 14 from stream 1 at ts 13
*** dropping frame 15 from stream 1 at ts 13
Last message repeated 1 times
*** dropping frame 16 from stream 1 at ts 14
Last message repeated 1 times
*** dropping frame 17 from stream 1 at ts 15
Last message repeated 1 times
*** dropping frame 17 from stream 1 at ts 16
*** dropping frame 18 from stream 1 at ts 16
Last message repeated 1 times
*** dropping frame 19 from stream 1 at ts 17
Last message repeated 1 times
*** dropping frame 20 from stream 1 at ts 18me=00:00:01.33 bitrate= 270.3kbits/s dup=0 drop=39
Last message repeated 1 times
*** dropping frame 20 from stream 1 at ts 19
*** dropping frame 21 from stream 1 at ts 19
Last message repeated 1 times
*** dropping frame 22 from stream 1 at ts 20
Last message repeated 1 times
*** dropping frame 23 from stream 1 at ts 21
Last message repeated 1 times
*** dropping frame 23 from stream 1 at ts 22
*** dropping frame 24 from stream 1 at ts 22
Last message repeated 1 times
*** dropping frame 25 from stream 1 at ts 23
Last message repeated 1 times
*** dropping frame 26 from stream 1 at ts 24
Last message repeated 1 times
*** dropping frame 26 from stream 1 at ts 25
*** dropping frame 27 from stream 1 at ts 25
Last message repeated 1 times
*** dropping frame 28 from stream 1 at ts 26
Last message repeated 1 times
*** dropping frame 29 from stream 1 at ts 27
Last message repeated 1 times
*** dropping frame 29 from stream 1 at ts 28
*** dropping frame 30 from stream 1 at ts 28
Last message repeated 1 times
*** dropping frame 31 from stream 1 at ts 29
Last message repeated 1 times
*** dropping frame 32 from stream 1 at ts 30
Last message repeated 1 times
*** dropping frame 32 from stream 1 at ts 31
*** dropping frame 33 from stream 1 at ts 31
Last message repeated 1 times
*** dropping frame 34 from stream 1 at ts 32
Last message repeated 1 times
*** dropping frame 34 from stream 1 at ts 33
*** dropping frame 35 from stream 1 at ts 33
*** dropping frame 35 from stream 1 at ts 34
*** dropping frame 36 from stream 1 at ts 34
Last message repeated 1 times
*** dropping frame 37 from stream 1 at ts 35
Last message repeated 1 times
Invalid UE golomb code
*** dropping frame 38 from stream 1 at ts 36
Last message repeated 1 times
*** dropping frame 38 from stream 1 at ts 37
*** dropping frame 39 from stream 1 at ts 37
Last message repeated 1 times
*** dropping frame 40 from stream 1 at ts 38
Last message repeated 1 times
*** dropping frame 41 from stream 1 at ts 39me=00:00:02.73 bitrate= 311.7kbits/s dup=0 drop=88
Last message repeated 1 times
*** dropping frame 41 from stream 1 at ts 40
*** dropping frame 42 from stream 1 at ts 40
Last message repeated 1 times
*** dropping frame 43 from stream 1 at ts 41
Last message repeated 1 times
*** dropping frame 44 from stream 1 at ts 42
Last message repeated 1 times
*** dropping frame 44 from stream 1 at ts 43
*** dropping frame 45 from stream 1 at ts 43
Last message repeated 1 times
*** dropping frame 46 from stream 1 at ts 44
Last message repeated 1 times
*** dropping frame 47 from stream 1 at ts 45
Last message repeated 1 times
*** dropping frame 47 from stream 1 at ts 46
*** dropping frame 48 from stream 1 at ts 46
Last message repeated 1 times
*** dropping frame 49 from stream 1 at ts 47
Last message repeated 1 times
*** dropping frame 50 from stream 1 at ts 48
Last message repeated 1 times
*** dropping frame 50 from stream 1 at ts 49
*** dropping frame 51 from stream 1 at ts 49
Last message repeated 1 times
*** dropping frame 52 from stream 1 at ts 50
Last message repeated 1 times
*** dropping frame 53 from stream 1 at ts 51
Last message repeated 1 times
[h264 @ 0x9844a00] error while decoding MB 58 12, bytestream -5
[h264 @ 0x9844a00] concealing 1311 DC, 1311 AC, 1311 MV errors in B frame
*** dropping frame 53 from stream 1 at ts 52
No more output streams to write to, finishing.
frame= 55 fps= 42 q=4.3 Lsize= 152kB time=00:00:03.66 bitrate= 339.6kbits/s dup=0 drop=119
video:116kB audio:26kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 6.760316%
Input file #0 (http://source.com/1.ts):
Input stream #0:0 (video): 174 packets read (220322 bytes); 174 frames decoded;
Input stream #0:1 (audio): 156 packets read (36657 bytes); 156 frames decoded (159744 samples);
Total: 330 packets (256979 bytes) demuxed
Output file #0 (http://127.0.0.1:8090/feed1.ffm):
Output stream #0:0 (audio): 72 frames encoded (73383 samples); 72 packets muxed (26712 bytes);
Output stream #0:1 (video): 55 frames encoded; 55 packets muxed (119080 bytes);
Total: 127 packets (145792 bytes) muxedHere input URL file info After I download it to my PC with IDM
General
ID : 1 (0x1)
Complete name : D:\1.ts
Format : MPEG-TS
File size : 256 KiB
Duration : 2 s 520 ms
Overall bit rate mode : Variable
Overall bit rate : 788 kb/s
Video
ID : 256 (0x100)
Menu ID : 1 (0x1)
Format : AVC
Format/Info : Advanced Video Codec
Format profile : High@L3.1
Format settings, CABAC : Yes
Format settings, RefFrames : 2 frames
Codec ID : 27
Duration : 2 s 680 ms
Width : 960 pixels
Height : 540 pixels
Display aspect ratio : 16:9
Frame rate : 50.000 FPS
Color space : YUV
Chroma subsampling : 4:2:0
Bit depth : 8 bits
Scan type : Progressive
Audio
ID : 257 (0x101)
Menu ID : 1 (0x1)
Format : AAC
Format/Info : Advanced Audio Codec
Format version : Version 4
Format profile : LC
Muxing mode : ADTS
Codec ID : 15
Duration : 2 s 69 ms
Bit rate mode : Variable
Channel(s) : 2 channels
Channel positions : Front: L R
Sampling rate : 48.0 kHz
Frame rate : 46.875 FPS (1024 SPF)
Compression mode : Lossy
Delay relative to video : -12 ms
Menu
ID : 4096 (0x1000)
Menu ID : 1 (0x1)
Duration : 2 s 520 ms
List : 256 (0x100) (AVC) / 257 (0x101) (AAC)
Service name : Service01
Service provider : FFmpeg
Service type : digital television -
FFMpeg Concat Error - What needs to be changed ?
19 avril 2018, par Andrew BaldingerI have a tv episode video (let’s say episode.mp4). I also have a short, 20 second closing credit video that I want to append to various episodes (let’s say closing.mp4) The episode and closing are always Mp4, h264. The frame sizes are also the same. The audio codecs do vary, though. I would like to concat using concat demuxer to avoid having to re-encode. I tried doing this, but it gives me an error. I would like to make any necessary encoding changes to the short closing clip (so I would create multiple closing files, each matching the main episode file I want to add it to). What do I need to additionally make sure matches with the two videos to be able to use concat demuxer ? How would I edit the closing clip to match the episode ?
Here is a probe of the ending clip :
[STREAM]
index=0
codec_name=h264
codec_long_name=H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10
profile=High
codec_type=video
codec_time_base=1001/48000
codec_tag_string=avc1
codec_tag=0x31637661
width=1280
height=720
coded_width=1280
coded_height=720
has_b_frames=2
sample_aspect_ratio=1:1
display_aspect_ratio=16:9
pix_fmt=yuv420p
level=31
color_range=unknown
color_space=unknown
color_transfer=unknown
color_primaries=unknown
chroma_location=left
field_order=unknown
timecode=N/A
refs=1
is_avc=true
nal_length_size=4
id=N/A
r_frame_rate=24000/1001
avg_frame_rate=24000/1001
time_base=1/24000
start_pts=0
start_time=0.000000
duration_ts=672672
duration=28.028000
bit_rate=442973
max_bit_rate=N/A
bits_per_raw_sample=8
nb_frames=672
nb_read_frames=N/A
nb_read_packets=N/A
DISPOSITION:default=1
DISPOSITION:dub=0
DISPOSITION:original=0
DISPOSITION:comment=0
DISPOSITION:lyrics=0
DISPOSITION:karaoke=0
DISPOSITION:forced=0
DISPOSITION:hearing_impaired=0
DISPOSITION:visual_impaired=0
DISPOSITION:clean_effects=0
DISPOSITION:attached_pic=0
DISPOSITION:timed_thumbnails=0
TAG:language=eng
TAG:handler_name=VideoHandler
[/STREAM]
[STREAM]
index=1
codec_name=aac
codec_long_name=AAC (Advanced Audio Coding)
profile=LC
codec_type=audio
codec_time_base=1/48000
codec_tag_string=mp4a
codec_tag=0x6134706d
sample_fmt=fltp
sample_rate=48000
channels=2
channel_layout=stereo
bits_per_sample=0
id=N/A
r_frame_rate=0/0
avg_frame_rate=0/0
time_base=1/48000
start_pts=0
start_time=0.000000
duration_ts=1344000
duration=28.000000
bit_rate=128651
max_bit_rate=128651
bits_per_raw_sample=N/A
nb_frames=1314
nb_read_frames=N/A
nb_read_packets=N/AHere is a probe of a sample episode :
[STREAM]
index=0
codec_name=h264
codec_long_name=H.264 / AVC / MPEG-4 AVC / MPEG-4 part 10
profile=High
codec_type=video
codec_time_base=208879/10016000
codec_tag_string=avc1
codec_tag=0x31637661
width=1280
height=718
coded_width=1280
coded_height=718
has_b_frames=2
sample_aspect_ratio=1:1
display_aspect_ratio=640:359
pix_fmt=yuv420p
level=31
color_range=unknown
color_space=unknown
color_transfer=unknown
color_primaries=unknown
chroma_location=left
field_order=unknown
timecode=N/A
refs=1
is_avc=true
nal_length_size=4
id=N/A
r_frame_rate=24000/1001
avg_frame_rate=5008000/208879
time_base=1/16000
start_pts=0
start_time=0.000000
duration_ts=40104768
duration=2506.548000
bit_rate=1092383
max_bit_rate=N/A
bits_per_raw_sample=8
nb_frames=60096
nb_read_frames=N/A
nb_read_packets=N/A
DISPOSITION:default=1
DISPOSITION:dub=0
DISPOSITION:original=0
DISPOSITION:comment=0
DISPOSITION:lyrics=0
DISPOSITION:karaoke=0
DISPOSITION:forced=0
DISPOSITION:hearing_impaired=0
DISPOSITION:visual_impaired=0
DISPOSITION:clean_effects=0
DISPOSITION:attached_pic=0
DISPOSITION:timed_thumbnails=0
TAG:language=und
TAG:handler_name=VideoHandler
[/STREAM]
[STREAM]
index=1
codec_name=ac3
codec_long_name=ATSC A/52A (AC-3)
profile=unknown
codec_type=audio
codec_time_base=1/48000
codec_tag_string=ac-3
codec_tag=0x332d6361
sample_fmt=fltp
sample_rate=48000
channels=2
channel_layout=stereo
bits_per_sample=0
dmix_mode=-1
ltrt_cmixlev=-1.000000
ltrt_surmixlev=-1.000000
loro_cmixlev=-1.000000
loro_surmixlev=-1.000000
id=N/A
r_frame_rate=0/0
avg_frame_rate=0/0
time_base=1/48000
start_pts=0
start_time=0.000000
duration_ts=120313200
duration=2506.525000
bit_rate=192000
max_bit_rate=N/A
bits_per_raw_sample=N/A
nb_frames=78329
nb_read_frames=N/A
nb_read_packets=N/AFinally, I am running Windows 10 and here is a probe on my setup :
ffprobe version N-87327-g18821e3 Copyright (c) 2007-2017 the FFmpeg developers
built with gcc 7.2.0 (GCC)
configuration: --enable-gpl --enable-version3 --enable-cuda --enable-cuvid --enable-d3d11va --enable-dxva2 --enable-libmfx --enable-nvenc --enable-avisynth --enable-bzlib --enable-fontconfig --enable-frei0r --enable-gnutls --enable-iconv --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca --enable-libfreetype --enable-libgme --enable-libgsm --enable-libilbc --enable-libmodplug --enable-libmp3lame --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenh264 --enable-libopenjpeg --enable-libopus --enable-librtmp --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libtheora --enable-libtwolame --enable-libvidstab --enable-libvo-amrwbenc --enable-libvorbis --enable-libvpx --enable-libwavpack --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxavs --enable-libxvid --enable-libxml2 --enable-libzimg --enable-lzma --enable-zlib
libavutil 55. 75.100 / 55. 75.100
libavcodec 57.106.101 / 57.106.101
libavformat 57. 82.100 / 57. 82.100
libavdevice 57. 8.101 / 57. 8.101
libavfilter 6.105.100 / 6.105.100
libswscale 4. 7.103 / 4. 7.103
libswresample 2. 8.100 / 2. 8.100
libpostproc 54. 6.100 / 54. 6.100I created a version of the ending with the same screen size and audio codec as the episode. But, when I try to concat, the resulting video is much longer (1:03:00) than it should be (about 42 mins), and it freezes when played. Here is the concat :
ffmpeg -f concat -safe 0 -i "concat.txt" -c copy 's04e06.mp4'
ffmpeg : ffmpeg version N-87327-g18821e3 Copyright (c) 2000-2017 the FFmpeg developers
At line:1 char:1
+ ffmpeg -f concat -safe 0 -i "concat.txt" ...
+ ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
+ CategoryInfo : NotSpecified: (ffmpeg version ...mpeg developers:String) [], RemoteException
+ FullyQualifiedErrorId : NativeCommandError
built with gcc 7.2.0 (GCC)
configuration: --enable-gpl --enable-version3 --enable-cuda --enable-cuvid --enable-d3d11va --enable-dxva2
--enable-libmfx --enable-nvenc --enable-avisynth --enable-bzlib --enable-fontconfig --enable-frei0r
--enable-gnutls --enable-iconv --enable-libass --enable-libbluray --enable-libbs2b --enable-libcaca
--enable-libfreetype --enable-libgme --enable-libgsm --enable-libilbc --enable-libmodplug --enable-libmp3lame
--enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenh264 --enable-libopenjpeg --enable-libopus
--enable-librtmp --enable-libsnappy --enable-libsoxr --enable-libspeex --enable-libtheora --enable-libtwolame
--enable-libvidstab --enable-libvo-amrwbenc --enable-libvorbis --enable-libvpx --enable-libwavpack
--enable-libwebp --enable-libx264 --enable-libx265 --enable-libxavs --enable-libxvid --enable-libxml2
--enable-libzimg --enable-lzma --enable-zlib
libavutil 55. 75.100 / 55. 75.100
libavcodec 57.106.101 / 57.106.101
libavformat 57. 82.100 / 57. 82.100
libavdevice 57. 8.101 / 57. 8.101
libavfilter 6.105.100 / 6.105.100
libswscale 4. 7.103 / 4. 7.103
libswresample 2. 8.100 / 2. 8.100
libpostproc 54. 6.100 / 54. 6.100
[mov,mp4,m4a,3gp,3g2,mj2 @ 00000000047cb020]
Auto-inserting h264_mp4toannexb bitstream filter
Input #0, concat, from 'concat.txt':
Duration: N/A, start: -0.002333, bitrate: 1284 kb/s
Stream #0:
0(und
): Video: h264 (High) (avc1 / 0x31637661), yuv420p, 1280x718 [SAR 1:1 DAR 640:359], 1092 kb/s
,
23.98 fps,
23.98 tbr,
16k tbn, 47.95 tb
c
Metadata:
handler_name :
VideoHandler
Stream #0:
1(und): Audio: ac3 (ac-3 / 0x332D6361), 48000 Hz, stereo, fltp, 192 kb/s
Metadata:
handler_name :
SoundHandler
[mp4 @ 0000000004daf380]
track 1: codec frame size is not set
Output #0, mp4, to 's04e06.mp4':
Metadata:
encoder :
Lavf57.82.10
0
Stream #0:
0
(und)
: Video: h264 (High) (avc1 / 0x31637661), yuv420p, 1280x718 [SAR 1:1 DAR 640:359], q=2-31, 1092 kb/s
,
23.98 fps, 23.98 tbr,
16k tbn,
16k tbc
Metadata:
handler_name : VideoHandler
Stream #0:1(und): Audio: ac3 (ac-3 / 0x332D6361), 48000 Hz, stereo, fltp, 192 kb/s
Metadata:
handler_name : SoundHandler
Stream mapping:
Stream #0:0 -> #0:0 (copy)
Stream #0:1 -> #0:1 (copy)
Press [q] to stop, [?] for help
frame= 3050 fps=0.0 q=-1.0 size= 32768kB time=00:02:07.16 bitrate=2110.9kbits/s speed= 254x
frame= 7005 fps=6993 q=-1.0 size= 65536kB time=00:04:52.12 bitrate=1837.8kbits/s speed= 292x
frame=12638 fps=8414 q=-1.0 size= 99072kB time=00:08:47.04 bitrate=1539.9kbits/s speed= 351x
frame=17009 fps=8492 q=-1.0 size= 125440kB time=00:11:49.34 bitrate=1448.7kbits/s speed= 354x
frame=18981 fps=7413 q=-1.0 size= 136704kB time=00:13:11.61 bitrate=1414.7kbits/s speed= 309x
frame=20233 fps=6444 q=-1.0 size= 144896kB time=00:14:03.80 bitrate=1406.7kbits/s speed= 269x
frame=23615 fps=6421 q=-1.0 size= 165888kB time=00:16:24.89 bitrate=1379.8kbits/s speed= 268x
frame=25322 fps=6057 q=-1.0 size= 175360kB time=00:17:36.06 bitrate=1360.3kbits/s speed= 253x
frame=26957 fps=5759 q=-1.0 size= 184576kB time=00:18:44.25 bitrate=1344.9kbits/s speed= 240x
frame=31478 fps=6076 q=-1.0 size= 215040kB time=00:21:52.83 bitrate=1341.8kbits/s speed= 253x
frame=33517 fps=5900 q=-1.0 size= 235264kB time=00:23:17.88 bitrate=1378.7kbits/s speed= 246x
frame=34974 fps=5658 q=-1.0 size= 246272kB time=00:24:18.65 bitrate=1383.1kbits/s speed= 236x
frame=36987 fps=5437 q=-1.0 size= 259840kB time=00:25:42.59 bitrate=1379.9kbits/s speed= 227x
frame=37543 fps=5140 q=-1.0 size= 263168kB time=00:26:05.79 bitrate=1376.9kbits/s speed= 214x
frame=39203 fps=4982 q=-1.0 size= 273152kB time=00:27:15.04 bitrate=1368.6kbits/s speed= 208x
frame=45904 fps=5484 q=-1.0 size= 305408kB time=00:31:54.52 bitrate=1306.8kbits/s speed= 229x
frame=47996 fps=5410 q=-1.0 size= 318720kB time=00:33:21.75 bitrate=1304.3kbits/s speed= 226x
frame=50719 fps=5409 q=-1.0 size= 336128kB time=00:35:15.32 bitrate=1301.7kbits/s speed= 226x
frame=53508 fps=5409 q=-1.0 size= 354560kB time=00:37:11.65 bitrate=1301.5kbits/s speed= 226x
frame=57118 fps=5452 q=-1.0 size= 372736kB time=00:39:42.24 bitrate=1281.8kbits/s speed= 227x
frame=58440 fps=5324 q=-1.0 size= 382208kB time=00:40:37.35 bitrate=1284.6kbits/s speed= 222x
[mov,mp4,m4a,3gp,3g2,mj2 @ 00000000047d3640]
Auto-inserting h264_mp4toannexb bitstream filter
frame=60098 fps=5228 q=-1.0 size= 392960kB time=01:02:39.76 bitrate= 856.2kbits/s speed= 327x
frame=60746 fps=5031 q=-1.0 size= 393472kB time=01:03:20.30 bitrate= 848.2kbits/s speed= 315x
frame=60768 fps=4978 q=-1.0 Lsize= 397136kB time=01:03:21.67 bitrate= 855.8kbits/s speed= 311x
video:335753kB audio:59186kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.556209% -
How to not process any personal data with Matomo and what it means for you
22 avril 2018, par InnoCraftDisclaimer : this blog post has been written by digital analysts, not lawyers. The purpose of this article is to explain how to not process any personal data with Matomo in order to avoid going through the GDPR compliance process with Matomo analytics. This work comes from our interpretation of different sources : the official GDPR text and the UK privacy commission : ICO resources. It cannot be considered as a professional legal advice. So as GDPR, this information is subject to change. GDPR may be also known as RGPD in French, Spanish, Portuguese, Datenschutz-Grundverordnung, DS-GVO in German, Algemene verordening gegevensbescherming in Dutch, Regolamento generale sulla protezione dei dati in Italian.
Are you looking for a way to not process any personal data with Matomo ? If the answer is yes, you are at the right place. From our understanding, if you are not processing personal data, then you shouldn’t be concerned about GDPR. Our inspiration came from this official reference :
“The principles of data protection should therefore not apply to anonymous information, namely information which does not relate to an identified or identifiable natural person or to personal data rendered anonymous in such a manner that the data subject is not or no longer identifiable. This Regulation does not therefore concern the processing of such anonymous information, including for statistical or research purposes.“
In this blog post we are going to see how you can configure Matomo in order to not process any personal data and what the consequences are.
Which data is considered as personal according to GDPR ?
From : eur-lex.europa.eu
(1) “‘personal data’ means any information relating to an identified or identifiable natural person (‘data subject’) ; an identifiable natural person is one who can be identified, directly or indirectly, in particular by reference to an identifier such as a name, an identification number, location data, an online identifier or to one or more factors specific to the physical, physiological, genetic, mental, economic, cultural or social identity of that natural person ;”
(30) “Natural persons may be associated with online identifiers provided by their devices, applications, tools and protocols, such as internet protocol addresses, cookie identifiers or other identifiers such as radio frequency identification tags. This may leave traces which, in particular when combined with unique identifiers and other information received by the servers, may be used to create profiles of the natural persons and identify them.”
So according to your Matomo configuration, it may leave some traces within the following data :
- IP addresses
- Cookies identifiers
- Page URL or page titles
- User ID and Custom “personal” data
- Ecommerce order IDs
- Location
- Heatmaps & Session Recordings
Let’s see each of them in more detail.
1. IP addresses
IP addresses can indirectly identify an individual. It can also give a good approximation of an individual’s location.
IP addresses are therefore considered as personal data which means you need to anonymize them. To do so, a feature is available within Matomo, where you can anonymize the IP. We recommend you to anonymize at least the last two bytes :
See our configuration guide for more information
What are the consequences of using this feature ?
When applying IP anonymization on two bytes, you will no longer be able to see the full IP in the UI.
Moreover, there is a small chance that 2 different visitors with the same device and software configuration will be identified as the same visitor if the anonymised IP address is the same for both.
2. Cookies
It is not clear for us yet if all cookies are considered equal under GDPR. At this stage it is too early to make a definite decision.
Did you know ? Matomo lets you optionally disable the creation of cookies by adding an extra line of code to your tracking code see below.
See our configuration guide for more information
What are the consequences of using this feature ?
Matomo is using a few first party cookies, and the following cookies may hold personal data :
- _pk_id : contains a visitor id used to identify unique visitors
- _pk_ref : to identify from where they came from
If Matomo cannot set cookies, it will use a technique called Fingerprint. It is based on several metadata such as the operating system, browser, browser plugins, IP address, browser language ; just to name a few to identify a unique visitor. As this feature is less accurate than the one using cookies, the number of visitors and visits will be affected.
3. Page URLs and page titles
URLs are not mentioned within the official GDPR text. However, we know that according to the different CMS you use, some of them may have URLs including personal identifiers.
For example :
As a result, you need to find a way to anonymize this data.
There are several ways you can perform this action according to your website. If your website is adding the personal data through query parameters, you can define a rule to exclude them from Matomo.
If the personal data are not included within query parameters, you can use the “setCustomURL” feature and write your code as follow :
See our developer documentation for more information
If you are also processing personal data within the title tag, you can use the following function : “setDocumentTitle”.
What are the consequences of using this feature ?
By anonymizing the URLs containing personal data, some of your URLs will be grouped together.
4. User ID and custom personal data
User ID is a feature (a tracking code needs to be added) which allows you to identify the same user across different devices.
A User ID needs a corresponding database in order to link a user across different devices, it can be an email, a username, a name, a random number… All those data are either direct or non direct online identifiers and are therefore under the scope of GDPR.
It will be the same situation if you are using custom variables and/or custom dimensions in order to push personal data to the system.
To continue using the User ID feature but not recording personal data, you can consider using a hash function which will anonymize/convert your actual User ID into something like “3jrj3j34434834urj33j3”.
Alternatively, you can enable the feature “Anonymise User IDs”. This feature will be available starting in Matomo 3.5.0 :
What are the consequences of using this feature ?
Under GDPR, User ID is personal data. Anonymizing the User ID using a hash function or our built-in functionality make the User Id pseudo-anonymous, which means it can’t be easily identified to a specific user. As a result, you will still get accurate visits and unique visitors metrics, and the Visitor Profile, but without tracking the original User ID which is personal data.
5. Ecommerce order IDs
Order IDs are the reference number assigned to the products/services bought by your customers. As this information can be crossed with your internal database, it is considered as an online identifier and is therefore under the scope of GDPR. As for User ID, you can anonymize order IDs using our built-in functionality to Anonymise Order IDs (see section 4. about User Id).
What are the consequences of anonymizing order ID ?
It really depends on your former use of order IDs. If you were not using them in the past then you should not see any difference.
6. Location
Based on the IP address of a visitor, Matomo can detect the visitors location. Location data is problematic for privacy as this technology has become quite accurate and can detect not only the city a visitor is from, but sometimes an even more precise position of a visitor.
In order to not leave any accurate traces, we strongly recommend you to enable the IP anonymization feature. Next, you need to enable the setting “Also use the anonymized IP address when enriching visits”. You find this setting directly below the IP anonymization. This is important as otherwise the full IP address will be used to geolocate a visitor.
What are the consequences of anonymizing location data ?
The more bytes you anonymize from the IP, the more anonymized your location will be. When you remove two bytes as suggested, the city and region location reports will not be as accurate. In some cases even the country may not be detected correctly anymore.
7. Heatmaps & Session Recordings
Heatmaps & Session Recording is a premium feature in Matomo allowing you to see where users click, hover, type and scroll. With session recordings you can then replay their actions in a video.
Heatmaps & Session Recordings are under the scope of GDPR as they can disclose in some specific cases (for example : filling a contact form) personal data :
To avoid this, Matomo will anonymize all keystrokes which a user enters into a form field unless you specifically whitelist a field. Many fields that could contain personal data, such as a credit card, phone number, email address, password, social security number, and more are always anonymized and not recorded.
See our configuration guide for more information
Note that a page may still show personal information within the page as part of regular content (not a form element). For example an address, or the profile page of a forum user. We have added a feature which allows you to set an HTML attribute “data-matomo-mask” to anonymize any personal content shown in the UI.
What are the consequences of using this feature ?
Mainly, you will not be able to see in plain text what people are entering into your forms.
What should you do with past data ?
Once more, we have to say that we are not lawyers. So do not take our answers as legal advice. From : ec.europa.eu/newsroom/article29/document.cfm ?doc_id=50053
“For example, as the GDPR requires that a controller must be able to demonstrate that valid consent was obtained, all presumed consents of which no references are kept will automatically be below the consent standard of the GDPR and will need to be renewed.”
Our interpretation is that, if you were previously relying on consent, unless you can demonstrate that valid consent was obtained, you need to get the consent back (which is almost impossible) or you need to anonymize or remove that data.
To anonymize previously tracked data, we are actively working on a feature to do just that directly within Matomo. Alternatively, you may also set up the deletion of logs after a certain amount of time.
We really hope you enjoyed reading this article. GDPR is still on the go and we are pretty sure you have a lot of questions about it. You probably would like to share our vision about it. So do not hesitate to ask us through our contact form to see how we are interpreting GDPR at Matomo and InnoCraft.
The post How to not process any personal data with Matomo and what it means for you appeared first on Analytics Platform - Matomo.