Recherche avancée

Sur d’autres sites (4819)

• JavaFX MediaPlayer unable to play local m3u8 file

  3 mai 2017, par Lennart

  I want to show a live stream of a web cam in my JavaFX application using the MediaPlayer/MediaView. My attempt was to use ffmpeg to record a HLS and to play the resulting m3u8 file, but that throws the following exception (VLC plays the video without problems) :

  MediaException: UNKNOWN : com.sun.media.jfxmedia.MediaException: Could not create player! : com.sun.media.jfxmedia.MediaException: Could not create player!
  
      at javafx.scene.media.MediaException.exceptionToMediaException(MediaException.java:146)
  
      at javafx.scene.media.MediaPlayer.init(MediaPlayer.java:511)
  
      at javafx.scene.media.MediaPlayer.<init>(MediaPlayer.java:414)
  
      at de.fraunhofer.iosb.ias.flow.assessment.management.monitor.MonitorViewController.testStream(MonitorViewController.java:203)
  
      ... 58 more
  
  Caused by: com.sun.media.jfxmedia.MediaException: Could not create player!
  
      at com.sun.media.jfxmediaimpl.NativeMediaManager.getPlayer(NativeMediaManager.java:274)
  
      at com.sun.media.jfxmedia.MediaManager.getPlayer(MediaManager.java:118)
  
      at javafx.scene.media.MediaPlayer.init(MediaPlayer.java:467)
  
      ... 60 more
  
  </init>

  I debugged the player creation and the error occurs inside the constructor of GSTMediaPlayer when GSTMediaPlayer.gstInitPlayer() is called. This native method returns the error code 257, which javafx maps to MediaError.ERROR_MEDIA_NULL.

  I used the following ffmpeg command to record the video :

  ffmpeg -hide_banner -y -rtbufsize 250MB -f dshow -pixel_format yuv420p -video_size 960x720 -i video="Logitech HD Pro Webcam C920" -c:v libx264 -crf 20 -pix_fmt yuv420p out.m3u8

  I’m pretty sure that the encoding matches the requirements of javafx, because if I change the output container from m3u8 to mp4, the video is played without problems using the exact same ffmpeg command.

  This is the output of ffprobe for the m3u8 file :

  Input #0, hls,applehttp, from 'out.m3u8':
  
    Duration: 00:00:24.23, start: 1.466667, bitrate: 0 kb/s
  
    Program 0
  
      Metadata:
  
        variant_bitrate : 0
  
      Stream #0:0: Video: h264 (High) ([27][0][0][0] / 0x001B), yuv420p, 960x720, 30 fps, 30 tbr, 90k tbn, 60 tbc

  And for the mp4 file :

  Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'out.mp4':
  
    Metadata:
  
      major_brand     : isom
  
      minor_version   : 512
  
      compatible_brands: isomiso2avc1mp41
  
      encoder         : Lavf57.41.100
  
    Duration: 00:01:04.93, start: 0.000000, bitrate: 1676 kb/s
  
      Stream #0:0(und): Video: h264 (High) (avc1 / 0x31637661), yuv420p, 960x720, 1673 kb/s, 30 fps, 30 tbr, 10000k tbn, 60 tbc (default)
  
      Metadata:
  
        handler_name    : VideoHandler

  The resulting m3u8 file looks like this :

  #EXTM3U
  
  #EXT-X-VERSION:3
  
  #EXT-X-TARGETDURATION:9
  
  #EXT-X-MEDIA-SEQUENCE:0
  
  #EXTINF:8.333322,
  
  out0.ts
  
  #EXTINF:8.333333,
  
  out1.ts
  
  #EXTINF:7.133322,
  
  out2.ts
  
  #EXTINF:0.433333,
  
  out3.ts
  
  #EXT-X-ENDLIST

  Update : After I found this reference m3u file, I think that the problem is that the file is stored locally and isn’t delivered via HTTP. The video plays fine with this :

  Media media = new Media("http://download.oracle.com/otndocs/products/javafx/JavaRap/prog_index.m3u8");
  
  MediaPlayer player = new MediaPlayer(media);
  
  player.setAutoPlay(true);
  
  mediaView.setMediaPlayer(player);

  But after I downloaded the reference m3u and all of its segments and tried to open the local file like this, the error occurred again :

  File video = new File("H://Projects//Tools//ref//prog_index.m3u8");
  
  Media media = new Media(video.toURI().toString());
  
  MediaPlayer player = new MediaPlayer(media);
  
  player.setAutoPlay(true);
  
  mediaView.setMediaPlayer(player);

  I tried to change my m3u file so that the segements are referenced with absolute paths. I tried different notations (H:\f\out0.ts, H:/f/out0.ts, H://f//out0.ts, file:/H:/f/out0.ts, file:///H:/f/out0.ts), but I couldn’t get it to work.

• JavaFX MediaPlayer unable to play local m3u8 file

  22 février 2020, par Lennart

  I want to show a live stream of a web cam in my JavaFX application using the MediaPlayer/MediaView. My attempt was to use ffmpeg to record a HLS and to play the resulting m3u8 file, but that throws the following exception (VLC plays the video without problems) :

  MediaException: UNKNOWN : com.sun.media.jfxmedia.MediaException: Could not create player! : com.sun.media.jfxmedia.MediaException: Could not create player!
  
      at javafx.scene.media.MediaException.exceptionToMediaException(MediaException.java:146)
  
      at javafx.scene.media.MediaPlayer.init(MediaPlayer.java:511)
  
      at javafx.scene.media.MediaPlayer.<init>(MediaPlayer.java:414)
  
      at de.fraunhofer.iosb.ias.flow.assessment.management.monitor.MonitorViewController.testStream(MonitorViewController.java:203)
  
      ... 58 more
  
  Caused by: com.sun.media.jfxmedia.MediaException: Could not create player!
  
      at com.sun.media.jfxmediaimpl.NativeMediaManager.getPlayer(NativeMediaManager.java:274)
  
      at com.sun.media.jfxmedia.MediaManager.getPlayer(MediaManager.java:118)
  
      at javafx.scene.media.MediaPlayer.init(MediaPlayer.java:467)
  
      ... 60 more
  
  </init>

  I debugged the player creation and the error occurs inside the constructor of GSTMediaPlayer when GSTMediaPlayer.gstInitPlayer() is called. This native method returns the error code 257, which javafx maps to MediaError.ERROR_MEDIA_NULL.

  I used the following ffmpeg command to record the video :

  ffmpeg -hide_banner -y -rtbufsize 250MB -f dshow -pixel_format yuv420p -video_size 960x720 -i video="Logitech HD Pro Webcam C920" -c:v libx264 -crf 20 -pix_fmt yuv420p out.m3u8

  I’m pretty sure that the encoding matches the requirements of javafx, because if I change the output container from m3u8 to mp4, the video is played without problems using the exact same ffmpeg command.

  This is the output of ffprobe for the m3u8 file :

  Input #0, hls,applehttp, from 'out.m3u8':
  
    Duration: 00:00:24.23, start: 1.466667, bitrate: 0 kb/s
  
    Program 0
  
      Metadata:
  
        variant_bitrate : 0
  
      Stream #0:0: Video: h264 (High) ([27][0][0][0] / 0x001B), yuv420p, 960x720, 30 fps, 30 tbr, 90k tbn, 60 tbc

  And for the mp4 file :

  Input #0, mov,mp4,m4a,3gp,3g2,mj2, from 'out.mp4':
  
    Metadata:
  
      major_brand     : isom
  
      minor_version   : 512
  
      compatible_brands: isomiso2avc1mp41
  
      encoder         : Lavf57.41.100
  
    Duration: 00:01:04.93, start: 0.000000, bitrate: 1676 kb/s
  
      Stream #0:0(und): Video: h264 (High) (avc1 / 0x31637661), yuv420p, 960x720, 1673 kb/s, 30 fps, 30 tbr, 10000k tbn, 60 tbc (default)
  
      Metadata:
  
        handler_name    : VideoHandler

  The resulting m3u8 file looks like this :

  #EXTM3U
  
  #EXT-X-VERSION:3
  
  #EXT-X-TARGETDURATION:9
  
  #EXT-X-MEDIA-SEQUENCE:0
  
  #EXTINF:8.333322,
  
  out0.ts
  
  #EXTINF:8.333333,
  
  out1.ts
  
  #EXTINF:7.133322,
  
  out2.ts
  
  #EXTINF:0.433333,
  
  out3.ts
  
  #EXT-X-ENDLIST

  Update : After I found this reference m3u file, I think that the problem is that the file is stored locally and isn’t delivered via HTTP. The video plays fine with this :

  Media media = new Media("http://download.oracle.com/otndocs/products/javafx/JavaRap/prog_index.m3u8");
  
  MediaPlayer player = new MediaPlayer(media);
  
  player.setAutoPlay(true);
  
  mediaView.setMediaPlayer(player);

  But after I downloaded the reference m3u and all of its segments and tried to open the local file like this, the error occurred again :

  File video = new File("H://Projects//Tools//ref//prog_index.m3u8");
  
  Media media = new Media(video.toURI().toString());
  
  MediaPlayer player = new MediaPlayer(media);
  
  player.setAutoPlay(true);
  
  mediaView.setMediaPlayer(player);

  I tried to change my m3u file so that the segements are referenced with absolute paths. I tried different notations (H:\f\out0.ts, H:/f/out0.ts, H://f//out0.ts, file:/H:/f/out0.ts, file:///H:/f/out0.ts), but I couldn’t get it to work.

• Why is my .mp4 file created using cv2.VideoWriter not syncing up with the audio when i combine the video and audio using ffmpeg [closed]

  27 décembre 2024, par joeS125

  The aim of the script is to take text from a text file and put it onto a stock video with an ai reading the text. Similar to those reddit stories on social media with parkour minecraft in the background.

  


  import cv2
import time
from ffpyplayer.player import MediaPlayer
from Transcription import newTranscribeAudio
from pydub import AudioSegment

#get a gpt text generation to create a story based on a prompt, for example sci-fi story and spread it over 3-4 parts
#get stock footage, like minecraft parkour etc
#write text of script on the footage
#create video for each part
#have ai voiceover to read the transcript
cap = cv2.VideoCapture("Stock_Videos\Minecraft_Parkour.mp4")
transcription = newTranscribeAudio("final_us.wav")
player = MediaPlayer("final_us.mp3")
audio = AudioSegment.from_file("final_us.mp3")
story = open("Story.txt", "r").read()
story_split = story.split("||")
fps = cap.get(cv2.CAP_PROP_FPS)
frame_count = int(cap.get(cv2.CAP_PROP_FRAME_COUNT))
video_duration = frame_count / fps  # Duration of one loop of the video
fourcc = cv2.VideoWriter_fourcc(*"mp4v")
audio_duration = len(audio) / 1000  # Duration in seconds
video_writer = cv2.VideoWriter(f"CompletedVideo.mp4", fourcc, fps, (1080, 1920))

choice = 0#part of the story choice
part_split = story_split[choice].split(" ")
with open("Segment.txt", "w") as file:
    file.write(story_split[choice])
start_time = time.time()
length = len(part_split) - 1
next_text = []
for j in range(0, length):
    temp = part_split[j].replace("\n", "")
    next_text.append([temp])
index = 0
word_index = 0
frame_size_x = 1080
frame_size_y = 1920
audio_duration = len(audio) / 1000  # Duration in seconds
start_time = time.time()
wait_time = 1 / fps
while (time.time() - start_time) < audio_duration:
    cap.set(cv2.CAP_PROP_POS_FRAMES, 0)  # Restart video
    elapsed_time = time.time() - start_time
    print(video_writer)
    if index >= len(transcription):
        break
    while cap.isOpened():
        # Capture frames in the video 
        ret, frame = cap.read()
        if not ret:
            break
        audio_frame, val = player.get_frame()
        if val == 'eof':  # End of file
            print("Audio playback finished.")
            break
        if index >= len(transcription):
            break
        
        if frame_size_x == -1:
            frame_size_x = frame.shape[1]
            frame_size_y = frame.shape[0]

        elapsed_time = time.time() - start_time

        # describe the type of font 
        # to be used. 
        font = cv2.FONT_HERSHEY_SIMPLEX 
        trans = transcription[index]["words"]
        end_time = trans[word_index]["end"]
        if trans[word_index]["start"] < elapsed_time < trans[word_index]["end"]:
            video_text = trans[word_index]["text"]
        elif elapsed_time >= trans[word_index]["end"]:
            #index += 1
            word_index += 1
        if (word_index >= len(trans)):
            index += 1
            word_index = 0
        # get boundary of this text
        textsize = cv2.getTextSize(video_text, font, 3, 6)[0]
        # get coords based on boundary
        textX = int((frame.shape[1] - textsize[0]) / 2)
        textY = int((frame.shape[0] + textsize[1]) / 2)
        
        cv2.putText(frame,  
                    video_text,  
                    (textX, textY),  
                    font, 3,  
                    (0, 255, 255),  
                    6,  
                    cv2.LINE_4)
        
        # Define the resize scale
        scale_percent = 50  # Resize to 50% of the original size
        # Get new dimensions
        width = 1080
        height = 1920
        new_size = (width, height)

        # Resize the frame
        resized_frame = cv2.resize(frame, new_size)
        video_writer.write(resized_frame)
        cv2.imshow('video', resized_frame)
        cv2.waitKey(wait_time)
        if cv2.waitKey(1) & 0xFF == ord('q'): 
            break
cv2.destroyAllWindows()
video_writer.release()
cap.release()



  


  When I run this script the audio matches the text in the video perfectly and it runs for the correct amount of time to match with the audio (2 min 44 sec). However, the saved video CompletedVideo.mp4 only lasts for 1 min 10 sec. I am unsure why the video has sped up. The fps is 60 fps. If you require any more information please let me know and thanks in advance.

  


  I have tried changing the fps, changing the wait_time after writing each frame. I am expecting the CompletedVideo.mp4 to be 2 min 44 sec long not 1 min 10 sec long.