Recherche avancée

Sur d’autres sites (3228)

• Unable to open audio file on Heroku using Librosa

  15 mars 2020, par Rohan Bojja

  I have a feature extraction REST API written in Python using the Librosa library (Extracting audio features), it receives an audio file through HTTP POST and responds with a list of features(such as MFCC,etc).

  Since librosa depends on SoundFile (libsndfile1 / libsndfile-dev), it doesn’t support all the formats, I’m converting the audio file using ffmpeg-python wrapper (https://kkroening.github.io/ffmpeg-python/) .

  It works just fine on my Windows 10 machine with Conda, but when I deploy it on Heroku, the librosa.load() functions returns an unknown format error, no matter what format I convert it to. I have tried FLAC, AIFF and WAV.

  My first guess is that the converted format isn’t supported by libsndfile1, but it works on my local server (plus, their documentation says AIFF and WAV are supported), so I’m a little lost.

  I have attached all the relevant snippets of code below, I can provide anything extra if necessary. Any help is highly appreciated. Thanks.

  UPDATE1 :

  I am using pipes instead of writing and reading from disk, worth a mention as the question could be misleading otherwise.

  The log :

  File "/app/app.py", line 31, in upload
  
  x , sr = librosa.load(audioFile,mono=True,duration=5)
  
  File "/app/.heroku/python/lib/python3.6/site-packages/librosa/core/audio.py", line 164, in load
  
  six.reraise(*sys.exc_info())
  
  File "/app/.heroku/python/lib/python3.6/site-packages/six.py", line 703, in reraise
  
  raise value
  
  File "/app/.heroku/python/lib/python3.6/site-packages/librosa/core/audio.py", line 129, in load
  
  with sf.SoundFile(path) as sf_desc:
  
  File "/app/.heroku/python/lib/python3.6/site-packages/soundfile.py", line 629, in __init__
  
  self._file = self._open(file, mode_int, closefd)
  
  File "/app/.heroku/python/lib/python3.6/site-packages/soundfile.py", line 1184, in _open
  
  "Error opening {0!r}: ".format(self.name))
  
  File "/app/.heroku/python/lib/python3.6/site-packages/soundfile.py", line 1357, in _error_check
  
  raise RuntimeError(prefix + _ffi.string(err_str).decode('utf-8', 'replace'))
  
  RuntimeError: Error opening <_io.BytesIO object at 0x7f46ad28beb8>: File contains data in an unknown format.
  
  10.69.244.94 - - [15/Mar/2020:12:37:28 +0000] "POST /receiveWav HTTP/1.1" 500 290 "-" "curl/7.55.1"

  Flask/Librosa code deployed on Heroku (app.py) :

  from flask import Flask, jsonify, request
  
  import scipy.optimize
  
  import os,pickle
  
  import numpy as np
  
  from sklearn.preprocessing import StandardScaler
  
  import librosa
  
  import logging
  
  import soundfile as sf
  
  from pydub import AudioSegment
  
  import subprocess as sp
  
  import ffmpeg
  
  from io import BytesIO
  
  
  
  logging.basicConfig(level=logging.DEBUG)
  
  
  
  app = Flask(__name__) 
  
  
  
  @app.route('/receiveWav',methods = ['POST'])
  
  def upload():
  
      if(request.method == 'POST'):
  
          f = request.files['file']
  
          app.logger.info(f'AUDIO FORMAT\n\n\n\n\n\n\n\n\n\n: {f}')
  
          proc = (
  
              ffmpeg.input('pipe:')
  
              .output('pipe:', format='aiff')
  
              .run_async(pipe_stdin=True,pipe_stdout=True, pipe_stderr=True)
  
          )
  
          audioFile,err = proc.communicate(input=f.read())
  
          audioFile =  BytesIO(audioFile)
  
          scaler = pickle.load(open("scaler.ok","rb"))
  
          x , sr = librosa.load(audioFile,mono=True,duration=5)
  
          y=x
  
          #Extract the features
  
          chroma_stft = librosa.feature.chroma_stft(y=y, sr=sr)
  
          spec_cent = librosa.feature.spectral_centroid(y=y, sr=sr)
  
          spec_bw = librosa.feature.spectral_bandwidth(y=y, sr=sr)
  
          rolloff = librosa.feature.spectral_rolloff(y=y, sr=sr)
  
          zcr = librosa.feature.zero_crossing_rate(y)
  
          rmse = librosa.feature.rms(y=y)
  
          mfcc = librosa.feature.mfcc(y=y, sr=sr)
  
          features = f'{np.mean(chroma_stft)} {np.mean(rmse)} {np.mean(spec_cent)} {np.mean(spec_bw)} {np.mean(rolloff)} {np.mean(zcr)}'    
  
          for e in mfcc:
  
              features += f' {np.mean(e)}'
  
          input_data2 = np.array([float(i) for i in features.split(" ")]).reshape(1,-1)
  
          input_data2 = scaler.transform(input_data2)
  
          return jsonify(input_data2.tolist())
  
  
  
  # driver function 
  
  if __name__ == '__main__':   
  
      app.run(debug = True) 

  Aptfile :

  libsndfile1
  
  libsndfile-dev
  
  libav-tools
  
  libavcodec-extra-53 
  
  libavcodec-extra-53
  
  ffmpeg 

  requirements.txt :

  aniso8601==8.0.0
  
  audioread==2.1.8
  
  certifi==2019.11.28
  
  cffi==1.14.0
  
  Click==7.0
  
  decorator==4.4.2
  
  ffmpeg-python==0.2.0
  
  Flask==1.1.1
  
  Flask-RESTful==0.3.8
  
  future==0.18.2
  
  gunicorn==20.0.4
  
  itsdangerous==1.1.0
  
  Jinja2==2.11.1
  
  joblib==0.14.1
  
  librosa==0.7.2
  
  llvmlite==0.31.0
  
  MarkupSafe==1.1.1
  
  marshmallow==3.2.2
  
  numba==0.48.0
  
  numpy==1.18.1
  
  pycparser==2.20
  
  pydub==0.23.1
  
  pytz==2019.3
  
  resampy==0.2.2
  
  scikit-learn==0.22.2.post1
  
  scipy==1.4.1
  
  six==1.14.0
  
  SoundFile==0.10.3.post1
  
  Werkzeug==1.0.0
  
  wincertstore==0.2

• doc/platform : drop reference to ffmpeg.zeranoe.com

  28 mars 2023, par Stefano Sabatini

  doc/platform : drop reference to ffmpeg.zeranoe.com
  It was closed in September 2020.
  Fix issue :
  
  http://trac.ffmpeg.org/ticket/9734
  

  • [DH] doc/platform.texi

• How to Check Website Traffic As Accurately As Possible

  18 août 2023, par Erin — Analytics Tips

  If you want to learn about the health of your website and the success of your digital marketing initiatives, there are few better ways than checking your website traffic. 

  It’s a great way to get a quick dopamine hit when things are up, but you can also use traffic levels to identify issues, learn more about your users or benchmark your performance. That means you need a reliable and easy way to check your website traffic over time — as well as a way to check out your competitors’ traffic levels, too. 

  In this article, we’ll show you how to do just that. You’ll learn how to check website traffic for both your and your competitor’s sites and discover why some methods of checking website traffic are better than others. 

  Why check website traffic ? 

  Dopamine hits aside, it’s important to constantly monitor your website’s traffic for several reasons.

  

  Benchmark site performance

  Keeping regular tabs on your traffic levels is a great way to track your website’s performance over time. It can help you plan for the future or identify problems. 

  For instance, growing traffic levels may mean expanding your business’s offering or investing in more inventory. On the flip side, decreasing traffic levels may suggest it’s time to revamp your marketing strategies or look into issues impacting your SEO. 

  Analyse user behaviour

  Checking website traffic and user behaviour lets marketing managers understand how users interact with your website. Which pages are they visiting ? Which CTAs do they click on ? What can you do to encourage users to take the actions you want ? You can also identify issues that lead to high bounce rates and other problems. 

  The better you understand user behaviour, the easier it will be to give them what they want. For example, you may find that users spend more time on your landing pages than they do your blog pages. You could use that information to revise how you create blog posts or focus on creating more landing pages. 

  Improve the user experience

  Once you understand how users behave on your website, you can use that information to fix errors, update your content and improve the user experience for the site. 

  You can even personalise the experience for customers, leading to significant growth. Research shows companies that grow faster derive 40% more of their revenue from personalisation. 

  That could come in the form of sweeping personalisations — like rearranging your website’s navigation bar based on user behaviour — or individual personalisation that uses analytics to transform sections or entire pages of your site based on user behaviour. 

  Optimise marketing strategies

  You can use website traffic reports to understand where users are coming from and optimise your marketing plan accordingly. You may want to double down on organic traffic, for instance, or invest more in PPC advertising. Knowing current traffic estimates and how these traffic levels have trended over time can help you benchmark your campaigns and prioritise your efforts. 

  Increasing traffic levels from other countries can also help you identify new marketing opportunities. If you start seeing significant traffic levels from a neighbouring country or a large market, it could be time to take your business international and launch a cross-border campaign. 

  Filter unwanted traffic

  A not-insignificant portion of your site’s traffic may be coming from bots and other unwanted sources. These can compromise the quality of your analytics and make it harder to draw insights. You may not be able to get rid of this traffic, but you can use analytics tools to remove it from your stats. 

  How to check website traffic on Matomo

  If you want to check your website’s traffic, you’d be forgiven for heading to Google Analytics first. It’s the most popular analytics tool on the market, after all. But if you want a more reliable assessment of your website’s traffic, then we recommend using Matomo alongside Google Analytics. 

  The Matomo web analytics platform is an open-source solution that helps you collect accurate data about your website’s traffic and make more informed decisions as a result — all while enhancing the customer experience and ensuring GDPR compliance and user privacy. 

  Matomo also offers multiple ways to check website traffic :

  • Visits log report
  • Real-time visitor map
  • Visits in real-time report

  Let’s look at all of them one by one. 

  The visits log report is a unique rundown of all of the individual visitors to your site. This offers a much more granular view than other tools that just show the total number of visitors for a given period. 

  

  You can access the visits log report by clicking on the reporting menu, then clicking Visitor and Visits Log. From there, you’ll be able to scroll through every user session and see the following information :

  • The location of the user
  • The total number of actions they took
  • The length of time on site
  • How they arrived at your site
  • And the device they used to access your site 

  This may be overwhelming if your site receives thousands of visitors at a time. But it’s a great way to understand users at an individual level and appreciate the lifetime activity of specific users. 

  The Real-time visitor map is a visual display of users’ location for a given timeframe. If you have an international website, it’s a fantastic way to see exactly where in the world your traffic comes from.

  

  You can access the Real-time Visitor Map by clicking Visitor in the main navigation menu and then Real-time Map. The map itself is colour-coded. Larger orange bubbles represent recent visits, and smaller dark orange and grey bubbles represent older visits. The map will refresh every five seconds, and new users appear with a flashing effect. 

  If you run TV or radio adverts, Matomo’s Real-time Map provides an immediate read on the effectiveness of your campaign. If your map lights up in the minutes following your ad, you know it’s been effective. It can also help you identify the source of bot attacks, too. 

  Finally, the Visits in Real-time report provides a snapshot of who is browsing your website. You can access this report under Visitors > Real-time and add it to your custom dashboards as a widget. 

  Open the report, and you’ll see the real-time flow of your site’s users and counters for visits and pageviews over the last 30 minutes and 24 hours. The report refreshes every five seconds with new users added to the top of the report with a fade-in effect.

  

  The report provides a snapshot of each visitor, including :

  • Whether they are new or a returning 
  • Their country
  • Their browser
  • Their operating system
  • The number of actions they took
  • The time they spent on the site
  • The channel they came in from
  • Whether the visitor converted a goal

  3 other ways to check website traffic

  You don’t need to use Matomo to check your website traffic. Here are three other tools you can use instead. 

  How to check website traffic on Google Analytics

  Google Analytics is usually the first starting point for anyone looking to check their website traffic. It’s free to use, incredibly popular and offers a wide range of traffic reports. 

  Google Analytics lets you break down historical traffic data almost any way you wish. You can split traffic by acquisition channel (organic, social media, direct, etc.) by country, device or demographic.

  

  It also provides real-time traffic reports that give you a snapshot of users on your site right now and over the last 30 minutes. 

  

  Google Analytics may be one of the most popular ways to check website traffic, but it could be better. Google Analytics 4 is difficult to use compared to its predecessor, and it also limits the amount of data you can track in accordance with privacy laws. If users refuse your cookie consent, Google Analytics won’t record these visits. In other words, you aren’t getting a complete view of your traffic by using Google Analytics alone. 

  That’s why it’s important to use Google Analytics alongside other web analytics tools (like Matomo) that don’t suffer from the same privacy issues. That way, you can make sure you track every single user who visits your site. 

  How to check website traffic on Google Search Console

  Google Search Console is a free tool from Google that lets you analyse the search traffic that your site gets from Google. 

  The top-line report shows you how many times your website has appeared in Google Search, how many clicks it has received, the average clickthrough rate and the average position of your website in the search results. 

  

  Google Search Console is a great way to understand what you rank for and how much traffic your organic rankings generate. It will also show you which pages are indexed in Google and whether there are any crawling errors. 

  Unfortunately, Google Search Console is limited if you want to get a complete view of your traffic. While you can analyse search traffic in a huge amount of detail, it will not tell you how users who access your website directly or via social media behave. 

  How to check website traffic on Similarweb

  Similarweb is a website analysis tool that estimates the total traffic of any site on the internet. It is one of the best tools for estimating how much traffic your competitors receive. 

  What’s great about Similarweb is that it estimates total traffic, not just traffic from search engines like many SEO tools. It even breaks down traffic by different channels, allowing you to see how your website compares against your competitors. 

  

  As you can see from the image above, Similarweb provides an estimate of total visits, bounce rate, the average number of pages users view per visit and the average duration on the site. The company also has a free browser extension that lets you check website traffic estimates as you browse the web. 

  You can use Similarweb for free to a point. But to really get the most out of this tool, you’ll need to upgrade to a premium plan which starts at $125 per user per month. 

  The price isn’t the only downside of using Similarweb to check the traffic of your own and your competitor’s websites. Ultimately, Similarweb is only an estimate — even if it’s a reasonably accurate one — and it’s no match for a comprehensive analytics tool. 

  7 website traffic metrics to track

  Now that you know how to check your website’s traffic, you can start to analyse it. You can use plenty of metrics to assess the quality of your website traffic, but here are some of the most important metrics to track. 

  • New visitors : These are users who have never visited your website before. They are a great sign that your marketing efforts are working and your site is reaching more people. But it’s also important to track how they behave on the website to ensure your site caters effectively to new visitors. 
  • Returning visitors : Returning visitors are coming back to your site for a reason : either they like the content you’re creating or they want to make a purchase. Both instances are great. The more returning visitors, the better. 
  • Bounce rate : This is a measure of how many users leave your website without taking action. Different analytics tools measure this metric differently.
  • Session duration : This is the length of time users spend on your website, and it can be a great gauge of whether they find your site engaging. Especially when combined with the metric below. 
  • Pages per session : This measures how many different pages users visit on average. The more pages they visit and the longer users spend on your website, the more engaging it is. 
  • Traffic source : Traffic can come from a variety of sources (organic, direct, social media, referral, etc.) Tracking which sources generate the most traffic can help you analyse and prioritise your marketing efforts. 
  • User demographics : This broad metric tells you more about who the users are that visit your website, what device they use, what country they come from, etc. While the bulk of your website traffic will come from the countries you target, an influx of new users from other countries can open the door to new opportunities.

  Why do my traffic reports differ ?

  If you use more than one of the methods above to check your website traffic, you’ll quickly realise that every traffic report differs. In some cases, the reasons are obvious. Any tool that estimates your traffic without adding code to your website is just that : an estimate. Tools like Similarweb will never offer the accuracy of analytics platforms like Matomo and Google Analytics. 

  But what about the differences between these analytics platforms themselves ? While each platform has a different way of recording user behaviour, significant differences in website traffic reports between analytics platforms are usually a result of how each platform handles user privacy. 

  A platform like Google Analytics requires users to accept a cookie consent banner to track them. If they accept, great. Google collects all of the data that any other analytics platform does. It may even collect more. If users reject cookie consent banners, however, then Google Analytics can’t track these visitors at all. They simply won’t show up in your traffic reports. 

  That doesn’t happen with all analytics platforms, however. A privacy-focused alternative like Matomo doesn’t require cookie consent banners (apart from in the United Kingdom and Germany) and can therefore continue to track visitors even after they have rejected a cookie consent screen from Google Analytics. This means that virtually all of your website traffic will be tracked regardless of whether users accept a cookie consent banner or not. And it’s why traffic reports in Matomo are often much higher than they are in Google Analytics.

  

  Given that around half (47.32%) of adults in the European Union refuse to allow the use of personal data tracking for advertising purposes and that 95% of people will reject additional cookies when it is easy to do so, this means you could have vastly different traffic reports — and be missing out on a significant amount of user data. 

  If you’re serious about using web analytics to improve your website and optimise your marketing campaigns, then it is essential to use another analytics platform alongside Google Analytics. 

  Get more accurate traffic reports with Matomo

  There are several methods to check website traffic. Some, like Similarweb, can provide estimates on your competitors’ traffic levels. Others, like Google Analytics, are free. But data doesn’t lie. Only privacy-focused analytics solutions like Matomo can provide accurate reports that account for every visitor. 

  Join over one million organisations using Matomo to accurately check their website traffic. Try it for free alongside GA today. No credit card required.