Recherche avancée

Sur d’autres sites (5266)

• FFmpeg, access violation on av_frame_free when running though Unity

  27 octobre 2016, par Mockarutan

  I’m working on a video recording plugin for Unity using ffmpeg. I’m new to the video encoding domain and just got my code to work today. But I think a might have a few memory leaks and trying to fix them crashes Unity.

  The plugin is written i c++ (as external "C" code) and imported in a c# script in unity with a simple DllImport. Again, this is not my comfort area either, but it works.

  When a screen buffer is rendered, I put in a RGB24 buffer and send it to my c++ function, this one :

  int encode_frame(uint8_t* rgb24Data)
  
  {
  
      AVFrame *frame = av_frame_alloc();
  
      if (!frame)
  
          return COULD_NOT_ALLOCATE_FRAME;
  
  
  
      frame->format = codec_context->pix_fmt;
  
      frame->width = codec_context->width;
  
      frame->height = codec_context->height;
  
  
  
      int ret = av_image_alloc(frame->data, frame->linesize, codec_context->width, codec_context->height, codec_context->pix_fmt, 32);
  
      if (ret < 0)
  
          return COULD_NOT_ALLOCATE_PIC_BUF;
  
  
  
      SwsContext * ctx = sws_getContext(codec_context->width, codec_context->height,
  
          AV_PIX_FMT_RGB24, codec_context->width, codec_context->height,
  
          AV_PIX_FMT_YUV420P, 0, 0, 0, 0);
  
  
  
  
  
      uint8_t * inData[1] = { rgb24Data };
  
      int inLinesize[1] = { 3 * codec_context->width };
  
  
  
      sws_scale(ctx, inData, inLinesize, 0, codec_context->height, frame->data, frame->linesize); // From RGB to YUV
  
  
  
      frame->pts = frame_counter++;
  
  
  
      ret = avcodec_send_frame(codec_context, frame);
  
      if (ret < 0)
  
          return ERROR_ENCODING_FRAME_SEND;
  
  
  
      AVPacket pkt;
  
      av_init_packet(&pkt);
  
      pkt.data = NULL;
  
      pkt.size = 0;
  
  
  
      while (true)
  
      {
  
          ret = avcodec_receive_packet(codec_context, &pkt);
  
          if (!ret)
  
          {
  
              if (pkt.pts != AV_NOPTS_VALUE)
  
                  pkt.pts = av_rescale_q(pkt.pts, codec_context->time_base, video_st->time_base);
  
              if (pkt.dts != AV_NOPTS_VALUE)
  
                  pkt.dts = av_rescale_q(pkt.dts, codec_context->time_base, video_st->time_base);
  
  
  
              av_write_frame(outctx, &pkt);
  
              av_packet_unref(&pkt);
  
          }
  
          else if (ret == AVERROR(EAGAIN))
  
          {
  
              frame->pts = frame_counter++;
  
              ret = avcodec_send_frame(codec_context, frame);
  
              if (ret < 0)
  
                  return ERROR_ENCODING_FRAME_SEND;
  
          }
  
          else if (ret < 0)
  
              return ERROR_ENCODING_FRAME_RECEIVE;
  
          else
  
              break;
  
      }
  
  
  
      // This one
  
      av_frame_free(&frame);
  
  }

  Now, this code might have a lot of issues that I’m not aware of, and you are free to point them out if you like. But the line that gives me error is av_frame_free(&frame);.

  If I run this in a synthetic test app in c++ that I made, it works. I can even run it in a c# synthetic test app (exactly like the c++ one), and it works. But if I run it though Unity, it crashes on the first frame. The log says "Read from location fe7f8097 caused an access violation.".

  I have tried with av_freep() and av_free(). Not sure exactly what makes them different (different example codes use different ones), but none work.

  So, what I’m I missing ? The frame is leaking if I don’t free it right ? But why does it crash in Unity ?

  The whole thing works great in Unity if I don’t have the av_frame_free(&frame);. Resulting video looks great !

  PS. I’m aware (as far as I know) that the frame also leaks if something fails and returns an error code. But one thing at a time.

• FFmpeg, access violation on av_frame_free when running though Unity

  1er février 2021, par Mockarutan

  I'm working on a video recording plugin for Unity using ffmpeg. I'm new to the video encoding domain and just got my code to work today. But I think a might have a few memory leaks and trying to fix them crashes Unity.

  



  The plugin is written i c++ (as external "C" code) and imported in a c# script in unity with a simple DllImport. Again, this is not my comfort area either, but it works.

  



  When a screen buffer is rendered, I put in a RGB24 buffer and send it to my c++ function, this one :

  



  int encode_frame(uint8_t* rgb24Data)
{
    AVFrame *frame = av_frame_alloc();
    if (!frame)
        return COULD_NOT_ALLOCATE_FRAME;

    frame->format = codec_context->pix_fmt;
    frame->width = codec_context->width;
    frame->height = codec_context->height;

    int ret = av_image_alloc(frame->data, frame->linesize, codec_context->width, codec_context->height, codec_context->pix_fmt, 32);
    if (ret < 0)
        return COULD_NOT_ALLOCATE_PIC_BUF;

    SwsContext * ctx = sws_getContext(codec_context->width, codec_context->height,
        AV_PIX_FMT_RGB24, codec_context->width, codec_context->height,
        AV_PIX_FMT_YUV420P, 0, 0, 0, 0);


    uint8_t * inData[1] = { rgb24Data };
    int inLinesize[1] = { 3 * codec_context->width };

    sws_scale(ctx, inData, inLinesize, 0, codec_context->height, frame->data, frame->linesize); // From RGB to YUV

    frame->pts = frame_counter++;

    ret = avcodec_send_frame(codec_context, frame);
    if (ret < 0)
        return ERROR_ENCODING_FRAME_SEND;

    AVPacket pkt;
    av_init_packet(&pkt);
    pkt.data = NULL;
    pkt.size = 0;

    while (true)
    {
        ret = avcodec_receive_packet(codec_context, &pkt);
        if (!ret)
        {
            if (pkt.pts != AV_NOPTS_VALUE)
                pkt.pts = av_rescale_q(pkt.pts, codec_context->time_base, video_st->time_base);
            if (pkt.dts != AV_NOPTS_VALUE)
                pkt.dts = av_rescale_q(pkt.dts, codec_context->time_base, video_st->time_base);

            av_write_frame(outctx, &pkt);
            av_packet_unref(&pkt);
        }
        else if (ret == AVERROR(EAGAIN))
        {
            frame->pts = frame_counter++;
            ret = avcodec_send_frame(codec_context, frame);
            if (ret < 0)
                return ERROR_ENCODING_FRAME_SEND;
        }
        else if (ret < 0)
            return ERROR_ENCODING_FRAME_RECEIVE;
        else
            break;
    }

    // This one
    av_frame_free(&frame);
}


  



  Now, this code might have a lot of issues that I'm not aware of, and you are free to point them out if you like. But the line that gives me error is av_frame_free(&frame);.

  



  If I run this in a synthetic test app in c++ that I made, it works. I can even run it in a c# synthetic test app (exactly like the c++ one), and it works. But if I run it though Unity, it crashes on the first frame. The log says "Read from location fe7f8097 caused an access violation.".

  



  I have tried with av_freep() and av_free(). Not sure exactly what makes them different (different example codes use different ones), but none work.

  



  So, what I'm I missing ? The frame is leaking if I don't free it right ? But why does it crash in Unity ?

  



  The whole thing works great in Unity if I don't have the av_frame_free(&frame);. Resulting video looks great !

  



  PS. I'm aware (as far as I know) that the frame also leaks if something fails and returns an error code. But one thing at a time.

  


• Four Trends Shaping the Future of Analytics in Banking

  27 novembre 2024, par Daniel Crough — Banking and Financial Services

  While retail banking revenues have been growing in recent years, trends like rising financial crimes and capital required for generative AI and ML tech pose significant risks and increase operating costs across the financial industry, according to McKinsey’s State of Retail Banking report.

   

  Today’s financial institutions are focused on harnessing AI and advanced analytics to make their data work for them. To be up to the task, analytics solutions must allow banks to give consumers the convenient, personalised experiences they want while respecting their privacy.

   

  In this article, we’ll explore some of the big trends shaping the future of analytics in banking and finance. We’ll also look at how banks use data and technology to cut costs and personalise customer experiences.
  
  So, let’s get into it.

  

  This doesn’t just represent a security risk, it also impacts the usability for both customers and employees. Does any of the following sound familiar ?

  • Only specific senior employees know how to navigate the software to generate custom reports or use its more advanced features.
  • Customer complaints about your site’s usability or online banking experience are routine.
  • Onboarding employees takes much longer than necessary because of convoluted systems.
  • Teams and departments experience ‘data siloing,’ meaning that not everyone can access the data they need.

  These are warning signs that IT systems are ready for a review. Anyone thinking, “If it’s not broken, why fix it ?” should consider that legacy systems can also present data security risks. As more countries introduce regulations to protect customer privacy, staying ahead of the curve is increasingly important to avoid penalties and litigation.

  And regulations aren’t the only trends impacting the future of financial institutions’ IT and analytics.

  4 trends shaping the future of analytics in banking

  New regulations and new technology have changed the landscape of analytics in banking.

  New privacy regulations impact banks globally

  The first major international example was the advent of GDPR, which went into effect in the EU in 2018. But a lot has happened since. New privacy regulations and restrictions around AI continue to roll out.

  • The European Artificial Intelligence Act (EU AI Act), which was held up as the world’s first comprehensive legislation on AI, took effect on 31 July 2024.
  • In Europe’s federated data initiative, Gaia-X’s planned cloud infrastructure will provide for more secure, transparent, and trustworthy data storage and processing.
  • The revised Payment Services Directive (PSD2) makes payments more secure and strengthens protections for European businesses and consumers, aiming to create a more integrated and efficient payments market.

  But even businesses that don’t have customers in Europe aren’t safe. Consumer privacy is a hot-button issue globally.

  For example, the California Consumer Privacy Act (CCPA), which took effect in January, impacts the financial services industry more than any other. Case in point, 34% of CCPA-related cases filed in 2022 were related to the financial sector.

  California’s privacy regulations were the first in the US, but other states are following closely behind. On 1 July 2024, new privacy laws went into effect in Florida, Oregon, and Texas, giving people more control over their data.

  

  One typical issue for companies in the banking industry is that their privacy measures regarding user data collected from their website are much less lax than those in their online banking system.

  It’s better to proactively invest in a privacy-centric analytics platform before you get tangled up in a lawsuit and have to pay a fine (and are forced to change your system anyway). 

  And regulatory compliance isn’t the only bonus of an ethical analytics solution. The right alternative can unlock key customer insights that can help you improve the user experience.

  The demand for personalised banking services

  At the same time, consumers are expecting a more and more streamlined personal experience from financial institutions. 86% of bank employees say personalisation is a clear priority for the company. But 63% described resources as limited or only available after demonstrating clear business cases.

  McKinsey’s The data and analytics edge in corporate and commercial banking points out how advanced analytics are empowering frontline bank employees to give customers more personalised experiences at every stage :

  • Pre-meeting/meeting prep : Using advanced analytics to assess customer potential, recommend products, and identify prospects who are most likely to convert
  • Meetings/negotiation : Applying advanced models to support price negotiations, what-if scenarios and price multiple products simultaneously
  • Post-meeting/tracking : Using advanced models to identify behaviours that lead to high performance and improve forecast accuracy and sales execution

  Today’s banks must deliver the personalisation that drives customer satisfaction and engagement to outperform their competitors.

  The rise of AI and its role in banking

  With AI and machine learning technologies becoming more powerful and accessible, financial institutions around the world are already reaping the rewards.

  McKinsey estimates that AI in banking could add $200 to 340 billion annually across the global banking sector through productivity gains.

  • Credit card fraud prevention : Algorithms analyse usage to flag and block fraudulent transactions.
  • More accurate forecasting : AI-based tools can analyse a broader spectrum of data points and forecast more accurately.
  • Better risk assessment and modelling : More advanced analytics and predictive models help avoid extending credit to high-risk customers.
  • Predictive analytics : Help spot clients most likely to churn 
  • Gen-AI assistants : Instantly analyse customer profiles and apply predictive models to suggest the next best actions.

  Considering these market trends, let’s discuss how you can move your bank into the future.

  Using analytics to minimise risk and establish a competitive edge 

  With the right approach, you can leverage analytics and AI to help future-proof your bank against changing customer expectations, increased fraud, and new regulations.

  Use machine learning to prevent fraud

  Every year, more consumers are victims of credit and debit card fraud. Debit card skimming cases nearly doubled in the US in 2023. The last thing you want as a bank is to put your customer in a situation where a criminal has spent their money.

  This not only leads to a horrible customer experience but also creates a lot of internal work and additional costs.Thankfully, machine learning can help identify suspicious activity and stop transactions before they go through. For example, Mastercard’s fraud prevention model has improved fraud detection rates by 20–300%.

  

  Implementing a solution like this (or partnering with credit card companies who use it) may be a way to reduce risk and improve customer trust.

  Foresee and avoid future issues with AI-powered risk management

  Regardless of what type of financial products organisations offer, AI can be an enormous tool. Here are just a few ways in which it can mitigate financial risk in the future :

  • Predictive analytics can evaluate risk exposure and allow for more informed decisions about whether to approve commercial loan applications.
  • With better credit risk modelling, banks can avoid extending personal loans to customers most likely to default.
  • Investment banks (or individual traders or financial analysts) can use AI- and ML-based systems to monitor market and trading activity more effectively.

  Those are just a few examples that barely scratch the surface. Many other AI-based applications and analytics use cases exist across all industries and market segments.

  Protect customer privacy while still getting detailed analytics

  New regulations and increasing consumer privacy concerns don’t mean banks and financial institutions should forego website analytics altogether. Its insights into performance and customer behaviour are simply too valuable. And without customer interaction data, you’ll only know something’s wrong if someone complains.

  Fortunately, it doesn’t have to be one or the other. The right financial analytics solution can give you the data and insights needed without compromising privacy while complying with regulations like GDPR and CCPA.

  That way, you can track usage patterns and improve site performance and content quality based on accurate data — without compromising privacy. Reliable, precise analytics are crucial for any bank that’s serious about user experience.

  Use A/B testing and other tools to improve digital customer experiences

  Personalised digital experiences can be key differentiators in banking and finance when done well. But there’s stiff competition. In 2023, 40% of bank customers rated their bank’s online and mobile experience as excellent. 

  Improving digital experiences for users while respecting their privacy means going above and beyond a basic web analytics tool like Google Analytics. Invest in a platform with features like A/B tests and user session analysis for deeper insights into user behaviour.

  

  Behavioural analytics are crucial to understanding customer interactions. By identifying points of friction and drop-off points, you can make digital experiences smoother and more engaging.

  Matomo offers all this and is a great GDPR-compliant alternative to Google Analytics for banks and financial institutions. 

  Of course, this can be challenging. This is why taking an ethical and privacy-centric approach to analytics can be a key competitive edge for banks. Prioritising data security and privacy will attract other like-minded, ethically conscious consumers and boost customer loyalty.

  Get privacy-friendly web analytics suitable for banking & finance with Matomo

  Improving digital experiences for today’s customers requires a solid web analytics platform that prioritises data privacy and accurate analytics. And choosing the wrong one could even mean ending up in legal trouble or scrambling to reconstruct your entire analytics setup.

  Matomo provides privacy-friendly analytics with 100% data accuracy (no sampling), advanced privacy controls and the ability to run A/B tests and user session analysis within the same platform (limiting risk and minimising costs). 

  It’s easy to get started with Matomo. Users can access clear, easy-to-understand metrics and plenty of pre-made reports that deliver valuable insights from day one. Form usage reports can help banks and fintechs identify potential issues with broken links or technical glitches and reveal clues on improving UX in the short term.

  Over one million websites, including some of the world’s top banks and financial institutions, use Matomo for their analytics.

  Start your 21-day free trial to see why, or book a demo with one of our analytics experts.