Recherche avancée

Sur d’autres sites (5677)

• Stopping Referrer Spam

  13 mai 2015, par Piwik Core Team — Community

  In this blog post we explain what is Referrer spam, this new kind of spam that has recently appeared on the Internet. We also provide solutions to stop it and preserve the quality of your analytics data.

  What is Referrer Spam ?

  Referrer spam (also known as log spam or referrer bombing) is a kind of spamming aimed at web analytics tools. A spammer bot makes repeated web site requests using a fake referrer URL to the site the spammer wishes to advertise.

  Here is an example of referrer spam in action :

  

  Half of those referrers are spams, here are some well know spammers that you may have seen in your logs : buttons-for-you-website.com, best-seo-offer.com, semalt.com…

  The benefit for spammers is that their website will appear in analytics tools like Piwik or Google Analytics :

  • public analytics reports (or logs) will be indexed by search engines : links to the spammer’s website will improve its ranking
  • curious webmasters are likely to visit their referrers, thus bringing traffic to the spammer’s website

  How to deal with Referrer Spam ?

  Referrer spam is still new and analytics tools are all handling it differently.

  Referrer Spam in Piwik

  At Piwik we started working on mitigating Referrer spam more than a year ago. If you use Piwik and keep it up to date, you do not need to do anything.

  Referrer spammers are automatically excluded from your reports to keep your data clean and useful.

  New spammers are continuously detected and added to Piwik’s blacklist on each update. If you find a new spammer in your analytics data, you can even report it so that it is added to the Piwik’s open referrer blacklist and blocked for everyone.

  Referrer Spam in Google Analytics

  Google Analytics doesn’t offer any spam protection by default. It can however be configured manually using a custom Filter.

  To create a filter in Google Analytics go to the Admin section and click on All Filters. Create a new custom filter that excludes based on the Campaign Source field. In the Filter pattern enter the spammers domains you want to exclude (this is a regular expression) :

  

  If new spammers arise you will need to update this list. You can also use Piwik’s referrer blacklist to exclude all the spammers currently detected.

  Other Analytics Tools

  Many web analytics tools do not yet handle Referrer spam and when using these tools, you will often find a lot of spam data in your Referrer Websites analytics reports.

  If you use an analytics tool that does not exclude Referrer spam, we recommend to contact the vendor and ask them to implement a mechanism to remove these referrer spammers. As of today many analytics vendors still have not mitigated this issue.

  Public List of Referrer Spammers

  At Piwik with the help of our large community we have decided to tackle this growing spam issue. We have created a list of up to date referrer spammers that anyone can edit.

  The list is available in a simple text file on Github : github.com/piwik/referrer-spam-blacklist.

  The list is released under the Public Domain and anyone can use it within their applications to exclude referrer spammers.

  Many people have already contributed new spammers to the list. We invite you to use the list in your apps and websites and help us keep the list up to date !

  Let’s unite and fight the spammers together.

  Happy Analytics !

• Convert image sequence to video using ffmpeg and list of files

  13 mai 2015, par rensa

  I have a camera taking time-lapse shots every 2–3 seconds, and I keep a rolling record of a few days’ worth. Because that’s a lot of files, I keep them in subdirectories by day and hour :

  images/
  
      2015-05-02/
  
          00/
  
              2015-05-02-0000-02
  
              2015-05-02-0000-05
  
              2015-05-02-0000-07
  
          01/
  
              (etc.)
  
      2015-05-03/

  I’m writing a script to automatically upload a timelapse of the sunrise to YouTube each day. I can get the sunrise time from the web in advance, then go back after the sunrise and get a list of the files that were taken in that period using find :

  touch -d "$SUNRISE_START" sunrise-start.txt
  
  touch -d "$SUNRISE_END" sunrise-end.txt
  
  find images/"$TODAY" -type f -anewer sunrise-start.txt ! -anewer sunrise-end.txt

  Now I want to convert those files to a video with ffmpeg. Ideally I’d like to do this without making a copy of all the files (because we’re talking 3.5 GB per hour of images), and I’d prefer not to rename them to something like image000n.jpg because other users may want to access the images. Copying the images is my fallback.

  But I’m getting stuck sending the results of find to ffmpeg. I understand that ffmpeg can expand wildcards internally, but I’m not sure that this is going to work where the files aren’t all in one directory. I also see a few people using find’s --exec option with ffmpeg to do batch conversions, but I’m not sure if this is going to work with image sequence input (as opposed to, say, converting 1000 images into 1000 single-frame videos).

  Any ideas on how I can connect the two—or, failing that, a better way to get files in a date range across several subdirectories into ffmpeg as an image sequence ?

• writeImages and renaming the images using PHP

  3 mai 2015, par Kiran Kumar Dash

  I am working on a multimedia project. So, I am having a case where I am producing a sequence of images from a string input using he code below :

  <?php
  
  
  
      /*** a new Imagick object ***/ 
  
      $aniGif = new Imagick();
  
  
  
      /*** set the image format to gif ***/
  
      $aniGif->setFormat( "gif" );
  
  
  
      /*** a new ImagickPixel object for the colors ***/
  
      $color = new ImagickPixel( "white" );
  
  
  
      /*** set color to white ***/
  
      $color->setColor( "white" );
  
  
  
      $colorarray =array("white", "red", "blue" , "aqua", "fuchsia", "gray", "lime", "maroon", "navy", "orange", "purple", "silver", "teal", "yellow",  "green", "maroon", "green", "olive");
  
  
  
      /*** the text for the image ***/
  
      $string = "Hello Kiran Kumar";
  
  
  
  
  
      /*** a new draw object ***/
  
      $draw = new ImagickDraw();
  
  
  
      /*** set the draw font to helvetica ***/
  
      $draw->setFont( "./SociaLAnimaL.ttf" );
  
  
  
      /*** set the draw font to helvetica ***/
  
      $draw->setFontSize( "100" );
  
  
  
      /*** loop over the text ***/
  
      for ( $i = 0; $i <= strlen( $string ); $i++ )
  
      {
  
          /*** grab a character ***/
  
          $part = substr( $string, 0, $i );
  
  
  
          /*** a new ImagickPixel object for the colors ***/
  
          $color = new ImagickPixel( "white" );
  
  
  
          /*Generate random number for random color*/
  
          $randomNumber = rand(0,16);
  
  
  
          /*** create a new gif frame ***/
  
          $aniGif->newImage( 1920, 1200, $colorarray[$randomNumber] );
  
  
  
          /*** add the character to the image ***/
  
          $aniGif->annotateImage( $draw, 960, 600, 0, $part );
  
  
  
          /*** set the frame delay to 30 ***/
  
          $aniGif->setImageDelay( 30 );
  
  
  
      }
  
       /*** write the file ***/
  
          $aniGif->writeImages($directory.'kiran.jpg', $out);
  
  
  
  
  
  
  
  
  
      echo 'all done';
  
  
  
  ?>

  Now the problem is the writeimages object is generating images as kiran-0.jpg, kiran-1.jpg, kiran-2.jpg and so on. but what I am expecting is kiran001.jpg, kiran002.jpg, kiran003.jpg...and so on so that I can create a video out of it in while maintaining the sequence.Here is the code for video creation :

  <?php
  
  $ffmpeg= "/home/kiran/bin/ffmpeg";
  
      echo exec("$ffmpeg -f image2 -framerate 2/1 -pattern_type glob -i \"/var/www/html/fftest/getthumbnail/tmp/animate/est/*.jpg\" -i \"/var/www/html/fftest/getthumbnail/audios/audio1.mp3\" -c:v libx264 -c:a copy -shortest  -s 1920x1080 -r 60 -vf \"format=yuv420p\" \"/var/www/html/fftest/getthumbnail/output/animatedaudiocolor21.avi\" 2>&1" , $output, $return);
  
  ?>

  As you can see I am using -pattern type glob to select all the images, but this is getting confused with he naming sequence of kiran-0, kiran-1.

  So, what I am expecting here is how can I use writeimage object o name my images as the way mentioned above. so that I can use kiran%03d.jpg in my ffmpeg command instead of *.jpg.

  Or if any one can help me providing a code so that I can rename all the images in the expected manner.I tried the below code to rename all images :

  <?php
  
  $fileFolder="/fftest/getthumbnail/tmp/animate/test";
  
  $directory = $_SERVER['DOCUMENT_ROOT'].$fileFolder.'/';
  
  
  
  $i = 001; 
  
  $handler = opendir($directory);
  
  while ($file = readdir($handler)) {
  
      if ($file != "." && $file != "..") {
  
          $newName = 'kiran'.$i ;
  
          rename($directory.$file, $directory.$newName); // here; prepended a $directory
  
          $i++;
  
      }
  
  }
  
  closedir($handler);
  
  
  
  ?>

  But the code is unable to rename the images in sequence.

  Help please...