Okrzyki, przyjaciel! (chaircrusher) wrote,
Okrzyki, przyjaciel!
chaircrusher

When the Internet Vultures Come To Roost...

Every so often when you have a website, you find out that the most popular URLs for the site are files you forgot you uploaded, or linked to, or...

This is particularly true of mp3 files, and the reason was a surprise to me, but it shouldn't have been. Sites like http://www.tagoo.ru use web crawlers to find audio and video files. And apparently they don't honor robots.txt files either.

So I resolve in this new year to replace those files on my site when I notice them being downloaded a lot with ridiculous replacements...
Subscribe
  • Post a new comment

    Error

    default userpic

    Your reply will be screened

    Your IP address will be recorded 

    When you submit the form an invisible reCAPTCHA check will be performed.
    You must follow the Privacy Policy and Google Terms of use.
  • 0 comments