Re: Got a puzzle here
On Friday 01 November 2019 13:43:04 tomas@tuxteam.de wrote:
> On Fri, Nov 01, 2019 at 01:12:46PM -0400, Gene Heskett wrote:
> > On Friday 01 November 2019 12:42:21 tomas@tuxteam.de wrote:
>
> [...]
>
> > > https://en.wikipedia.org/wiki/Robots.txt
> >
> > Did that, blanket Disallow for all didn't stop them. But they are
> > spacing out the requests now, so the average traffic is very low. I
> > can tolerate that.
>
> You can block by user agent, that's more drastic.
>
> If I've been paying attention, you are on apache. Then this might
> be relevant:
>
>
> https://httpd.apache.org/docs/2.4/rewrite/access.html#blocking-of-robo
>ts
>
Unfortunately its starts with a very fuzzy explanation of where to put
all those examples. I suspect thats because I probably don't have near
all of apache2 installed.
> Cheers
> -- t
Cheers, Gene Heskett
--
"There are four boxes to be used in defense of liberty:
soap, ballot, jury, and ammo. Please use in that order."
-Ed Howdershelt (Author)
If we desire respect for the law, we must first make the law respectable.
- Louis D. Brandeis
Genes Web page <http://geneslinuxbox.net:6309/gene>
Reply to: