112groningen.nl
robots.txt

Robots Exclusion Standard data for 112groningen.nl

Resource Scan

Scan Details

Site Domain 112groningen.nl
Base Domain 112groningen.nl
Scan Status Ok
Last Scan2024-11-12T17:43:02+00:00
Next Scan 2024-11-19T17:43:02+00:00

Last Scan

Scanned2024-11-12T17:43:02+00:00
URL https://112groningen.nl/robots.txt
Domain IPs 104.26.2.20, 104.26.3.20, 172.67.71.61, 2606:4700:20::681a:214, 2606:4700:20::681a:314, 2606:4700:20::ac43:473d
Response IP 104.26.2.20
Found Yes
Hash 75746b74a174cadfc0bb284f5e5e6b19091d7f98e1868cc57a5d9ebafdbfe641
SimHash a84059184d13

Groups

*

Rule Path
Disallow

litefinder

Rule Path
Disallow /

slurp

Rule Path
Disallow /

baidu

Rule Path
Disallow /

Comments

  • too many repeated hits, too quick
  • Yahoo. too many repeated hits, too quick
  • too many repeated hits, too quick