larvelfaucet.com
robots.txt

Robots Exclusion Standard data for larvelfaucet.com

Resource Scan

Scan Details

Site Domain larvelfaucet.com
Base Domain larvelfaucet.com
Scan Status Ok
Last Scan2024-11-13T22:04:00+00:00
Next Scan 2024-11-20T22:04:00+00:00

Last Scan

Scanned2024-11-13T22:04:00+00:00
URL https://larvelfaucet.com/robots.txt
Domain IPs 104.26.10.98, 104.26.11.98, 172.67.72.97
Response IP 104.26.11.98
Found Yes
Hash 82f151dd74db4c7190a5df068e3f90a8daafe5a2c56663e7d5294233d86ab6d9
SimHash c14cc2704332

Groups

proximic

Rule Path
Disallow /

*

Rule Path
Allow /

admantx

Rule Path
Disallow /

Warnings

  • 1 invalid line.
  • `crawler` is not a known field.