ramenparados.com
robots.txt

Robots Exclusion Standard data for ramenparados.com

Resource Scan

Scan Details

Site Domain ramenparados.com
Base Domain ramenparados.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-27T06:44:19+00:00
Next Scan 2024-07-27T06:44:19+00:00

Last Successful Scan

Scanned2024-05-29T06:43:12+00:00
URL https://ramenparados.com/robots.txt
Domain IPs 104.21.25.132, 172.67.134.66, 2606:4700:3034::6815:1984, 2606:4700:3036::ac43:8642
Response IP 172.67.134.66
Found Yes
Hash 42c6d2027cc2b8acd8056d1925d957632f704f8826401a1b1d20bdba4123bc71
SimHash 6018d8c0c735

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

Comments

  • Example 1: delay bots