benfrain.com
robots.txt

Robots Exclusion Standard data for benfrain.com

Resource Scan

Scan Details

Site Domain benfrain.com
Base Domain benfrain.com
Scan Status Ok
Last Scan2025-10-12T18:29:32+00:00
Next Scan 2025-10-26T18:29:32+00:00

Last Scan

Scanned2025-10-12T18:29:32+00:00
URL https://benfrain.com/robots.txt
Domain IPs 104.21.4.35, 172.67.131.156, 2606:4700:3033::6815:423, 2606:4700:3036::ac43:839c
Response IP 104.21.4.35
Found Yes
Hash 97437accc3e33538236038bf342d2818de6d85359eb16acbc1c87e86ec6af7ea
SimHash 6558c4c4c595

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30