sbfsg.life
robots.txt

Robots Exclusion Standard data for sbfsg.life

Resource Scan

Scan Details

Site Domain sbfsg.life
Base Domain sbfsg.life
Scan Status Ok
Last Scan5/1/2025, 11:03:48 PM
Next Scan 5/31/2025, 11:03:48 PM

Last Scan

Scanned5/1/2025, 11:03:48 PM
URL https://sbfsg.life/robots.txt
Domain IPs 104.21.50.203, 172.67.166.201, 2606:4700:3033::6815:32cb, 2606:4700:3033::ac43:a6c9
Response IP 104.21.50.203
Found Yes
Hash 2a7151806e2cbafd9fde314e9de3a2d52db94260ee06a60b697be725b0ea79de
SimHash 673cd060eb50

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

amazonbot

Rule Path
Disallow /do-not-crawl/