sbfsg.net
robots.txt

Robots Exclusion Standard data for sbfsg.net

Resource Scan

Scan Details

Site Domain sbfsg.net
Base Domain sbfsg.net
Scan Status Ok
Last Scan2024-11-11T18:53:42+00:00
Next Scan 2024-12-11T18:53:42+00:00

Last Scan

Scanned2024-11-11T18:53:42+00:00
URL https://sbfsg.net/robots.txt
Domain IPs 104.21.57.149, 172.67.146.166, 2606:4700:3032::6815:3995, 2606:4700:3036::ac43:92a6
Response IP 104.21.57.149
Found Yes
Hash 2a7151806e2cbafd9fde314e9de3a2d52db94260ee06a60b697be725b0ea79de
SimHash 673cd060eb50

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

amazonbot

Rule Path
Disallow /do-not-crawl/