sbfsg.net
robots.txt
Robots Exclusion Standard data for sbfsg.net
Resource Scan
Scan Details
Site Domain | sbfsg.net |
Base Domain | sbfsg.net |
Scan Status | Ok |
Last Scan | 2024-11-11T18:53:42+00:00 |
Next Scan | 2024-12-11T18:53:42+00:00 |
Last Scan
Scanned | 2024-11-11T18:53:42+00:00 |
URL | https://sbfsg.net/robots.txt |
Domain IPs | 104.21.57.149, 172.67.146.166, 2606:4700:3032::6815:3995, 2606:4700:3036::ac43:92a6 |
Response IP | 104.21.57.149 |
Found | Yes |
Hash | 2a7151806e2cbafd9fde314e9de3a2d52db94260ee06a60b697be725b0ea79de |
SimHash | 673cd060eb50 |
Groups
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 5 |