gibson.com
robots.txt
Robots Exclusion Standard data for gibson.com
Resource Scan
Scan Details
Site Domain | gibson.com |
Base Domain | gibson.com |
Scan Status | Ok |
Last Scan | 2024-09-17T04:39:48+00:00 |
Next Scan | 2024-10-17T04:39:48+00:00 |
Last Scan
Scanned | 2024-09-17T04:39:48+00:00 |
URL | https://gibson.com/robots.txt |
Redirect | https://www.gibson.com/robots.txt |
Redirect Domain | www.gibson.com |
Redirect Base | gibson.com |
Domain IPs | 104.211.26.212 |
Redirect IPs | 13.107.246.59, 2620:1ec:bdf::59 |
Response IP | 13.107.246.59 |
Found | Yes |
Hash | bf336a9bf680ce331d75792c41268b52f69e2b337d6ad956dfeac7ff8a6904c0 |
SimHash | d460dd0463d4 |
Groups
*
Rule | Path |
---|---|
Disallow | /_scripts/ |
Disallow | /_styles/ |
Disallow | /error/debug |
Disallow | /News |