geekspin.co
robots.txt
Robots Exclusion Standard data for geekspin.co
Resource Scan
Scan Details
Site Domain | geekspin.co |
Base Domain | geekspin.co |
Scan Status | Ok |
Last Scan | 2024-05-28T22:11:21+00:00 |
Next Scan | 2024-06-04T22:11:21+00:00 |
Last Scan
Scanned | 2024-05-28T22:11:21+00:00 |
URL | https://geekspin.co/robots.txt |
Domain IPs | 104.19.154.92 |
Response IP | 104.19.154.92 |
Found | Yes |
Hash | 4da678329446be28385744e1412cdb75e9e879fd5b01df2d9a86853a40b154df |
SimHash | 610d4fa6f291 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /wp-admin/ |
Disallow | /linkout/ |
Disallow | /recommended/ |
Disallow | /comments/feed/ |
Disallow | /trackback/ |
Disallow | /index.php |
Disallow | /xmlrpc.php |
*
Rule | Path |
---|---|
Disallow | *?s=* |
*
Rule | Path |
---|---|
Disallow | */snax_item/* |
Other Records
Field | Value |
---|---|
sitemap | https://geekspin.co/sitemap_index.xml |