thegeekrebellion.com
robots.txt
Robots Exclusion Standard data for thegeekrebellion.com
Resource Scan
Scan Details
Site Domain | thegeekrebellion.com |
Base Domain | thegeekrebellion.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-09-22T12:20:55+00:00 |
Next Scan | 2025-09-29T12:20:55+00:00 |
Last Successful Scan
Scanned | 2025-08-22T10:13:02+00:00 |
URL | https://thegeekrebellion.com/robots.txt |
Domain IPs | 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001 |
Response IP | 104.21.64.1 |
Found | Yes |
Hash | fc3923e26cf17861aefe2d44f1e068b867094e139fa002d9461ede03baffdcc1 |
SimHash | 586d4844cd92 |
Other Records
Field | Value |
---|---|
sitemap | https://thegeekrebellion.com/sitemap_index.xml |
sitemap | https://newsfromtechtoday.com/sitemap_index.xml |
sitemap | https://gadgetpieces.com/sitemap_index.xml |
sitemap | https://techautomates.com/sitemap_index.xml |
sitemap | https://roboticsforyou.net/sitemap_index.xml |
sitemap | https://theindexer.co.uk/sitemap_index.xml |
Comments