insidethegames.biz
robots.txt
Robots Exclusion Standard data for insidethegames.biz
Resource Scan
Scan Details
Site Domain | insidethegames.biz |
Base Domain | insidethegames.biz |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-11-14T07:02:06+00:00 |
Next Scan | 2025-01-13T07:02:06+00:00 |
Last Successful Scan
Scanned | 2024-09-16T06:59:47+00:00 |
URL | https://insidethegames.biz/robots.txt |
Redirect | https://www.insidethegames.biz/robots.txt |
Redirect Domain | www.insidethegames.biz |
Redirect Base | insidethegames.biz |
Domain IPs | 104.26.2.124, 104.26.3.124, 172.67.72.98, 2606:4700:20::681a:27c, 2606:4700:20::681a:37c, 2606:4700:20::ac43:4862 |
Redirect IPs | 104.26.2.124, 104.26.3.124, 172.67.72.98, 2606:4700:20::681a:27c, 2606:4700:20::681a:37c, 2606:4700:20::ac43:4862 |
Response IP | 104.26.2.124 |
Found | Yes |
Hash | 5fe6e0d7bff99d06f6ff67efe4affeca25115fed4d103023de029c7a7343c4e4 |
SimHash | 6d154c54e411 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /api/ |
Disallow | /cdn-cgi/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://www.insidethegames.biz/sitemaps |