insidethegames.biz
robots.txt

Robots Exclusion Standard data for insidethegames.biz

Resource Scan

Scan Details

Site Domain insidethegames.biz
Base Domain insidethegames.biz
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-14T07:02:06+00:00
Next Scan 2025-01-13T07:02:06+00:00

Last Successful Scan

Scanned2024-09-16T06:59:47+00:00
URL https://insidethegames.biz/robots.txt
Redirect https://www.insidethegames.biz/robots.txt
Redirect Domain www.insidethegames.biz
Redirect Base insidethegames.biz
Domain IPs 104.26.2.124, 104.26.3.124, 172.67.72.98, 2606:4700:20::681a:27c, 2606:4700:20::681a:37c, 2606:4700:20::ac43:4862
Redirect IPs 104.26.2.124, 104.26.3.124, 172.67.72.98, 2606:4700:20::681a:27c, 2606:4700:20::681a:37c, 2606:4700:20::ac43:4862
Response IP 104.26.2.124
Found Yes
Hash 5fe6e0d7bff99d06f6ff67efe4affeca25115fed4d103023de029c7a7343c4e4
SimHash 6d154c54e411

Groups

*

Rule Path
Disallow /admin/
Disallow /api/
Disallow /cdn-cgi/

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.insidethegames.biz/sitemaps