arenarpg.com.br
robots.txt

Robots Exclusion Standard data for arenarpg.com.br

Resource Scan

Scan Details

Site Domain arenarpg.com.br
Base Domain arenarpg.com.br
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-20T09:25:24+00:00
Next Scan 2026-01-18T09:25:24+00:00

Last Successful Scan

Scanned2023-10-02T03:38:53+00:00
URL https://arenarpg.com.br/robots.txt
Redirect https://www.arenarpg.com.br/robots.txt
Redirect Domain www.arenarpg.com.br
Redirect Base arenarpg.com.br
Domain IPs 67.225.178.184
Redirect IPs 67.225.178.184
Response IP 67.225.178.184
Found Yes
Hash 3fb64df3dd766d261c3b466b9650efcfd94149f8d6e43031e23e75f97ac8848a
SimHash 6814dc926735

Groups

googlebot

Rule Path
Allow

googlebot-image

Rule Path
Allow

mediapartners-google

Rule Path
Allow

adsbot-google

Rule Path
Allow

adsbot-google-mobile

Rule Path
Allow /*?*view
Allow /index.php

Other Records

Field Value
crawl-delay 240

twitterbot

Rule Path
Allow /*?*view
Allow /index.php

Other Records

Field Value
crawl-delay 240

*

Rule Path
Allow /*?*view
Allow /index.php
Disallow /

Other Records

Field Value
crawl-delay 360