rush4darena.com
robots.txt

Robots Exclusion Standard data for rush4darena.com

Resource Scan

Scan Details

Site Domain rush4darena.com
Base Domain rush4darena.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-03-08T23:30:26+00:00
Next Scan 2025-05-07T23:30:26+00:00

Last Successful Scan

Scanned2024-12-16T23:22:25+00:00
URL https://rush4darena.com/robots.txt
Redirect https://rush4dgloria.com/robots.txt
Redirect Domain rush4dgloria.com
Redirect Base rush4dgloria.com
Domain IPs 104.21.18.46, 172.67.180.98, 2606:4700:3034::ac43:b462, 2606:4700:3036::6815:122e
Redirect IPs 104.21.27.46, 172.67.168.232, 2606:4700:3035::ac43:a8e8, 2606:4700:3037::6815:1b2e
Response IP 104.21.27.46
Found Yes
Hash 86c006865246862be0c802f18f34dfb28afe9c30168cf9e6c4ac019b09368351
SimHash 6054d7125793

Groups

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

msnbot

Rule Path
Allow /

slurp

Rule Path
Allow /

teoma

Rule Path
Allow /

gigabot

Rule Path
Allow /

robozilla

Rule Path
Allow /

nutch

Rule Path
Allow /

ia_archiver

Rule Path
Allow /

baiduspider

Rule Path
Allow /

naverbot

Rule Path
Allow /

yeti

Rule Path
Allow /

yahoo-mmcrawler

Rule Path
Allow /

psbot

Rule Path
Allow /

yahoo-blogs/v3.9

Rule Path
Allow /

*

Rule Path
Allow /
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://rush4dgloria.com/sitemap.xml