join-real.com
robots.txt

Robots Exclusion Standard data for join-real.com

Resource Scan

Scan Details

Site Domain join-real.com
Base Domain join-real.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-08-10T02:20:25+00:00
Next Scan 2024-10-09T02:20:25+00:00

Last Successful Scan

Scanned2024-05-20T02:19:03+00:00
URL https://join-real.com/robots.txt
Redirect https://www.join-real.com/robots.txt
Redirect Domain www.join-real.com
Redirect Base join-real.com
Domain IPs 104.21.7.251, 172.67.156.143, 2606:4700:3030::ac43:9c8f, 2606:4700:3037::6815:7fb
Redirect IPs 13.33.88.112, 13.33.88.125, 13.33.88.70, 13.33.88.9, 2600:9000:223b:0:b:4814:9fc0:93a1, 2600:9000:223b:5000:b:4814:9fc0:93a1, 2600:9000:223b:8400:b:4814:9fc0:93a1, 2600:9000:223b:8c00:b:4814:9fc0:93a1, 2600:9000:223b:8e00:b:4814:9fc0:93a1, 2600:9000:223b:d800:b:4814:9fc0:93a1, 2600:9000:223b:de00:b:4814:9fc0:93a1, 2600:9000:223b:e200:b:4814:9fc0:93a1
Response IP 13.33.88.125
Found Yes
Hash 1f4c8eef0a5f707369ec9a5b3a0b445563a7c1105bc575e0bb5db8c3e422b742
SimHash 4c50cd026731

Groups

*

Rule Path
Allow /

Comments

  • Allow all crawlers