rog-toto.tor1.cdn.digitaloceanspaces.com
robots.txt

Resource Scan

Scan Details

Site Domain rog-toto.tor1.cdn.digitaloceanspaces.com
Base Domain digitaloceanspaces.com
Scan Status Ok
Last Scan2025-11-05T16:52:58+00:00
Next Scan 2025-12-05T16:52:58+00:00

Last Scan

Scanned2025-11-05T16:52:58+00:00
URL https://rog-toto.tor1.cdn.digitaloceanspaces.com/robots.txt
Domain IPs 104.18.42.227, 172.64.145.29, 2606:4700:4405::ac40:911d, 2a06:98c1:3105::6812:2ae3
Response IP 104.18.42.227
Found Yes
Hash 1bb0696ec858fdeeeb2f10fd0a1071d599fa81e0a686cf0fb842f52cc820f9ca
SimHash 68148dd27a93

Groups

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

ahrefsbot

Rule Path
Allow /

lumendatabase

Rule Path
Disallow /

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://rog-toto.tor1.cdn.digitaloceanspaces.com/sitemap.xml