di-rankings.com
robots.txt

Robots Exclusion Standard data for di-rankings.com

Resource Scan

Scan Details

Site Domain di-rankings.com
Base Domain di-rankings.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-05-29T23:19:58+00:00
Next Scan 2025-08-27T23:19:58+00:00

Last Successful Scan

Scanned2024-10-09T23:17:33+00:00
URL https://di-rankings.com/robots.txt
Redirect https://www.shstructures.com/robots.txt
Redirect Domain www.shstructures.com
Redirect Base shstructures.com
Domain IPs 104.21.77.70, 172.67.205.92, 2606:4700:3030::ac43:cd5c, 2606:4700:3036::6815:4d46
Redirect IPs 104.26.10.181, 104.26.11.181, 172.67.70.45, 2606:4700:20::681a:ab5, 2606:4700:20::681a:bb5, 2606:4700:20::ac43:462d
Response IP 104.26.10.181
Found Yes
Hash 128c525e88a2def83e862e15bd25dea89d2bae634605efc12cd84edc024dccd8
SimHash 685880d5e535

Groups

googlebot
slurp
bingbot

Rule Path
Allow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.shstructures.com/sitemap.xml