Log In Sign Up

archdaily.mx
robots.txt

Robots Exclusion Standard data for archdaily.mx

Resource Scan

Scan Details

Site Domain archdaily.mx
Base Domain archdaily.mx
Scan Status Ok
Last Scan2024-06-13T02:41:22+00:00
Next Scan 2024-06-20T02:41:22+00:00

Last Scan

Scanned2024-06-13T02:41:22+00:00
URL https://archdaily.mx/robots.txt
Redirect https://www.archdaily.mx/robots.txt
Redirect Domain www.archdaily.mx
Redirect Base archdaily.mx
Domain IPs 108.139.10.39, 108.139.10.5, 108.139.10.73, 108.139.10.82, 2600:9000:234b:7c00:5:6f47:bbc0:93a1, 2600:9000:234b:8400:5:6f47:bbc0:93a1, 2600:9000:234b:8600:5:6f47:bbc0:93a1, 2600:9000:234b:9000:5:6f47:bbc0:93a1, 2600:9000:234b:a200:5:6f47:bbc0:93a1, 2600:9000:234b:aa00:5:6f47:bbc0:93a1, 2600:9000:234b:bc00:5:6f47:bbc0:93a1, 2600:9000:234b:d600:5:6f47:bbc0:93a1
Redirect IPs 2600:9000:2024:1e00:5:6f47:bbc0:93a1, 2600:9000:2024:4000:5:6f47:bbc0:93a1, 2600:9000:2024:4200:5:6f47:bbc0:93a1, 2600:9000:2024:7a00:5:6f47:bbc0:93a1, 2600:9000:2024:8200:5:6f47:bbc0:93a1, 2600:9000:2024:a200:5:6f47:bbc0:93a1, 2600:9000:2024:d000:5:6f47:bbc0:93a1, 2600:9000:2024:ee00:5:6f47:bbc0:93a1, 65.9.112.126, 65.9.112.24, 65.9.112.68, 65.9.112.88
Response IP 18.165.171.94
Found Yes
Hash acfd96a0e2db3016ce55521c630f3eb7bd38474e309594082d1fb5c18d669c69
SimHash 812409da4713

Groups

*

Rule Path
Disallow *?replytocom
Allow /
Disallow /cl/
Disallow /catalog/cl/
Disallow /us/
Disallow /catalog/us/
Disallow /cn/
Disallow /br/
Disallow /catalog/br/
Disallow /co/
Disallow /catalog/co/
Disallow /pe/
Disallow /catalog/pe/
Disallow /1021178/ADMX
Disallow /1021178/AD_MX
Back to top

Other Records

Field Value
sitemap https://www.archdaily.mx/sitemap.xml
Back to top