archdaily.com.br
robots.txt

Robots Exclusion Standard data for archdaily.com.br

Resource Scan

Scan Details

Site Domain archdaily.com.br
Base Domain archdaily.com.br
Scan Status Ok
Last Scan2024-05-07T12:48:28+00:00
Next Scan 2024-05-14T12:48:28+00:00

Last Scan

Scanned2024-05-07T12:48:28+00:00
URL https://archdaily.com.br/robots.txt
Redirect https://www.archdaily.com.br/robots.txt
Redirect Domain www.archdaily.com.br
Redirect Base archdaily.com.br
Domain IPs 13.226.2.123, 13.226.2.35, 13.226.2.45, 13.226.2.95
Redirect IPs 18.164.154.114, 18.164.154.62, 18.164.154.84, 18.164.154.92
Response IP 18.165.171.55
Found Yes
Hash b3e45df7607d58ba2309b4675ddffed57cf88dae3220088e0c5de7fdffd05a33
SimHash c92719f6cf93

Groups

*

Rule Path
Disallow *?replytocom
Allow /
Disallow /cl/
Disallow /catalog/cl/
Disallow /us/
Disallow /catalog/us/
Disallow /cn/
Disallow /mx/
Disallow /catalog/mx/
Disallow /co/
Disallow /catalog/co/
Disallow /pe/
Disallow /catalog/pe/
Disallow /1021178/ADBR

Other Records

Field Value
sitemap https://www.archdaily.com.br/sitemap.xml