Log In Sign Up

architecturalrecord.com
robots.txt

Robots Exclusion Standard data for architecturalrecord.com

Resource Scan

Scan Details

Site Domain architecturalrecord.com
Base Domain architecturalrecord.com
Scan Status Ok
Last Scan2025-09-21T16:39:56+00:00
Next Scan 2025-10-21T16:39:56+00:00

Last Scan

Scanned2025-09-21T16:39:56+00:00
URL https://architecturalrecord.com/robots.txt
Redirect https://www.architecturalrecord.com/robots.txt
Redirect Domain www.architecturalrecord.com
Redirect Base architecturalrecord.com
Domain IPs 104.21.26.169, 172.67.137.101, 2606:4700:3036::6815:1aa9, 2606:4700:3037::ac43:8965
Redirect IPs 104.21.26.169, 172.67.137.101, 2606:4700:3036::6815:1aa9, 2606:4700:3037::ac43:8965
Response IP 104.21.26.169
Found Yes
Hash fe0936963d91fba4f108f4ccface9641c2341715b4202427abd0b1ae5262564c
SimHash ea9c0d1dd652

Groups

*

Rule Path
Disallow /comments/flag/
Disallow /search
Disallow /articles/comment/abuse
Disallow /articles/email
Disallow /articles/preview
Disallow /articles/print
Disallow /products/email
Disallow /products/print
Disallow /cart
Disallow /user/*
Disallow /*/log_view
Disallow /query/*
Disallow /media/video/
Allow /media/videos/play/*

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://www.architecturalrecord.com/sitemap.xml
Back to top

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-agent: *
  • Disallow: /
Back to top