architectmagazine.com
robots.txt

Robots Exclusion Standard data for architectmagazine.com

Resource Scan

Scan Details

Site Domain architectmagazine.com
Base Domain architectmagazine.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-17T11:38:33+00:00
Next Scan 2025-02-15T11:38:33+00:00

Last Successful Scan

Scanned2023-01-23T11:45:43+00:00
URL https://architectmagazine.com/robots.txt
Redirect https://www.architectmagazine.com/robots.txt
Redirect Domain www.architectmagazine.com
Redirect Base architectmagazine.com
Domain IPs 45.60.152.237, 45.60.172.237
Redirect IPs 45.60.160.237
Response IP 45.60.160.237
Found Yes
Hash ae4c3d8e6b2554363344286ffd87a3a012d86bb28436ca176accf17eb2b9b675
SimHash 2b05dc71e2d3

Groups

*

Rule Path
Disallow /_debug/
Disallow /_plugins/
Disallow /ajax/
Disallow /cms/
Disallow /search
Disallow /_track

bingbot

Rule Path
Disallow /_debug/
Disallow /_plugins/
Disallow /ajax/
Disallow /cms/
Disallow /search
Disallow /_track

Other Records

Field Value
crawl-delay 5

turnitinbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.architectmagazine.com/sitemap.xml