wweek.com
robots.txt

Robots Exclusion Standard data for wweek.com

Resource Scan

Scan Details

Site Domain wweek.com
Base Domain wweek.com
Scan Status Ok
Last Scan2024-11-02T09:18:56+00:00
Next Scan 2024-11-09T09:18:56+00:00

Last Scan

Scanned2024-11-02T09:18:56+00:00
URL https://wweek.com/robots.txt
Redirect https://www.wweek.com:443/robots.txt
Redirect Domain www.wweek.com
Redirect Base wweek.com
Domain IPs 35.71.160.19, 52.223.56.255
Redirect IPs 23.52.171.129, 23.52.171.154, 2600:1413:b000:13::b857:c18d, 2600:1413:b000:13::b857:c1a1
Response IP 23.52.171.129
Found Yes
Hash 2ca9bcaf5133c07ff3627e6e49493709c49e6e650ce7df5b7ddae5d9ba8e23b2
SimHash 700d2c010c91

Groups

*

Rule Path
Disallow /portland/article-8557-randall-palazzo.html
Disallow /portland/blog-8585-rogue_of_the_week_bull_randall_palazzo.html
Disallow /search/palazzo/?q=palazzo
Disallow /editorial/2008/03/12/randall-palazzo/
Disallow /popup/comment.php?%2Fstory=11057
Disallow /editorial/2008/03/12/randall-palazzo/
Disallow /portland/article-8557-randall_palazzo.html
Disallow /portland/blog-8585-rogue_of_the_week_randall_palazzo.html
Disallow /portland/blog-8585-rogue-of-the-week-randall-palazzo.html

Other Records

Field Value
sitemap https://www.wweek.com/arc/outboundfeeds/sitemap-index?outputType=xml
sitemap https://www.wweek.com/arc/outboundfeeds/news-sitemap-index?outputType=xml
sitemap https://www.wweek.com/arc/outboundfeeds/sitemap?outputType=xml
sitemap https://www.wweek.com/arc/outboundfeeds/news-sitemap?outputType=xml