prweekus.com
robots.txt

Robots Exclusion Standard data for prweekus.com

Resource Scan

Scan Details

Site Domain prweekus.com
Base Domain prweekus.com
Scan Status Ok
Last Scan2025-10-02T20:17:40+00:00
Next Scan 2025-11-01T20:17:40+00:00

Last Scan

Scanned2025-10-02T20:17:40+00:00
URL https://prweekus.com/robots.txt
Redirect https://www.prweek.com/robots.txt
Redirect Domain www.prweek.com
Redirect Base prweek.com
Domain IPs 104.21.69.221, 172.67.213.131, 2606:4700:3035::ac43:d583, 2606:4700:3037::6815:45dd
Redirect IPs 104.21.10.200, 172.67.131.184, 2606:4700:3031::6815:ac8, 2606:4700:3034::ac43:83b8
Response IP 172.67.131.184
Found Yes
Hash 917ad4ebaf088d21e3eb5dfeae780e752482bcb07649a9bd5a09ddd1b2bbea1a
SimHash 2a1598e0c591

Groups

*

Rule Path
Disallow /search/
Disallow /login?
Disallow /rulesforcommenting/
Disallow /PAGE/*
Disallow /page/*
Disallow /register/?

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.prweek.com/newsmap.xml
sitemap https://www.prweek.com/sitemap.xml