test.fenwick.com
robots.txt

Robots Exclusion Standard data for test.fenwick.com

Resource Scan

Scan Details

Site Domain test.fenwick.com
Base Domain fenwick.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-06-19T15:27:52+00:00
Next Scan 2025-09-17T15:27:52+00:00

Last Successful Scan

Scanned2023-02-07T15:42:30+00:00
URL http://test.fenwick.com/robots.txt
Domain IPs 52.8.166.171
Response IP 52.8.166.171
Found Yes
Hash f06ea8e5fdae66ec7db4e0c35e2b9cb7e0ba289964d47ede67c4266e1a771e6a
SimHash 60004aca4792

Groups

*

Rule Path
Disallow /cpresources/
Disallow /people*?*prod_main
Disallow /insights*?*prod_main
Disallow /china/people*?*prod_main_zh
Disallow /china/insights*?*prod_main_zh
Disallow /pro-bono-corporate-social-responsibility-events

Other Records

Field Value
sitemap https://www.fenwick.com/sitemaps-1-sitemap.xml
sitemap http://www.fenwick.com/china/sitemaps-1-sitemap.xml

Comments

  • robots.txt for https://www.fenwick.com/