business.trustpilot.com
robots.txt

Robots Exclusion Standard data for business.trustpilot.com

Resource Scan

Scan Details

Site Domain business.trustpilot.com
Base Domain trustpilot.com
Scan Status Ok
Last Scan2024-11-02T03:22:55+00:00
Next Scan 2024-11-16T03:22:55+00:00

Last Scan

Scanned2024-11-02T03:22:55+00:00
URL https://business.trustpilot.com/robots.txt
Domain IPs 13.35.238.10, 13.35.238.28, 13.35.238.6, 13.35.238.93
Response IP 13.35.238.28
Found Yes
Hash 3c3cf161b3ad8a7f4ae45391d78fc8027c1e0a4c288e2b38a6256a56a6192354
SimHash 894dec80c9b3

Groups

*

Rule Path
Disallow /_next/
Disallow /tests/

alexabot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://business.trustpilot.com/sitemaps/index.xml