business.trustpilot.com
robots.txt

Robots Exclusion Standard data for business.trustpilot.com

Resource Scan

Scan Details

Site Domain business.trustpilot.com
Base Domain trustpilot.com
Scan Status Ok
Last Scan2024-05-03T19:03:37+00:00
Next Scan 2024-05-17T19:03:37+00:00

Last Scan

Scanned2024-05-03T19:03:37+00:00
URL https://business.trustpilot.com/robots.txt
Domain IPs 108.156.133.110, 108.156.133.48, 108.156.133.51, 108.156.133.82
Response IP 108.156.133.110
Found Yes
Hash 3c3cf161b3ad8a7f4ae45391d78fc8027c1e0a4c288e2b38a6256a56a6192354
SimHash 894dec80c9b3

Groups

*

Rule Path
Disallow /_next/
Disallow /tests/

alexabot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://business.trustpilot.com/sitemaps/index.xml