trustpilot.io
robots.txt

Robots Exclusion Standard data for trustpilot.io

Resource Scan

Scan Details

Site Domain trustpilot.io
Base Domain trustpilot.io
Scan Status Ok
Last Scan2024-09-22T02:57:14+00:00
Next Scan 2024-09-29T02:57:14+00:00

Last Scan

Scanned2024-09-22T02:57:14+00:00
URL http://trustpilot.io/robots.txt
Redirect https://www.trustpilot.com/robots.txt
Redirect Domain www.trustpilot.com
Redirect Base trustpilot.com
Domain IPs 52.214.202.22, 54.74.69.22
Redirect IPs 108.157.254.100, 108.157.254.129, 108.157.254.45, 108.157.254.84
Response IP 108.157.254.129
Found Yes
Hash e26b3da047986f1168fa87cd170ff59985c296299927817f1c1ad46bd3234f9f
SimHash 2c457b90ddd3

Groups

googlebot

Rule Path
Disallow /error
Disallow /evaluate/
Disallow /evaluate-link
Disallow /evaluate-unique-link
Disallow /pingdom
Disallow /reviews/
Disallow /review/*/transparency
Disallow /*?*editmode=
Disallow /api/*
Disallow /*?*languages=
Disallow /*?*stars=
Disallow /*?*sort=
Disallow /*?*verified=
Disallow /*?*aspects=
Disallow /*?*replies=
Disallow /*?*date=
Disallow /*?*trustscore=
Disallow /*?*claimed=
Disallow /*?*country=
Disallow /*?*location=
Disallow /*?*subcategories=
Disallow /search
Disallow /sessions
Disallow /submitted/review
Disallow /users/
Allow /users/connect
Disallow /users/connect?redirect
Disallow /users/connect?signup
Disallow /users/activate
Disallow /users/embed-login-to-edit
Disallow /users/create
Disallow /unsubscribe/invitation

mediapartners-google

Rule Path
Disallow /error
Disallow /evaluate/
Disallow /evaluate-link
Disallow /evaluate-unique-link
Disallow /pingdom
Disallow /reviews/
Disallow /review/*/transparency
Disallow /*?*editmode=
Disallow /api/*
Disallow /*?*languages=
Disallow /*?*stars=
Disallow /*?*sort=
Disallow /*?*verified=
Disallow /*?*aspects=
Disallow /*?*replies=
Disallow /*?*date=
Disallow /*?*trustscore=
Disallow /*?*claimed=
Disallow /*?*country=
Disallow /*?*location=
Disallow /*?*subcategories=
Disallow /search
Disallow /sessions
Disallow /submitted/review
Disallow /users/
Allow /users/connect
Disallow /users/connect?redirect
Disallow /users/connect?signup
Disallow /users/activate
Disallow /users/embed-login-to-edit
Disallow /users/create
Disallow /unsubscribe/invitation

googlebot-mobile

Rule Path
Disallow /error
Disallow /evaluate/
Disallow /evaluate-link
Disallow /evaluate-unique-link
Disallow /pingdom
Disallow /reviews/
Disallow /review/*/transparency
Disallow /*?*editmode=
Disallow /api/*
Disallow /*?*languages=
Disallow /*?*stars=
Disallow /*?*sort=
Disallow /*?*verified=
Disallow /*?*aspects=
Disallow /*?*replies=
Disallow /*?*date=
Disallow /*?*trustscore=
Disallow /*?*claimed=
Disallow /*?*country=
Disallow /*?*location=
Disallow /*?*subcategories=
Disallow /search
Disallow /sessions
Disallow /submitted/review
Disallow /users/
Allow /users/connect
Disallow /users/connect?redirect
Disallow /users/connect?signup
Disallow /users/activate
Disallow /users/embed-login-to-edit
Disallow /users/create
Disallow /unsubscribe/invitation

adsbot-google

Rule Path
Disallow /error
Disallow /evaluate/
Disallow /evaluate-link
Disallow /evaluate-unique-link
Disallow /pingdom
Disallow /reviews/
Disallow /review/*/transparency
Disallow /*?*editmode=
Disallow /api/*
Disallow /*?*languages=
Disallow /*?*stars=
Disallow /*?*sort=
Disallow /*?*verified=
Disallow /*?*aspects=
Disallow /*?*replies=
Disallow /*?*date=
Disallow /*?*trustscore=
Disallow /*?*claimed=
Disallow /*?*country=
Disallow /*?*location=
Disallow /*?*subcategories=
Disallow /search
Disallow /sessions
Disallow /submitted/review
Disallow /users/
Allow /users/connect
Disallow /users/connect?redirect
Disallow /users/connect?signup
Disallow /users/activate
Disallow /users/embed-login-to-edit
Disallow /users/create
Disallow /unsubscribe/invitation

adsbot-google-mobile

Rule Path
Disallow /error
Disallow /evaluate/
Disallow /evaluate-link
Disallow /evaluate-unique-link
Disallow /pingdom
Disallow /reviews/
Disallow /review/*/transparency
Disallow /*?*editmode=
Disallow /api/*
Disallow /*?*languages=
Disallow /*?*stars=
Disallow /*?*sort=
Disallow /*?*verified=
Disallow /*?*aspects=
Disallow /*?*replies=
Disallow /*?*date=
Disallow /*?*trustscore=
Disallow /*?*claimed=
Disallow /*?*country=
Disallow /*?*location=
Disallow /*?*subcategories=
Disallow /search
Disallow /sessions
Disallow /submitted/review
Disallow /users/
Allow /users/connect
Disallow /users/connect?redirect
Disallow /users/connect?signup
Disallow /users/activate
Disallow /users/embed-login-to-edit
Disallow /users/create
Disallow /unsubscribe/invitation

bingbot

Rule Path
Disallow /error
Disallow /evaluate/
Disallow /evaluate-link
Disallow /evaluate-unique-link
Disallow /pingdom
Disallow /reviews/
Disallow /review/*/transparency
Disallow /*?*editmode=
Disallow /api/*
Disallow /*?*languages=
Disallow /*?*stars=
Disallow /*?*sort=
Disallow /*?*verified=
Disallow /*?*aspects=
Disallow /*?*replies=
Disallow /*?*date=
Disallow /*?*trustscore=
Disallow /*?*claimed=
Disallow /*?*country=
Disallow /*?*location=
Disallow /*?*subcategories=
Disallow /search
Disallow /sessions
Disallow /submitted/review
Disallow /users/
Allow /users/connect
Disallow /users/connect?redirect
Disallow /users/connect?signup
Disallow /users/activate
Disallow /users/embed-login-to-edit
Disallow /users/create
Disallow /unsubscribe/invitation

msnbot

Rule Path
Disallow /error
Disallow /evaluate/
Disallow /evaluate-link
Disallow /evaluate-unique-link
Disallow /pingdom
Disallow /reviews/
Disallow /review/*/transparency
Disallow /*?*editmode=
Disallow /api/*
Disallow /*?*languages=
Disallow /*?*stars=
Disallow /*?*sort=
Disallow /*?*verified=
Disallow /*?*aspects=
Disallow /*?*replies=
Disallow /*?*date=
Disallow /*?*trustscore=
Disallow /*?*claimed=
Disallow /*?*country=
Disallow /*?*location=
Disallow /*?*subcategories=
Disallow /search
Disallow /sessions
Disallow /submitted/review
Disallow /users/
Allow /users/connect
Disallow /users/connect?redirect
Disallow /users/connect?signup
Disallow /users/activate
Disallow /users/embed-login-to-edit
Disallow /users/create
Disallow /unsubscribe/invitation

ia_archiver

Rule Path
Disallow /error
Disallow /evaluate/
Disallow /evaluate-link
Disallow /evaluate-unique-link
Disallow /pingdom
Disallow /reviews/
Disallow /review/*/transparency
Disallow /*?*editmode=
Disallow /api/*
Disallow /*?*languages=
Disallow /*?*stars=
Disallow /*?*sort=
Disallow /*?*verified=
Disallow /*?*aspects=
Disallow /*?*replies=
Disallow /*?*date=
Disallow /*?*trustscore=
Disallow /*?*claimed=
Disallow /*?*country=
Disallow /*?*location=
Disallow /*?*subcategories=
Disallow /search
Disallow /sessions
Disallow /submitted/review
Disallow /users/
Allow /users/connect
Disallow /users/connect?redirect
Disallow /users/connect?signup
Disallow /users/activate
Disallow /users/embed-login-to-edit
Disallow /users/create
Disallow /unsubscribe/invitation

alexabot

Rule Path
Disallow /error
Disallow /evaluate/
Disallow /evaluate-link
Disallow /evaluate-unique-link
Disallow /pingdom
Disallow /reviews/
Disallow /review/*/transparency
Disallow /*?*editmode=
Disallow /api/*
Disallow /*?*languages=
Disallow /*?*stars=
Disallow /*?*sort=
Disallow /*?*verified=
Disallow /*?*aspects=
Disallow /*?*replies=
Disallow /*?*date=
Disallow /*?*trustscore=
Disallow /*?*claimed=
Disallow /*?*country=
Disallow /*?*location=
Disallow /*?*subcategories=
Disallow /search
Disallow /sessions
Disallow /submitted/review
Disallow /users/
Allow /users/connect
Disallow /users/connect?redirect
Disallow /users/connect?signup
Disallow /users/activate
Disallow /users/embed-login-to-edit
Disallow /users/create
Disallow /unsubscribe/invitation

scoutjet

Rule Path
Disallow /error
Disallow /evaluate/
Disallow /evaluate-link
Disallow /evaluate-unique-link
Disallow /pingdom
Disallow /reviews/
Disallow /review/*/transparency
Disallow /*?*editmode=
Disallow /api/*
Disallow /*?*languages=
Disallow /*?*stars=
Disallow /*?*sort=
Disallow /*?*verified=
Disallow /*?*aspects=
Disallow /*?*replies=
Disallow /*?*date=
Disallow /*?*trustscore=
Disallow /*?*claimed=
Disallow /*?*country=
Disallow /*?*location=
Disallow /*?*subcategories=
Disallow /search
Disallow /sessions
Disallow /submitted/review
Disallow /users/
Allow /users/connect
Disallow /users/connect?redirect
Disallow /users/connect?signup
Disallow /users/activate
Disallow /users/embed-login-to-edit
Disallow /users/create
Disallow /unsubscribe/invitation

slurp

Rule Path
Disallow /error
Disallow /evaluate/
Disallow /evaluate-link
Disallow /evaluate-unique-link
Disallow /pingdom
Disallow /reviews/
Disallow /review/*/transparency
Disallow /*?*editmode=
Disallow /api/*
Disallow /*?*languages=
Disallow /*?*stars=
Disallow /*?*sort=
Disallow /*?*verified=
Disallow /*?*aspects=
Disallow /*?*replies=
Disallow /*?*date=
Disallow /*?*trustscore=
Disallow /*?*claimed=
Disallow /*?*country=
Disallow /*?*location=
Disallow /*?*subcategories=
Disallow /search
Disallow /sessions
Disallow /submitted/review
Disallow /users/
Allow /users/connect
Disallow /users/connect?redirect
Disallow /users/connect?signup
Disallow /users/activate
Disallow /users/embed-login-to-edit
Disallow /users/create
Disallow /unsubscribe/invitation

twitterbot

Rule Path
Disallow /error
Disallow /evaluate/
Disallow /evaluate-link
Disallow /evaluate-unique-link
Disallow /pingdom
Disallow /reviews/
Disallow /review/*/transparency
Disallow /*?*editmode=
Disallow /api/*
Disallow /*?*languages=
Disallow /*?*stars=
Disallow /*?*sort=
Disallow /*?*verified=
Disallow /*?*aspects=
Disallow /*?*replies=
Disallow /*?*date=
Disallow /*?*trustscore=
Disallow /*?*claimed=
Disallow /*?*country=
Disallow /*?*location=
Disallow /*?*subcategories=
Disallow /search
Disallow /sessions
Disallow /submitted/review
Disallow /users/
Allow /users/connect
Disallow /users/connect?redirect
Disallow /users/connect?signup
Disallow /users/activate
Disallow /users/embed-login-to-edit
Disallow /users/create
Disallow /unsubscribe/invitation

baiduspider

Rule Path
Disallow /error
Disallow /evaluate/
Disallow /evaluate-link
Disallow /evaluate-unique-link
Disallow /pingdom
Disallow /reviews/
Disallow /review/*/transparency
Disallow /*?*editmode=
Disallow /api/*
Disallow /*?*languages=
Disallow /*?*stars=
Disallow /*?*sort=
Disallow /*?*verified=
Disallow /*?*aspects=
Disallow /*?*replies=
Disallow /*?*date=
Disallow /*?*trustscore=
Disallow /*?*claimed=
Disallow /*?*country=
Disallow /*?*location=
Disallow /*?*subcategories=
Disallow /search
Disallow /sessions
Disallow /submitted/review
Disallow /users/
Allow /users/connect
Disallow /users/connect?redirect
Disallow /users/connect?signup
Disallow /users/activate
Disallow /users/embed-login-to-edit
Disallow /users/create
Disallow /unsubscribe/invitation

facebookbot

Rule Path
Disallow /error
Disallow /evaluate/
Disallow /evaluate-link
Disallow /evaluate-unique-link
Disallow /pingdom
Allow /reviews/
Disallow /review/*/transparency
Disallow /*?*editmode=
Disallow /api/*
Disallow /*?*languages=
Disallow /*?*stars=
Disallow /*?*sort=
Disallow /*?*verified=
Disallow /*?*aspects=
Disallow /*?*replies=
Disallow /*?*date=
Disallow /*?*trustscore=
Disallow /*?*claimed=
Disallow /*?*country=
Disallow /*?*location=
Disallow /*?*subcategories=
Disallow /search
Disallow /sessions
Disallow /submitted/review
Disallow /users/
Allow /users/connect
Disallow /users/connect?redirect
Disallow /users/connect?signup
Disallow /users/activate
Disallow /users/embed-login-to-edit
Disallow /users/create
Disallow /unsubscribe/invitation

facebookexternalhit

Rule Path
Disallow /error
Disallow /evaluate/
Disallow /evaluate-link
Disallow /evaluate-unique-link
Disallow /pingdom
Allow /reviews/
Disallow /review/*/transparency
Disallow /*?*editmode=
Disallow /api/*
Disallow /*?*languages=
Disallow /*?*stars=
Disallow /*?*sort=
Disallow /*?*verified=
Disallow /*?*aspects=
Disallow /*?*replies=
Disallow /*?*date=
Disallow /*?*trustscore=
Disallow /*?*claimed=
Disallow /*?*country=
Disallow /*?*location=
Disallow /*?*subcategories=
Disallow /search
Disallow /sessions
Disallow /submitted/review
Disallow /users/
Allow /users/connect
Disallow /users/connect?redirect
Disallow /users/connect?signup
Disallow /users/activate
Disallow /users/embed-login-to-edit
Disallow /users/create
Disallow /unsubscribe/invitation

duckduckbot

Rule Path
Disallow /error
Disallow /evaluate/
Disallow /evaluate-link
Disallow /evaluate-unique-link
Disallow /pingdom
Disallow /reviews/
Disallow /review/*/transparency
Disallow /*?*editmode=
Disallow /api/*
Disallow /*?*languages=
Disallow /*?*stars=
Disallow /*?*sort=
Disallow /*?*verified=
Disallow /*?*aspects=
Disallow /*?*replies=
Disallow /*?*date=
Disallow /*?*trustscore=
Disallow /*?*claimed=
Disallow /*?*country=
Disallow /*?*location=
Disallow /*?*subcategories=
Disallow /search
Disallow /sessions
Disallow /submitted/review
Disallow /users/
Allow /users/connect
Disallow /users/connect?redirect
Disallow /users/connect?signup
Disallow /users/activate
Disallow /users/embed-login-to-edit
Disallow /users/create
Disallow /unsubscribe/invitation

sentibot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://sitemaps.trustpilot.com/index_en-us.xml
sitemap https://trustpilot.com/trust/sitemaps/domain_en-us.xml
sitemap https://trustpilot.com/blog/sitemaps/domain_en-us.xml