trustpilot.com.au
robots.txt
Robots Exclusion Standard data for trustpilot.com.au
Resource Scan
Scan Details
| Site Domain | trustpilot.com.au |
| Base Domain | trustpilot.com.au |
| Scan Status | Ok |
| Last Scan | 2024-09-21T07:34:34+00:00 |
| Next Scan | 2024-09-28T07:34:34+00:00 |
Last Scan
| Scanned | 2024-09-21T07:34:34+00:00 |
| URL | http://trustpilot.com.au/robots.txt |
| Redirect | https://au.trustpilot.com/robots.txt |
| Redirect Domain | au.trustpilot.com |
| Redirect Base | trustpilot.com |
| Domain IPs | 52.51.216.97, 54.154.81.236 |
| Redirect IPs | 13.35.185.122, 13.35.185.54, 13.35.185.78, 13.35.185.9 |
| Response IP | 108.157.254.100 |
| Found | Yes |
| Hash | 400b36fde4b5384fe4bc0273b3fe7a9e462e6c9e508ad37644436fc2123cd72a |
| SimHash | 68557a109df3 |
Groups
googlebot
| Rule | Path |
|---|---|
| Disallow | /error |
| Disallow | /evaluate/ |
| Disallow | /evaluate-link |
| Disallow | /evaluate-unique-link |
| Disallow | /pingdom |
| Disallow | /reviews/ |
| Disallow | /review/*/transparency |
| Disallow | /*?*editmode= |
| Disallow | /api/* |
| Disallow | /*?*languages= |
| Disallow | /*?*stars= |
| Disallow | /*?*sort= |
| Disallow | /*?*verified= |
| Disallow | /*?*aspects= |
| Disallow | /*?*replies= |
| Disallow | /*?*date= |
| Disallow | /*?*trustscore= |
| Disallow | /*?*claimed= |
| Disallow | /*?*country= |
| Disallow | /*?*location= |
| Disallow | /*?*subcategories= |
| Disallow | /search |
| Disallow | /sessions |
| Disallow | /submitted/review |
| Disallow | /users/ |
| Allow | /users/connect |
| Disallow | /users/connect?redirect |
| Disallow | /users/connect?signup |
| Disallow | /users/activate |
| Disallow | /users/embed-login-to-edit |
| Disallow | /users/create |
| Disallow | /unsubscribe/invitation |
mediapartners-google
| Rule | Path |
|---|---|
| Disallow | /error |
| Disallow | /evaluate/ |
| Disallow | /evaluate-link |
| Disallow | /evaluate-unique-link |
| Disallow | /pingdom |
| Disallow | /reviews/ |
| Disallow | /review/*/transparency |
| Disallow | /*?*editmode= |
| Disallow | /api/* |
| Disallow | /*?*languages= |
| Disallow | /*?*stars= |
| Disallow | /*?*sort= |
| Disallow | /*?*verified= |
| Disallow | /*?*aspects= |
| Disallow | /*?*replies= |
| Disallow | /*?*date= |
| Disallow | /*?*trustscore= |
| Disallow | /*?*claimed= |
| Disallow | /*?*country= |
| Disallow | /*?*location= |
| Disallow | /*?*subcategories= |
| Disallow | /search |
| Disallow | /sessions |
| Disallow | /submitted/review |
| Disallow | /users/ |
| Allow | /users/connect |
| Disallow | /users/connect?redirect |
| Disallow | /users/connect?signup |
| Disallow | /users/activate |
| Disallow | /users/embed-login-to-edit |
| Disallow | /users/create |
| Disallow | /unsubscribe/invitation |
googlebot-mobile
| Rule | Path |
|---|---|
| Disallow | /error |
| Disallow | /evaluate/ |
| Disallow | /evaluate-link |
| Disallow | /evaluate-unique-link |
| Disallow | /pingdom |
| Disallow | /reviews/ |
| Disallow | /review/*/transparency |
| Disallow | /*?*editmode= |
| Disallow | /api/* |
| Disallow | /*?*languages= |
| Disallow | /*?*stars= |
| Disallow | /*?*sort= |
| Disallow | /*?*verified= |
| Disallow | /*?*aspects= |
| Disallow | /*?*replies= |
| Disallow | /*?*date= |
| Disallow | /*?*trustscore= |
| Disallow | /*?*claimed= |
| Disallow | /*?*country= |
| Disallow | /*?*location= |
| Disallow | /*?*subcategories= |
| Disallow | /search |
| Disallow | /sessions |
| Disallow | /submitted/review |
| Disallow | /users/ |
| Allow | /users/connect |
| Disallow | /users/connect?redirect |
| Disallow | /users/connect?signup |
| Disallow | /users/activate |
| Disallow | /users/embed-login-to-edit |
| Disallow | /users/create |
| Disallow | /unsubscribe/invitation |
adsbot-google
| Rule | Path |
|---|---|
| Disallow | /error |
| Disallow | /evaluate/ |
| Disallow | /evaluate-link |
| Disallow | /evaluate-unique-link |
| Disallow | /pingdom |
| Disallow | /reviews/ |
| Disallow | /review/*/transparency |
| Disallow | /*?*editmode= |
| Disallow | /api/* |
| Disallow | /*?*languages= |
| Disallow | /*?*stars= |
| Disallow | /*?*sort= |
| Disallow | /*?*verified= |
| Disallow | /*?*aspects= |
| Disallow | /*?*replies= |
| Disallow | /*?*date= |
| Disallow | /*?*trustscore= |
| Disallow | /*?*claimed= |
| Disallow | /*?*country= |
| Disallow | /*?*location= |
| Disallow | /*?*subcategories= |
| Disallow | /search |
| Disallow | /sessions |
| Disallow | /submitted/review |
| Disallow | /users/ |
| Allow | /users/connect |
| Disallow | /users/connect?redirect |
| Disallow | /users/connect?signup |
| Disallow | /users/activate |
| Disallow | /users/embed-login-to-edit |
| Disallow | /users/create |
| Disallow | /unsubscribe/invitation |
adsbot-google-mobile
| Rule | Path |
|---|---|
| Disallow | /error |
| Disallow | /evaluate/ |
| Disallow | /evaluate-link |
| Disallow | /evaluate-unique-link |
| Disallow | /pingdom |
| Disallow | /reviews/ |
| Disallow | /review/*/transparency |
| Disallow | /*?*editmode= |
| Disallow | /api/* |
| Disallow | /*?*languages= |
| Disallow | /*?*stars= |
| Disallow | /*?*sort= |
| Disallow | /*?*verified= |
| Disallow | /*?*aspects= |
| Disallow | /*?*replies= |
| Disallow | /*?*date= |
| Disallow | /*?*trustscore= |
| Disallow | /*?*claimed= |
| Disallow | /*?*country= |
| Disallow | /*?*location= |
| Disallow | /*?*subcategories= |
| Disallow | /search |
| Disallow | /sessions |
| Disallow | /submitted/review |
| Disallow | /users/ |
| Allow | /users/connect |
| Disallow | /users/connect?redirect |
| Disallow | /users/connect?signup |
| Disallow | /users/activate |
| Disallow | /users/embed-login-to-edit |
| Disallow | /users/create |
| Disallow | /unsubscribe/invitation |
bingbot
| Rule | Path |
|---|---|
| Disallow | /error |
| Disallow | /evaluate/ |
| Disallow | /evaluate-link |
| Disallow | /evaluate-unique-link |
| Disallow | /pingdom |
| Disallow | /reviews/ |
| Disallow | /review/*/transparency |
| Disallow | /*?*editmode= |
| Disallow | /api/* |
| Disallow | /*?*languages= |
| Disallow | /*?*stars= |
| Disallow | /*?*sort= |
| Disallow | /*?*verified= |
| Disallow | /*?*aspects= |
| Disallow | /*?*replies= |
| Disallow | /*?*date= |
| Disallow | /*?*trustscore= |
| Disallow | /*?*claimed= |
| Disallow | /*?*country= |
| Disallow | /*?*location= |
| Disallow | /*?*subcategories= |
| Disallow | /search |
| Disallow | /sessions |
| Disallow | /submitted/review |
| Disallow | /users/ |
| Allow | /users/connect |
| Disallow | /users/connect?redirect |
| Disallow | /users/connect?signup |
| Disallow | /users/activate |
| Disallow | /users/embed-login-to-edit |
| Disallow | /users/create |
| Disallow | /unsubscribe/invitation |
msnbot
| Rule | Path |
|---|---|
| Disallow | /error |
| Disallow | /evaluate/ |
| Disallow | /evaluate-link |
| Disallow | /evaluate-unique-link |
| Disallow | /pingdom |
| Disallow | /reviews/ |
| Disallow | /review/*/transparency |
| Disallow | /*?*editmode= |
| Disallow | /api/* |
| Disallow | /*?*languages= |
| Disallow | /*?*stars= |
| Disallow | /*?*sort= |
| Disallow | /*?*verified= |
| Disallow | /*?*aspects= |
| Disallow | /*?*replies= |
| Disallow | /*?*date= |
| Disallow | /*?*trustscore= |
| Disallow | /*?*claimed= |
| Disallow | /*?*country= |
| Disallow | /*?*location= |
| Disallow | /*?*subcategories= |
| Disallow | /search |
| Disallow | /sessions |
| Disallow | /submitted/review |
| Disallow | /users/ |
| Allow | /users/connect |
| Disallow | /users/connect?redirect |
| Disallow | /users/connect?signup |
| Disallow | /users/activate |
| Disallow | /users/embed-login-to-edit |
| Disallow | /users/create |
| Disallow | /unsubscribe/invitation |
ia_archiver
| Rule | Path |
|---|---|
| Disallow | /error |
| Disallow | /evaluate/ |
| Disallow | /evaluate-link |
| Disallow | /evaluate-unique-link |
| Disallow | /pingdom |
| Disallow | /reviews/ |
| Disallow | /review/*/transparency |
| Disallow | /*?*editmode= |
| Disallow | /api/* |
| Disallow | /*?*languages= |
| Disallow | /*?*stars= |
| Disallow | /*?*sort= |
| Disallow | /*?*verified= |
| Disallow | /*?*aspects= |
| Disallow | /*?*replies= |
| Disallow | /*?*date= |
| Disallow | /*?*trustscore= |
| Disallow | /*?*claimed= |
| Disallow | /*?*country= |
| Disallow | /*?*location= |
| Disallow | /*?*subcategories= |
| Disallow | /search |
| Disallow | /sessions |
| Disallow | /submitted/review |
| Disallow | /users/ |
| Allow | /users/connect |
| Disallow | /users/connect?redirect |
| Disallow | /users/connect?signup |
| Disallow | /users/activate |
| Disallow | /users/embed-login-to-edit |
| Disallow | /users/create |
| Disallow | /unsubscribe/invitation |
alexabot
| Rule | Path |
|---|---|
| Disallow | /error |
| Disallow | /evaluate/ |
| Disallow | /evaluate-link |
| Disallow | /evaluate-unique-link |
| Disallow | /pingdom |
| Disallow | /reviews/ |
| Disallow | /review/*/transparency |
| Disallow | /*?*editmode= |
| Disallow | /api/* |
| Disallow | /*?*languages= |
| Disallow | /*?*stars= |
| Disallow | /*?*sort= |
| Disallow | /*?*verified= |
| Disallow | /*?*aspects= |
| Disallow | /*?*replies= |
| Disallow | /*?*date= |
| Disallow | /*?*trustscore= |
| Disallow | /*?*claimed= |
| Disallow | /*?*country= |
| Disallow | /*?*location= |
| Disallow | /*?*subcategories= |
| Disallow | /search |
| Disallow | /sessions |
| Disallow | /submitted/review |
| Disallow | /users/ |
| Allow | /users/connect |
| Disallow | /users/connect?redirect |
| Disallow | /users/connect?signup |
| Disallow | /users/activate |
| Disallow | /users/embed-login-to-edit |
| Disallow | /users/create |
| Disallow | /unsubscribe/invitation |
scoutjet
| Rule | Path |
|---|---|
| Disallow | /error |
| Disallow | /evaluate/ |
| Disallow | /evaluate-link |
| Disallow | /evaluate-unique-link |
| Disallow | /pingdom |
| Disallow | /reviews/ |
| Disallow | /review/*/transparency |
| Disallow | /*?*editmode= |
| Disallow | /api/* |
| Disallow | /*?*languages= |
| Disallow | /*?*stars= |
| Disallow | /*?*sort= |
| Disallow | /*?*verified= |
| Disallow | /*?*aspects= |
| Disallow | /*?*replies= |
| Disallow | /*?*date= |
| Disallow | /*?*trustscore= |
| Disallow | /*?*claimed= |
| Disallow | /*?*country= |
| Disallow | /*?*location= |
| Disallow | /*?*subcategories= |
| Disallow | /search |
| Disallow | /sessions |
| Disallow | /submitted/review |
| Disallow | /users/ |
| Allow | /users/connect |
| Disallow | /users/connect?redirect |
| Disallow | /users/connect?signup |
| Disallow | /users/activate |
| Disallow | /users/embed-login-to-edit |
| Disallow | /users/create |
| Disallow | /unsubscribe/invitation |
slurp
| Rule | Path |
|---|---|
| Disallow | /error |
| Disallow | /evaluate/ |
| Disallow | /evaluate-link |
| Disallow | /evaluate-unique-link |
| Disallow | /pingdom |
| Disallow | /reviews/ |
| Disallow | /review/*/transparency |
| Disallow | /*?*editmode= |
| Disallow | /api/* |
| Disallow | /*?*languages= |
| Disallow | /*?*stars= |
| Disallow | /*?*sort= |
| Disallow | /*?*verified= |
| Disallow | /*?*aspects= |
| Disallow | /*?*replies= |
| Disallow | /*?*date= |
| Disallow | /*?*trustscore= |
| Disallow | /*?*claimed= |
| Disallow | /*?*country= |
| Disallow | /*?*location= |
| Disallow | /*?*subcategories= |
| Disallow | /search |
| Disallow | /sessions |
| Disallow | /submitted/review |
| Disallow | /users/ |
| Allow | /users/connect |
| Disallow | /users/connect?redirect |
| Disallow | /users/connect?signup |
| Disallow | /users/activate |
| Disallow | /users/embed-login-to-edit |
| Disallow | /users/create |
| Disallow | /unsubscribe/invitation |
twitterbot
| Rule | Path |
|---|---|
| Disallow | /error |
| Disallow | /evaluate/ |
| Disallow | /evaluate-link |
| Disallow | /evaluate-unique-link |
| Disallow | /pingdom |
| Disallow | /reviews/ |
| Disallow | /review/*/transparency |
| Disallow | /*?*editmode= |
| Disallow | /api/* |
| Disallow | /*?*languages= |
| Disallow | /*?*stars= |
| Disallow | /*?*sort= |
| Disallow | /*?*verified= |
| Disallow | /*?*aspects= |
| Disallow | /*?*replies= |
| Disallow | /*?*date= |
| Disallow | /*?*trustscore= |
| Disallow | /*?*claimed= |
| Disallow | /*?*country= |
| Disallow | /*?*location= |
| Disallow | /*?*subcategories= |
| Disallow | /search |
| Disallow | /sessions |
| Disallow | /submitted/review |
| Disallow | /users/ |
| Allow | /users/connect |
| Disallow | /users/connect?redirect |
| Disallow | /users/connect?signup |
| Disallow | /users/activate |
| Disallow | /users/embed-login-to-edit |
| Disallow | /users/create |
| Disallow | /unsubscribe/invitation |
baiduspider
| Rule | Path |
|---|---|
| Disallow | /error |
| Disallow | /evaluate/ |
| Disallow | /evaluate-link |
| Disallow | /evaluate-unique-link |
| Disallow | /pingdom |
| Disallow | /reviews/ |
| Disallow | /review/*/transparency |
| Disallow | /*?*editmode= |
| Disallow | /api/* |
| Disallow | /*?*languages= |
| Disallow | /*?*stars= |
| Disallow | /*?*sort= |
| Disallow | /*?*verified= |
| Disallow | /*?*aspects= |
| Disallow | /*?*replies= |
| Disallow | /*?*date= |
| Disallow | /*?*trustscore= |
| Disallow | /*?*claimed= |
| Disallow | /*?*country= |
| Disallow | /*?*location= |
| Disallow | /*?*subcategories= |
| Disallow | /search |
| Disallow | /sessions |
| Disallow | /submitted/review |
| Disallow | /users/ |
| Allow | /users/connect |
| Disallow | /users/connect?redirect |
| Disallow | /users/connect?signup |
| Disallow | /users/activate |
| Disallow | /users/embed-login-to-edit |
| Disallow | /users/create |
| Disallow | /unsubscribe/invitation |
facebookbot
| Rule | Path |
|---|---|
| Disallow | /error |
| Disallow | /evaluate/ |
| Disallow | /evaluate-link |
| Disallow | /evaluate-unique-link |
| Disallow | /pingdom |
| Allow | /reviews/ |
| Disallow | /review/*/transparency |
| Disallow | /*?*editmode= |
| Disallow | /api/* |
| Disallow | /*?*languages= |
| Disallow | /*?*stars= |
| Disallow | /*?*sort= |
| Disallow | /*?*verified= |
| Disallow | /*?*aspects= |
| Disallow | /*?*replies= |
| Disallow | /*?*date= |
| Disallow | /*?*trustscore= |
| Disallow | /*?*claimed= |
| Disallow | /*?*country= |
| Disallow | /*?*location= |
| Disallow | /*?*subcategories= |
| Disallow | /search |
| Disallow | /sessions |
| Disallow | /submitted/review |
| Disallow | /users/ |
| Allow | /users/connect |
| Disallow | /users/connect?redirect |
| Disallow | /users/connect?signup |
| Disallow | /users/activate |
| Disallow | /users/embed-login-to-edit |
| Disallow | /users/create |
| Disallow | /unsubscribe/invitation |
facebookexternalhit
| Rule | Path |
|---|---|
| Disallow | /error |
| Disallow | /evaluate/ |
| Disallow | /evaluate-link |
| Disallow | /evaluate-unique-link |
| Disallow | /pingdom |
| Allow | /reviews/ |
| Disallow | /review/*/transparency |
| Disallow | /*?*editmode= |
| Disallow | /api/* |
| Disallow | /*?*languages= |
| Disallow | /*?*stars= |
| Disallow | /*?*sort= |
| Disallow | /*?*verified= |
| Disallow | /*?*aspects= |
| Disallow | /*?*replies= |
| Disallow | /*?*date= |
| Disallow | /*?*trustscore= |
| Disallow | /*?*claimed= |
| Disallow | /*?*country= |
| Disallow | /*?*location= |
| Disallow | /*?*subcategories= |
| Disallow | /search |
| Disallow | /sessions |
| Disallow | /submitted/review |
| Disallow | /users/ |
| Allow | /users/connect |
| Disallow | /users/connect?redirect |
| Disallow | /users/connect?signup |
| Disallow | /users/activate |
| Disallow | /users/embed-login-to-edit |
| Disallow | /users/create |
| Disallow | /unsubscribe/invitation |
duckduckbot
| Rule | Path |
|---|---|
| Disallow | /error |
| Disallow | /evaluate/ |
| Disallow | /evaluate-link |
| Disallow | /evaluate-unique-link |
| Disallow | /pingdom |
| Disallow | /reviews/ |
| Disallow | /review/*/transparency |
| Disallow | /*?*editmode= |
| Disallow | /api/* |
| Disallow | /*?*languages= |
| Disallow | /*?*stars= |
| Disallow | /*?*sort= |
| Disallow | /*?*verified= |
| Disallow | /*?*aspects= |
| Disallow | /*?*replies= |
| Disallow | /*?*date= |
| Disallow | /*?*trustscore= |
| Disallow | /*?*claimed= |
| Disallow | /*?*country= |
| Disallow | /*?*location= |
| Disallow | /*?*subcategories= |
| Disallow | /search |
| Disallow | /sessions |
| Disallow | /submitted/review |
| Disallow | /users/ |
| Allow | /users/connect |
| Disallow | /users/connect?redirect |
| Disallow | /users/connect?signup |
| Disallow | /users/activate |
| Disallow | /users/embed-login-to-edit |
| Disallow | /users/create |
| Disallow | /unsubscribe/invitation |
*
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://sitemaps.trustpilot.com/index_en-au.xml |
| sitemap | https://trustpilot.com/trust/sitemaps/domain_en-au.xml |
| sitemap | https://trustpilot.com/blog/sitemaps/domain_en-au.xml |