trustpilot.com.au
robots.txt
Robots Exclusion Standard data for trustpilot.com.au
Resource Scan
Scan Details
| Site Domain | trustpilot.com.au |
| Base Domain | trustpilot.com.au |
| Scan Status | Ok |
| Last Scan | 2024-11-09T12:00:38+00:00 |
| Next Scan | 2024-11-16T12:00:38+00:00 |
Last Scan
| Scanned | 2024-11-09T12:00:38+00:00 |
| URL | http://trustpilot.com.au/robots.txt |
| Redirect | https://au.trustpilot.com/robots.txt |
| Redirect Domain | au.trustpilot.com |
| Redirect Base | trustpilot.com |
| Domain IPs | 52.48.133.245, 54.77.187.200 |
| Redirect IPs | 108.157.254.100, 108.157.254.129, 108.157.254.45, 108.157.254.84 |
| Response IP | 108.157.254.129 |
| Found | Yes |
| Hash | dd40b528bd9d84490ef9c979e8a7bb8c732ecfc54689b217b5a35db9b5930c5d |
| SimHash | 6855791095c3 |
Groups
googlebot
| Rule | Path |
|---|---|
| Disallow | /error |
| Disallow | /evaluate/ |
| Disallow | /evaluate-link |
| Disallow | /evaluate-unique-link |
| Disallow | /pingdom |
| Disallow | /reviews/ |
| Disallow | /review/*/transparency |
| Disallow | /*?*editmode= |
| Disallow | /api/* |
| Disallow | /*?*languages= |
| Disallow | /*?*stars= |
| Disallow | /*?*sort= |
| Disallow | /*?*verified= |
| Disallow | /*?*aspects= |
| Disallow | /*?*replies= |
| Disallow | /*?*date= |
| Disallow | /*?*trustscore= |
| Disallow | /*?*claimed= |
| Disallow | /*?*country= |
| Disallow | /*?*location= |
| Disallow | /*?*subcategories= |
| Disallow | /search |
| Disallow | /sessions |
| Disallow | /submitted/review |
| Disallow | /users/ |
| Allow | /users/connect |
| Disallow | /users/connect?redirect |
| Disallow | /users/connect?signup |
| Disallow | /users/activate |
| Disallow | /users/embed-login-to-edit |
| Disallow | /users/create |
| Disallow | /unsubscribe/invitation |
mediapartners-google
| Rule | Path |
|---|---|
| Disallow | /error |
| Disallow | /evaluate/ |
| Disallow | /evaluate-link |
| Disallow | /evaluate-unique-link |
| Disallow | /pingdom |
| Disallow | /reviews/ |
| Disallow | /review/*/transparency |
| Disallow | /*?*editmode= |
| Disallow | /api/* |
| Disallow | /*?*languages= |
| Disallow | /*?*stars= |
| Disallow | /*?*sort= |
| Disallow | /*?*verified= |
| Disallow | /*?*aspects= |
| Disallow | /*?*replies= |
| Disallow | /*?*date= |
| Disallow | /*?*trustscore= |
| Disallow | /*?*claimed= |
| Disallow | /*?*country= |
| Disallow | /*?*location= |
| Disallow | /*?*subcategories= |
| Disallow | /search |
| Disallow | /sessions |
| Disallow | /submitted/review |
| Disallow | /users/ |
| Allow | /users/connect |
| Disallow | /users/connect?redirect |
| Disallow | /users/connect?signup |
| Disallow | /users/activate |
| Disallow | /users/embed-login-to-edit |
| Disallow | /users/create |
| Disallow | /unsubscribe/invitation |
googlebot-mobile
| Rule | Path |
|---|---|
| Disallow | /error |
| Disallow | /evaluate/ |
| Disallow | /evaluate-link |
| Disallow | /evaluate-unique-link |
| Disallow | /pingdom |
| Disallow | /reviews/ |
| Disallow | /review/*/transparency |
| Disallow | /*?*editmode= |
| Disallow | /api/* |
| Disallow | /*?*languages= |
| Disallow | /*?*stars= |
| Disallow | /*?*sort= |
| Disallow | /*?*verified= |
| Disallow | /*?*aspects= |
| Disallow | /*?*replies= |
| Disallow | /*?*date= |
| Disallow | /*?*trustscore= |
| Disallow | /*?*claimed= |
| Disallow | /*?*country= |
| Disallow | /*?*location= |
| Disallow | /*?*subcategories= |
| Disallow | /search |
| Disallow | /sessions |
| Disallow | /submitted/review |
| Disallow | /users/ |
| Allow | /users/connect |
| Disallow | /users/connect?redirect |
| Disallow | /users/connect?signup |
| Disallow | /users/activate |
| Disallow | /users/embed-login-to-edit |
| Disallow | /users/create |
| Disallow | /unsubscribe/invitation |
adsbot-google
| Rule | Path |
|---|---|
| Disallow | /error |
| Disallow | /evaluate/ |
| Disallow | /evaluate-link |
| Disallow | /evaluate-unique-link |
| Disallow | /pingdom |
| Disallow | /reviews/ |
| Disallow | /review/*/transparency |
| Disallow | /*?*editmode= |
| Disallow | /api/* |
| Disallow | /*?*languages= |
| Disallow | /*?*stars= |
| Disallow | /*?*sort= |
| Disallow | /*?*verified= |
| Disallow | /*?*aspects= |
| Disallow | /*?*replies= |
| Disallow | /*?*date= |
| Disallow | /*?*trustscore= |
| Disallow | /*?*claimed= |
| Disallow | /*?*country= |
| Disallow | /*?*location= |
| Disallow | /*?*subcategories= |
| Disallow | /search |
| Disallow | /sessions |
| Disallow | /submitted/review |
| Disallow | /users/ |
| Allow | /users/connect |
| Disallow | /users/connect?redirect |
| Disallow | /users/connect?signup |
| Disallow | /users/activate |
| Disallow | /users/embed-login-to-edit |
| Disallow | /users/create |
| Disallow | /unsubscribe/invitation |
adsbot-google-mobile
| Rule | Path |
|---|---|
| Disallow | /error |
| Disallow | /evaluate/ |
| Disallow | /evaluate-link |
| Disallow | /evaluate-unique-link |
| Disallow | /pingdom |
| Disallow | /reviews/ |
| Disallow | /review/*/transparency |
| Disallow | /*?*editmode= |
| Disallow | /api/* |
| Disallow | /*?*languages= |
| Disallow | /*?*stars= |
| Disallow | /*?*sort= |
| Disallow | /*?*verified= |
| Disallow | /*?*aspects= |
| Disallow | /*?*replies= |
| Disallow | /*?*date= |
| Disallow | /*?*trustscore= |
| Disallow | /*?*claimed= |
| Disallow | /*?*country= |
| Disallow | /*?*location= |
| Disallow | /*?*subcategories= |
| Disallow | /search |
| Disallow | /sessions |
| Disallow | /submitted/review |
| Disallow | /users/ |
| Allow | /users/connect |
| Disallow | /users/connect?redirect |
| Disallow | /users/connect?signup |
| Disallow | /users/activate |
| Disallow | /users/embed-login-to-edit |
| Disallow | /users/create |
| Disallow | /unsubscribe/invitation |
bingbot
| Rule | Path |
|---|---|
| Disallow | /error |
| Disallow | /evaluate/ |
| Disallow | /evaluate-link |
| Disallow | /evaluate-unique-link |
| Disallow | /pingdom |
| Disallow | /reviews/ |
| Disallow | /review/*/transparency |
| Disallow | /*?*editmode= |
| Disallow | /api/* |
| Disallow | /*?*languages= |
| Disallow | /*?*stars= |
| Disallow | /*?*sort= |
| Disallow | /*?*verified= |
| Disallow | /*?*aspects= |
| Disallow | /*?*replies= |
| Disallow | /*?*date= |
| Disallow | /*?*trustscore= |
| Disallow | /*?*claimed= |
| Disallow | /*?*country= |
| Disallow | /*?*location= |
| Disallow | /*?*subcategories= |
| Disallow | /search |
| Disallow | /sessions |
| Disallow | /submitted/review |
| Disallow | /users/ |
| Allow | /users/connect |
| Disallow | /users/connect?redirect |
| Disallow | /users/connect?signup |
| Disallow | /users/activate |
| Disallow | /users/embed-login-to-edit |
| Disallow | /users/create |
| Disallow | /unsubscribe/invitation |
msnbot
| Rule | Path |
|---|---|
| Disallow | /error |
| Disallow | /evaluate/ |
| Disallow | /evaluate-link |
| Disallow | /evaluate-unique-link |
| Disallow | /pingdom |
| Disallow | /reviews/ |
| Disallow | /review/*/transparency |
| Disallow | /*?*editmode= |
| Disallow | /api/* |
| Disallow | /*?*languages= |
| Disallow | /*?*stars= |
| Disallow | /*?*sort= |
| Disallow | /*?*verified= |
| Disallow | /*?*aspects= |
| Disallow | /*?*replies= |
| Disallow | /*?*date= |
| Disallow | /*?*trustscore= |
| Disallow | /*?*claimed= |
| Disallow | /*?*country= |
| Disallow | /*?*location= |
| Disallow | /*?*subcategories= |
| Disallow | /search |
| Disallow | /sessions |
| Disallow | /submitted/review |
| Disallow | /users/ |
| Allow | /users/connect |
| Disallow | /users/connect?redirect |
| Disallow | /users/connect?signup |
| Disallow | /users/activate |
| Disallow | /users/embed-login-to-edit |
| Disallow | /users/create |
| Disallow | /unsubscribe/invitation |
ia_archiver
| Rule | Path |
|---|---|
| Disallow | /error |
| Disallow | /evaluate/ |
| Disallow | /evaluate-link |
| Disallow | /evaluate-unique-link |
| Disallow | /pingdom |
| Disallow | /reviews/ |
| Disallow | /review/*/transparency |
| Disallow | /*?*editmode= |
| Disallow | /api/* |
| Disallow | /*?*languages= |
| Disallow | /*?*stars= |
| Disallow | /*?*sort= |
| Disallow | /*?*verified= |
| Disallow | /*?*aspects= |
| Disallow | /*?*replies= |
| Disallow | /*?*date= |
| Disallow | /*?*trustscore= |
| Disallow | /*?*claimed= |
| Disallow | /*?*country= |
| Disallow | /*?*location= |
| Disallow | /*?*subcategories= |
| Disallow | /search |
| Disallow | /sessions |
| Disallow | /submitted/review |
| Disallow | /users/ |
| Allow | /users/connect |
| Disallow | /users/connect?redirect |
| Disallow | /users/connect?signup |
| Disallow | /users/activate |
| Disallow | /users/embed-login-to-edit |
| Disallow | /users/create |
| Disallow | /unsubscribe/invitation |
alexabot
| Rule | Path |
|---|---|
| Disallow | /error |
| Disallow | /evaluate/ |
| Disallow | /evaluate-link |
| Disallow | /evaluate-unique-link |
| Disallow | /pingdom |
| Disallow | /reviews/ |
| Disallow | /review/*/transparency |
| Disallow | /*?*editmode= |
| Disallow | /api/* |
| Disallow | /*?*languages= |
| Disallow | /*?*stars= |
| Disallow | /*?*sort= |
| Disallow | /*?*verified= |
| Disallow | /*?*aspects= |
| Disallow | /*?*replies= |
| Disallow | /*?*date= |
| Disallow | /*?*trustscore= |
| Disallow | /*?*claimed= |
| Disallow | /*?*country= |
| Disallow | /*?*location= |
| Disallow | /*?*subcategories= |
| Disallow | /search |
| Disallow | /sessions |
| Disallow | /submitted/review |
| Disallow | /users/ |
| Allow | /users/connect |
| Disallow | /users/connect?redirect |
| Disallow | /users/connect?signup |
| Disallow | /users/activate |
| Disallow | /users/embed-login-to-edit |
| Disallow | /users/create |
| Disallow | /unsubscribe/invitation |
scoutjet
| Rule | Path |
|---|---|
| Disallow | /error |
| Disallow | /evaluate/ |
| Disallow | /evaluate-link |
| Disallow | /evaluate-unique-link |
| Disallow | /pingdom |
| Disallow | /reviews/ |
| Disallow | /review/*/transparency |
| Disallow | /*?*editmode= |
| Disallow | /api/* |
| Disallow | /*?*languages= |
| Disallow | /*?*stars= |
| Disallow | /*?*sort= |
| Disallow | /*?*verified= |
| Disallow | /*?*aspects= |
| Disallow | /*?*replies= |
| Disallow | /*?*date= |
| Disallow | /*?*trustscore= |
| Disallow | /*?*claimed= |
| Disallow | /*?*country= |
| Disallow | /*?*location= |
| Disallow | /*?*subcategories= |
| Disallow | /search |
| Disallow | /sessions |
| Disallow | /submitted/review |
| Disallow | /users/ |
| Allow | /users/connect |
| Disallow | /users/connect?redirect |
| Disallow | /users/connect?signup |
| Disallow | /users/activate |
| Disallow | /users/embed-login-to-edit |
| Disallow | /users/create |
| Disallow | /unsubscribe/invitation |
slurp
| Rule | Path |
|---|---|
| Disallow | /error |
| Disallow | /evaluate/ |
| Disallow | /evaluate-link |
| Disallow | /evaluate-unique-link |
| Disallow | /pingdom |
| Disallow | /reviews/ |
| Disallow | /review/*/transparency |
| Disallow | /*?*editmode= |
| Disallow | /api/* |
| Disallow | /*?*languages= |
| Disallow | /*?*stars= |
| Disallow | /*?*sort= |
| Disallow | /*?*verified= |
| Disallow | /*?*aspects= |
| Disallow | /*?*replies= |
| Disallow | /*?*date= |
| Disallow | /*?*trustscore= |
| Disallow | /*?*claimed= |
| Disallow | /*?*country= |
| Disallow | /*?*location= |
| Disallow | /*?*subcategories= |
| Disallow | /search |
| Disallow | /sessions |
| Disallow | /submitted/review |
| Disallow | /users/ |
| Allow | /users/connect |
| Disallow | /users/connect?redirect |
| Disallow | /users/connect?signup |
| Disallow | /users/activate |
| Disallow | /users/embed-login-to-edit |
| Disallow | /users/create |
| Disallow | /unsubscribe/invitation |
twitterbot
| Rule | Path |
|---|---|
| Disallow | /error |
| Disallow | /evaluate/ |
| Disallow | /evaluate-link |
| Disallow | /evaluate-unique-link |
| Disallow | /pingdom |
| Disallow | /reviews/ |
| Disallow | /review/*/transparency |
| Disallow | /*?*editmode= |
| Disallow | /api/* |
| Disallow | /*?*languages= |
| Disallow | /*?*stars= |
| Disallow | /*?*sort= |
| Disallow | /*?*verified= |
| Disallow | /*?*aspects= |
| Disallow | /*?*replies= |
| Disallow | /*?*date= |
| Disallow | /*?*trustscore= |
| Disallow | /*?*claimed= |
| Disallow | /*?*country= |
| Disallow | /*?*location= |
| Disallow | /*?*subcategories= |
| Disallow | /search |
| Disallow | /sessions |
| Disallow | /submitted/review |
| Disallow | /users/ |
| Allow | /users/connect |
| Disallow | /users/connect?redirect |
| Disallow | /users/connect?signup |
| Disallow | /users/activate |
| Disallow | /users/embed-login-to-edit |
| Disallow | /users/create |
| Disallow | /unsubscribe/invitation |
baiduspider
| Rule | Path |
|---|---|
| Disallow | /error |
| Disallow | /evaluate/ |
| Disallow | /evaluate-link |
| Disallow | /evaluate-unique-link |
| Disallow | /pingdom |
| Disallow | /reviews/ |
| Disallow | /review/*/transparency |
| Disallow | /*?*editmode= |
| Disallow | /api/* |
| Disallow | /*?*languages= |
| Disallow | /*?*stars= |
| Disallow | /*?*sort= |
| Disallow | /*?*verified= |
| Disallow | /*?*aspects= |
| Disallow | /*?*replies= |
| Disallow | /*?*date= |
| Disallow | /*?*trustscore= |
| Disallow | /*?*claimed= |
| Disallow | /*?*country= |
| Disallow | /*?*location= |
| Disallow | /*?*subcategories= |
| Disallow | /search |
| Disallow | /sessions |
| Disallow | /submitted/review |
| Disallow | /users/ |
| Allow | /users/connect |
| Disallow | /users/connect?redirect |
| Disallow | /users/connect?signup |
| Disallow | /users/activate |
| Disallow | /users/embed-login-to-edit |
| Disallow | /users/create |
| Disallow | /unsubscribe/invitation |
facebookbot
| Rule | Path |
|---|---|
| Disallow | /error |
| Disallow | /evaluate/ |
| Disallow | /evaluate-link |
| Disallow | /evaluate-unique-link |
| Disallow | /pingdom |
| Allow | /reviews/ |
| Disallow | /review/*/transparency |
| Disallow | /*?*editmode= |
| Disallow | /api/* |
| Disallow | /*?*languages= |
| Disallow | /*?*stars= |
| Disallow | /*?*sort= |
| Disallow | /*?*verified= |
| Disallow | /*?*aspects= |
| Disallow | /*?*replies= |
| Disallow | /*?*date= |
| Disallow | /*?*trustscore= |
| Disallow | /*?*claimed= |
| Disallow | /*?*country= |
| Disallow | /*?*location= |
| Disallow | /*?*subcategories= |
| Disallow | /search |
| Disallow | /sessions |
| Disallow | /submitted/review |
| Disallow | /users/ |
| Allow | /users/connect |
| Disallow | /users/connect?redirect |
| Disallow | /users/connect?signup |
| Disallow | /users/activate |
| Disallow | /users/embed-login-to-edit |
| Disallow | /users/create |
| Disallow | /unsubscribe/invitation |
facebookexternalhit
| Rule | Path |
|---|---|
| Disallow | /error |
| Disallow | /evaluate/ |
| Disallow | /evaluate-link |
| Disallow | /evaluate-unique-link |
| Disallow | /pingdom |
| Allow | /reviews/ |
| Disallow | /review/*/transparency |
| Disallow | /*?*editmode= |
| Disallow | /api/* |
| Disallow | /*?*languages= |
| Disallow | /*?*stars= |
| Disallow | /*?*sort= |
| Disallow | /*?*verified= |
| Disallow | /*?*aspects= |
| Disallow | /*?*replies= |
| Disallow | /*?*date= |
| Disallow | /*?*trustscore= |
| Disallow | /*?*claimed= |
| Disallow | /*?*country= |
| Disallow | /*?*location= |
| Disallow | /*?*subcategories= |
| Disallow | /search |
| Disallow | /sessions |
| Disallow | /submitted/review |
| Disallow | /users/ |
| Allow | /users/connect |
| Disallow | /users/connect?redirect |
| Disallow | /users/connect?signup |
| Disallow | /users/activate |
| Disallow | /users/embed-login-to-edit |
| Disallow | /users/create |
| Disallow | /unsubscribe/invitation |
duckduckbot
| Rule | Path |
|---|---|
| Disallow | /error |
| Disallow | /evaluate/ |
| Disallow | /evaluate-link |
| Disallow | /evaluate-unique-link |
| Disallow | /pingdom |
| Disallow | /reviews/ |
| Disallow | /review/*/transparency |
| Disallow | /*?*editmode= |
| Disallow | /api/* |
| Disallow | /*?*languages= |
| Disallow | /*?*stars= |
| Disallow | /*?*sort= |
| Disallow | /*?*verified= |
| Disallow | /*?*aspects= |
| Disallow | /*?*replies= |
| Disallow | /*?*date= |
| Disallow | /*?*trustscore= |
| Disallow | /*?*claimed= |
| Disallow | /*?*country= |
| Disallow | /*?*location= |
| Disallow | /*?*subcategories= |
| Disallow | /search |
| Disallow | /sessions |
| Disallow | /submitted/review |
| Disallow | /users/ |
| Allow | /users/connect |
| Disallow | /users/connect?redirect |
| Disallow | /users/connect?signup |
| Disallow | /users/activate |
| Disallow | /users/embed-login-to-edit |
| Disallow | /users/create |
| Disallow | /unsubscribe/invitation |
*
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://sitemaps.trustpilot.com/index_en-au.xml |
| sitemap | https://trustpilot.com/trust/sitemaps/domain_en-au.xml |
| sitemap | https://trustpilot.com/blog/sitemaps/domain_en-au.xml |