kravein.com.au
robots.txt
Robots Exclusion Standard data for kravein.com.au
Resource Scan
Scan Details
| Site Domain | kravein.com.au |
| Base Domain | kravein.com.au |
| Scan Status | Ok |
| Last Scan | 2024-06-18T06:24:04+00:00 |
| Next Scan | 2024-07-02T06:24:04+00:00 |
Last Scan
| Scanned | 2024-06-18T06:24:04+00:00 |
| URL | https://kravein.com.au/robots.txt |
| Redirect | https://www.kravein.com.au/robots.txt |
| Redirect Domain | www.kravein.com.au |
| Redirect Base | kravein.com.au |
| Domain IPs | 13.227.254.115, 13.227.254.119, 13.227.254.29, 13.227.254.34 |
| Redirect IPs | 76.76.21.142, 76.76.21.22 |
| Response IP | 76.76.21.164 |
| Found | Yes |
| Hash | c40d71cbde45cf52ec55e0a034475d4b4ca6cf2e3469a24a08b894698ddfbc35 |
| SimHash | 04754740c7d5 |
Groups
googlebot
| Rule | Path |
|---|---|
| Disallow | /item-review/* |
| Disallow | /item-review?* |
| Disallow | /place-review/* |
| Disallow | /place-review?* |
| Disallow | /add-place/ |
| Disallow | /claim-place/ |
| Disallow | /profile/ |
| Disallow | /profile?t* |
| Disallow | /profile/* |
| Allow | / |
googlebot-mobile
| Rule | Path |
|---|---|
| Disallow | /item-review/* |
| Disallow | /item-review?* |
| Disallow | /place-review/* |
| Disallow | /place-review?* |
| Disallow | /add-place/ |
| Disallow | /claim-place/ |
| Disallow | /profile/ |
| Disallow | /profile?t* |
| Disallow | /profile/* |
| Allow | / |
mediapartners-google
| Rule | Path |
|---|---|
| Disallow | /item-review/* |
| Disallow | /item-review?* |
| Disallow | /place-review/* |
| Disallow | /place-review?* |
| Disallow | /add-place/ |
| Disallow | /claim-place/ |
| Disallow | /profile/ |
| Disallow | /profile?t* |
| Disallow | /profile/* |
| Allow | / |
adsbot-google
| Rule | Path |
|---|---|
| Disallow | /item-review/* |
| Disallow | /item-review?* |
| Disallow | /place-review/* |
| Disallow | /place-review?* |
| Disallow | /add-place/ |
| Disallow | /claim-place/ |
| Disallow | /profile/ |
| Disallow | /profile?t* |
| Disallow | /profile/* |
| Allow | / |
bingbot
| Rule | Path |
|---|---|
| Disallow | /item-review/* |
| Disallow | /item-review?* |
| Disallow | /place-review/* |
| Disallow | /place-review?* |
| Disallow | /add-place/ |
| Disallow | /claim-place/ |
| Disallow | /profile/ |
| Disallow | /profile?t* |
| Disallow | /profile/* |
| Allow | / |
ia_archiver
| Rule | Path |
|---|---|
| Disallow | /item-review/* |
| Disallow | /item-review?* |
| Disallow | /place-review/* |
| Disallow | /place-review?* |
| Disallow | /add-place/ |
| Disallow | /claim-place/ |
| Disallow | /profile/ |
| Disallow | /profile?t* |
| Disallow | /profile/* |
| Allow | / |
twitterbot
| Rule | Path |
|---|---|
| Disallow | /item-review/* |
| Disallow | /item-review?* |
| Disallow | /place-review/* |
| Disallow | /place-review?* |
| Disallow | /add-place/ |
| Disallow | /claim-place/ |
| Disallow | /profile/ |
| Disallow | /profile?t* |
| Disallow | /profile/* |
| Allow | / |
duckduckbot
| Rule | Path |
|---|---|
| Disallow | /item-review/* |
| Disallow | /item-review?* |
| Disallow | /place-review/* |
| Disallow | /place-review?* |
| Disallow | /add-place/ |
| Disallow | /claim-place/ |
| Disallow | /profile/ |
| Disallow | /profile?t* |
| Disallow | /profile/* |
| Allow | / |
applebot
| Rule | Path |
|---|---|
| Disallow | /item-review/* |
| Disallow | /item-review?* |
| Disallow | /place-review/* |
| Disallow | /place-review?* |
| Disallow | /add-place/ |
| Disallow | /claim-place/ |
| Disallow | /profile/ |
| Disallow | /profile?t* |
| Disallow | /profile/* |
| Allow | / |
facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
| Rule | Path |
|---|---|
| Disallow | /item-review/* |
| Disallow | /item-review?* |
| Disallow | /place-review/* |
| Disallow | /place-review?* |
| Disallow | /add-place/ |
| Disallow | /claim-place/ |
| Disallow | /profile/ |
| Disallow | /profile?t* |
| Disallow | /profile/* |
| Allow | / |
facebookexternalhit/1.1
| Rule | Path |
|---|---|
| Disallow | /item-review/* |
| Disallow | /item-review?* |
| Disallow | /place-review/* |
| Disallow | /place-review?* |
| Disallow | /add-place/ |
| Disallow | /claim-place/ |
| Disallow | /profile/ |
| Disallow | /profile?t* |
| Disallow | /profile/* |
| Allow | / |
facebookcatalog/1.0
| Rule | Path |
|---|---|
| Disallow | /item-review/* |
| Disallow | /item-review?* |
| Disallow | /place-review/* |
| Disallow | /place-review?* |
| Disallow | /add-place/ |
| Disallow | /claim-place/ |
| Disallow | /profile/ |
| Disallow | /profile?t* |
| Disallow | /profile/* |
| Allow | / |
*
| Rule | Path |
|---|---|
| Disallow | / |