gett.com
robots.txt
Robots Exclusion Standard data for gett.com
Resource Scan
Scan Details
| Site Domain | gett.com |
| Base Domain | gett.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-05-17T11:54:08+00:00 |
| Next Scan | 2024-08-15T11:54:08+00:00 |
Last Successful Scan
| Scanned | 2023-09-27T16:12:57+00:00 |
| URL | https://gett.com/robots.txt |
| Redirect | https://www.gett.com/robots.txt |
| Redirect Domain | www.gett.com |
| Redirect Base | gett.com |
| Domain IPs | 13.33.33.128, 13.33.33.17, 13.33.33.19, 13.33.33.37 |
| Redirect IPs | 104.22.52.78, 104.22.53.78, 172.67.39.106, 2606:4700:10::6816:344e, 2606:4700:10::6816:354e, 2606:4700:10::ac43:276a |
| Response IP | 172.67.39.106 |
| Found | Yes |
| Hash | f5c011857daae31e93c422c299fb34732bab293e2329d3fb0f638cba4d9de7a0 |
| SimHash | 6e32006acd87 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
| Disallow | /trackback/ |
| Disallow | /xmlrpc.php |
| Disallow | /feed/ |
| Disallow | /wordpress/ |
| Disallow | /wp-content/ |
| Allow | /wp-content/*.css |
| Allow | /wp-content/*.js |
| Allow | /wp-content/*.jpg |
| Allow | /wp-content/*.jpeg |
| Allow | /wp-content/*.png |
| Allow | /wp-content/*.svg |
| Allow | /wp-content/*.gif |
| Allow | /wp-content/*.ico |
| Allow | /wp-content/*.woff |
| Allow | /wp-content/*.woff2 |
| Disallow | /wp-includes/ |
| Allow | /wp-includes/*.css |
| Allow | /wp-includes/*.js |
| Allow | /wp-includes/*.jpg |
| Allow | /wp-includes/*.jpeg |
| Allow | /wp-includes/*.png |
| Allow | /wp-includes/*.gif |
| Allow | /wp-includes/*.ico |
| Disallow | |
| Disallow | /*.xls |
| Disallow | /*.doc |
| Disallow | /*.ppt |
| Disallow | /*.txt |
googlebot
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
| Disallow | /trackback/ |
| Disallow | /xmlrpc.php |
| Disallow | /feed/ |
| Disallow | /wordpress/ |
| Disallow | /wp-content/ |
| Allow | /wp-content/*.css |
| Allow | /wp-content/*.js |
| Allow | /wp-content/*.jpg |
| Allow | /wp-content/*.jpeg |
| Allow | /wp-content/*.png |
| Allow | /wp-content/*.svg |
| Allow | /wp-content/*.gif |
| Allow | /wp-content/*.ico |
| Allow | /wp-content/*.woff |
| Allow | /wp-content/*.woff2 |
| Disallow | /wp-includes/ |
| Allow | /wp-includes/*.css |
| Allow | /wp-includes/*.js |
| Allow | /wp-includes/*.jpg |
| Allow | /wp-includes/*.jpeg |
| Allow | /wp-includes/*.png |
| Allow | /wp-includes/*.gif |
| Allow | /wp-includes/*.ico |
| Disallow | |
| Disallow | /*.xls |
| Disallow | /*.doc |
| Disallow | /*.ppt |
| Disallow | /*.txt |
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
| Disallow | /trackback/ |
| Disallow | /xmlrpc.php |
| Disallow | /feed/ |
| Disallow | /wordpress/ |
| Disallow | /wp-content/ |
| Allow | /wp-content/*.css |
| Allow | /wp-content/*.js |
| Allow | /wp-content/*.jpg |
| Allow | /wp-content/*.jpeg |
| Allow | /wp-content/*.png |
| Allow | /wp-content/*.svg |
| Allow | /wp-content/*.gif |
| Allow | /wp-content/*.ico |
| Allow | /wp-content/*.woff |
| Allow | /wp-content/*.woff2 |
| Disallow | /wp-includes/ |
| Allow | /wp-includes/*.css |
| Allow | /wp-includes/*.js |
| Allow | /wp-includes/*.jpg |
| Allow | /wp-includes/*.jpeg |
| Allow | /wp-includes/*.png |
| Allow | /wp-includes/*.gif |
| Allow | /wp-includes/*.ico |
| Disallow | |
| Disallow | /*.xls |
| Disallow | /*.doc |
| Disallow | /*.ppt |
| Disallow | /*.txt |
Other Records
| Field | Value |
|---|---|
| sitemap | https://gett.com/sitemap_index.xml |
| sitemap | https://gett.com/uk/sitemap_index.xml |
| sitemap | https://gett.com/ru/sitemap_index.xml |
| sitemap | https://gett.com/il/sitemap_index.xml |
Warnings
- `clean-param` is not a known field.