gett.com
robots.txt
Robots Exclusion Standard data for gett.com
Resource Scan
Scan Details
Site Domain | gett.com |
Base Domain | gett.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-08-15T11:54:19+00:00 |
Next Scan | 2024-11-13T11:54:19+00:00 |
Last Successful Scan
Scanned | 2023-09-27T16:12:57+00:00 |
URL | https://gett.com/robots.txt |
Redirect | https://www.gett.com/robots.txt |
Redirect Domain | www.gett.com |
Redirect Base | gett.com |
Domain IPs | 13.33.33.128, 13.33.33.17, 13.33.33.19, 13.33.33.37 |
Redirect IPs | 104.22.52.78, 104.22.53.78, 172.67.39.106, 2606:4700:10::6816:344e, 2606:4700:10::6816:354e, 2606:4700:10::ac43:276a |
Response IP | 172.67.39.106 |
Found | Yes |
Hash | f5c011857daae31e93c422c299fb34732bab293e2329d3fb0f638cba4d9de7a0 |
SimHash | 6e32006acd87 |
Groups
yandex
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Allow | /wp-admin/admin-ajax.php |
Disallow | /trackback/ |
Disallow | /xmlrpc.php |
Disallow | /feed/ |
Disallow | /wordpress/ |
Disallow | /wp-content/ |
Allow | /wp-content/*.css |
Allow | /wp-content/*.js |
Allow | /wp-content/*.jpg |
Allow | /wp-content/*.jpeg |
Allow | /wp-content/*.png |
Allow | /wp-content/*.svg |
Allow | /wp-content/*.gif |
Allow | /wp-content/*.ico |
Allow | /wp-content/*.woff |
Allow | /wp-content/*.woff2 |
Disallow | /wp-includes/ |
Allow | /wp-includes/*.css |
Allow | /wp-includes/*.js |
Allow | /wp-includes/*.jpg |
Allow | /wp-includes/*.jpeg |
Allow | /wp-includes/*.png |
Allow | /wp-includes/*.gif |
Allow | /wp-includes/*.ico |
Disallow | |
Disallow | /*.xls |
Disallow | /*.doc |
Disallow | /*.ppt |
Disallow | /*.txt |
googlebot
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Allow | /wp-admin/admin-ajax.php |
Disallow | /trackback/ |
Disallow | /xmlrpc.php |
Disallow | /feed/ |
Disallow | /wordpress/ |
Disallow | /wp-content/ |
Allow | /wp-content/*.css |
Allow | /wp-content/*.js |
Allow | /wp-content/*.jpg |
Allow | /wp-content/*.jpeg |
Allow | /wp-content/*.png |
Allow | /wp-content/*.svg |
Allow | /wp-content/*.gif |
Allow | /wp-content/*.ico |
Allow | /wp-content/*.woff |
Allow | /wp-content/*.woff2 |
Disallow | /wp-includes/ |
Allow | /wp-includes/*.css |
Allow | /wp-includes/*.js |
Allow | /wp-includes/*.jpg |
Allow | /wp-includes/*.jpeg |
Allow | /wp-includes/*.png |
Allow | /wp-includes/*.gif |
Allow | /wp-includes/*.ico |
Disallow | |
Disallow | /*.xls |
Disallow | /*.doc |
Disallow | /*.ppt |
Disallow | /*.txt |
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Allow | /wp-admin/admin-ajax.php |
Disallow | /trackback/ |
Disallow | /xmlrpc.php |
Disallow | /feed/ |
Disallow | /wordpress/ |
Disallow | /wp-content/ |
Allow | /wp-content/*.css |
Allow | /wp-content/*.js |
Allow | /wp-content/*.jpg |
Allow | /wp-content/*.jpeg |
Allow | /wp-content/*.png |
Allow | /wp-content/*.svg |
Allow | /wp-content/*.gif |
Allow | /wp-content/*.ico |
Allow | /wp-content/*.woff |
Allow | /wp-content/*.woff2 |
Disallow | /wp-includes/ |
Allow | /wp-includes/*.css |
Allow | /wp-includes/*.js |
Allow | /wp-includes/*.jpg |
Allow | /wp-includes/*.jpeg |
Allow | /wp-includes/*.png |
Allow | /wp-includes/*.gif |
Allow | /wp-includes/*.ico |
Disallow | |
Disallow | /*.xls |
Disallow | /*.doc |
Disallow | /*.ppt |
Disallow | /*.txt |
Other Records
Field | Value |
---|---|
sitemap | https://gett.com/sitemap_index.xml |
sitemap | https://gett.com/uk/sitemap_index.xml |
sitemap | https://gett.com/ru/sitemap_index.xml |
sitemap | https://gett.com/il/sitemap_index.xml |
Warnings
- `clean-param` is not a known field.