grabr.io
robots.txt
Robots Exclusion Standard data for grabr.io
Resource Scan
Scan Details
| Site Domain | grabr.io |
| Base Domain | grabr.io |
| Scan Status | Ok |
| Last Scan | 2024-06-04T17:10:06+00:00 |
| Next Scan | 2024-06-18T17:10:06+00:00 |
Last Scan
| Scanned | 2024-06-04T17:10:06+00:00 |
| URL | https://grabr.io/robots.txt |
| Domain IPs | 104.26.0.72, 104.26.1.72, 172.67.70.118, 2606:4700:20::681a:148, 2606:4700:20::681a:48, 2606:4700:20::ac43:4676 |
| Response IP | 104.26.0.72 |
| Found | Yes |
| Hash | 01afd3eae8b43e356e749d4b259d48f42287ba8eb7704f572e2214ad48091f4f |
| SimHash | a849522f8aba |
Groups
twitterbot
| Rule | Path |
|---|---|
| Disallow | /users/ |
| Disallow | /en/users/ |
| Disallow | /ru/users/ |
| Disallow | /es/users/ |
| Disallow | /pt/users/ |
*
| Rule | Path |
|---|---|
| Disallow | /users/ |
| Disallow | /grabs/ |
| Disallow | /trips/ |
| Disallow | /en/order |
| Disallow | /en/account |
| Disallow | /en/grabs |
| Disallow | /en/login |
| Disallow | /en/travel |
| Disallow | /en/signup |
| Disallow | /en/unsubscribe |
| Disallow | /en/zendesk |
| Disallow | /en/trips |
| Disallow | /en/users/ |
| Disallow | /es/order |
| Disallow | /es/account |
| Disallow | /es/grabs |
| Disallow | /es/login |
| Disallow | /es/travel |
| Disallow | /es/signup |
| Disallow | /es/unsubscribe |
| Disallow | /es/zendesk |
| Disallow | /es/trips |
| Disallow | /es/users/ |
| Disallow | /pt/order |
| Disallow | /pt/account |
| Disallow | /pt/grabs |
| Disallow | /pt/login |
| Disallow | /pt/travel |
| Disallow | /pt/signup |
| Disallow | /pt/unsubscribe |
| Disallow | /pt/zendesk |
| Disallow | /pt/trips |
| Disallow | /pt/users/ |
| Disallow | /ru/order |
| Disallow | /ru/account |
| Disallow | /ru/grabs |
| Disallow | /ru/login |
| Disallow | /ru/travel |
| Disallow | /ru/signup |
| Disallow | /ru/unsubscribe |
| Disallow | /ru/zendesk |
| Disallow | /ru/trips |
| Disallow | /ru/users/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://grabr.io/sitemap.xml |