withlocals.com
robots.txt
Robots Exclusion Standard data for withlocals.com
Resource Scan
Scan Details
| Site Domain | withlocals.com |
| Base Domain | withlocals.com |
| Scan Status | Ok |
| Last Scan | 2024-06-02T05:10:53+00:00 |
| Next Scan | 2024-06-16T05:10:53+00:00 |
Last Scan
| Scanned | 2024-06-02T05:10:53+00:00 |
| URL | https://withlocals.com/robots.txt |
| Redirect | https://www.withlocals.com/robots.txt |
| Redirect Domain | www.withlocals.com |
| Redirect Base | withlocals.com |
| Domain IPs | 104.26.6.91, 104.26.7.91, 172.67.69.42, 2606:4700:20::681a:65b, 2606:4700:20::681a:75b, 2606:4700:20::ac43:452a |
| Redirect IPs | 104.26.6.91, 104.26.7.91, 172.67.69.42, 2606:4700:20::681a:65b, 2606:4700:20::681a:75b, 2606:4700:20::ac43:452a |
| Response IP | 104.26.6.91 |
| Found | Yes |
| Hash | 57ae5babb7f17e6f3d4f1af60719e8bae8a335c6537153ee58d3be4008058ff9 |
| SimHash | 6d3580b40b99 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /dashboard/ |
| Disallow | /offers/ |
| Disallow | /booking/ |
| Disallow | /filter/location |
| Disallow | /filter/date |
| Disallow | /filter/guests |
| Disallow | /filter/languages |
| Disallow | /filter/more |
| Disallow | /how-it-works-modal |
| Disallow | /host-agenda |
| Disallow | /family-friendly-modal |
| Disallow | /login-or-signup |
| Disallow | /experience/*/contact/* |
| Disallow | /experience/*/filters/guests |
| Disallow | /experience/*/filters/date-time |
| Disallow | /experience/*/instantly-confirmed |
| Disallow | /experience/*/family-friendly |
| Disallow | /experience/*/locals |
| Disallow | /*/admin/ |
| Disallow | /*/dashboard/ |
| Disallow | /*/offers/ |
| Disallow | /*/booking/ |
| Disallow | /*/filter/location |
| Disallow | /*/filter/date |
| Disallow | /*/filter/guests |
| Disallow | /*/filter/languages |
| Disallow | /*/filter/more |
| Disallow | /*/how-it-works-modal |
| Disallow | /*/host-agenda |
| Disallow | /*/family-friendly-modal |
| Disallow | /*/login-or-signup |
| Disallow | /*/experience/*/contact/* |
| Disallow | /*/experience/*/filters/guests |
| Disallow | /*/experience/*/filters/date-time |
| Disallow | /*/experience/*/instantly-confirmed |
| Disallow | /*/experience/*/family-friendly |
| Disallow | /*/experience/*/locals |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.withlocals.com/sitemap.xml |