withlocals.com
robots.txt
Robots Exclusion Standard data for withlocals.com
Resource Scan
Scan Details
Site Domain | withlocals.com |
Base Domain | withlocals.com |
Scan Status | Ok |
Last Scan | 2024-09-22T05:16:14+00:00 |
Next Scan | 2024-10-06T05:16:14+00:00 |
Last Scan
Scanned | 2024-09-22T05:16:14+00:00 |
URL | https://withlocals.com/robots.txt |
Redirect | https://www.withlocals.com/robots.txt |
Redirect Domain | www.withlocals.com |
Redirect Base | withlocals.com |
Domain IPs | 104.26.6.91, 104.26.7.91, 172.67.69.42, 2606:4700:20::681a:65b, 2606:4700:20::681a:75b, 2606:4700:20::ac43:452a |
Redirect IPs | 104.26.6.91, 104.26.7.91, 172.67.69.42, 2606:4700:20::681a:65b, 2606:4700:20::681a:75b, 2606:4700:20::ac43:452a |
Response IP | 104.26.6.91 |
Found | Yes |
Hash | f14ef3961038fc0566bc9e9184b10691f37dbf6cc1747c1d0db22700c4c1e2bb |
SimHash | 6d3580f00399 |
Groups
*
Rule | Path |
---|---|
Allow | /locals/* |
Disallow | /admin/ |
Disallow | /dashboard/ |
Disallow | /offers/ |
Disallow | /booking/ |
Disallow | /filter/date |
Disallow | /filter/guests |
Disallow | /filter/languages |
Disallow | /filter/more |
Disallow | /how-it-works-modal |
Disallow | /host-agenda |
Disallow | /family-friendly-modal |
Disallow | /login-or-signup |
Disallow | /experience/*/contact/* |
Disallow | /experience/*/filters/guests |
Disallow | /experience/*/filters/date-time |
Disallow | /experience/*/instantly-confirmed |
Disallow | /experience/*/family-friendly |
Disallow | /experience/*/locals |
Disallow | /*/admin/ |
Disallow | /*/dashboard/ |
Disallow | /*/offers/ |
Disallow | /*/booking/ |
Disallow | /*/filter/date |
Disallow | /*/filter/guests |
Disallow | /*/filter/languages |
Disallow | /*/filter/more |
Disallow | /*/how-it-works-modal |
Disallow | /*/host-agenda |
Disallow | /*/family-friendly-modal |
Disallow | /*/login-or-signup |
Disallow | /*/experience/*/contact/* |
Disallow | /*/experience/*/filters/guests |
Disallow | /*/experience/*/filters/date-time |
Disallow | /*/experience/*/instantly-confirmed |
Disallow | /*/experience/*/family-friendly |
Disallow | /*/experience/*/locals |
Disallow | /schedule |
Disallow | /locals |
Other Records
Field | Value |
---|---|
sitemap | https://www.withlocals.com/sitemap.xml |