movoto.com
robots.txt
Robots Exclusion Standard data for movoto.com
Resource Scan
Scan Details
| Site Domain | movoto.com |
| Base Domain | movoto.com |
| Scan Status | Ok |
| Last Scan | 2024-11-13T02:22:12+00:00 |
| Next Scan | 2024-11-20T02:22:12+00:00 |
Last Scan
| Scanned | 2024-11-13T02:22:12+00:00 |
| URL | https://movoto.com/robots.txt |
| Redirect | https://www.movoto.com/robots.txt |
| Redirect Domain | www.movoto.com |
| Redirect Base | movoto.com |
| Domain IPs | 108.156.133.112, 108.156.133.117, 108.156.133.121, 108.156.133.57 |
| Redirect IPs | 108.156.133.112, 108.156.133.117, 108.156.133.121, 108.156.133.57 |
| Response IP | 108.156.133.57 |
| Found | Yes |
| Hash | 5ba562f8beb335a53bdc72840d7289f73e71a2b73a7a8bde0e17981c66c810e1 |
| SimHash | 49affbf8c022 |
Groups
adsbot-google
adsbot-google-mobile
slurp
twitterbot
| Rule | Path |
|---|---|
| Disallow | /images/ |
| Disallow | /ac/ |
| Disallow | /tools/ |
| Disallow | /widget/ |
| Disallow | /my-movoto/ |
| Disallow | /unsubscribe/ |
| Disallow | /?showjoin |
| Disallow | /?showlogin |
| Disallow | /*/wp-content/plugins/ |
| Disallow | /*/wp-admin/ |
| Disallow | /*/wp-includes/ |
| Disallow | /wp-content/plugins/ |
| Disallow | /wp-admin/ |
| Disallow | /wp-includes/ |
| Disallow | /foundation/?s |
| Disallow | /blog/?s |
| Disallow | /press/?s |
| Disallow | /webservices/ |
| Disallow | /insurance/?zip |
| Disallow | /street- |
| Disallow | /for-sale/street- |
| Disallow | /api/ |
| Disallow | /about/bonus |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
trovitbot
exabot
sougou+web+spider
sosospider
baiduspider
yandexbot
aboundexbot
ccbot
storygizebot
clickagy+intelligence+bot
calculon+spider
getintent+crawler
maxpointcrawler
cliqzbot
storygizebot
leikibot
applebot
| Rule | Path |
|---|---|
| Disallow | / |
netseer+crawler
| Rule | Path |
|---|---|
| Disallow | / |
| Allow | /blog/ |
| Allow | /guide/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
*
| Rule | Path |
|---|---|
| Disallow | /gotoseehome/ |
| Disallow | /images/ |
| Disallow | /ac/ |
| Disallow | /tools/ |
| Disallow | /widget/ |
| Allow | /widget/api/ |
| Disallow | /my-movoto/ |
| Disallow | /unsubscribe/ |
| Disallow | /?showjoin |
| Disallow | /?showlogin |
| Disallow | /*/wp-content/plugins/ |
| Disallow | /*/wp-admin/ |
| Disallow | /*/wp-includes/ |
| Disallow | /wp-content/plugins/ |
| Disallow | /blog/wp-content/uploads/ |
| Disallow | /wp-admin/ |
| Disallow | /wp-includes/ |
| Disallow | /foundation/?s |
| Disallow | /blog/?s |
| Disallow | /press/?s |
| Disallow | /webservices/ |
| Disallow | /api/ |
| Allow | /api/dosearch/ |
| Disallow | /Pb7SA58F/xhr/api/v1/collector |
| Disallow | /insurance/?zip |
| Disallow | /for-sale/street- |
| Disallow | /agents/*/write-review/? |
| Disallow | /*/partialview/poilist.ejs |
| Disallow | /mortgages/?lt= |
| Disallow | /mortgages/*/?lt= |
| Disallow | /street- |
| Disallow | /address- |
| Disallow | /commute- |
| Allow | /street-md/ |
| Disallow | /*/school-1u- |
| Disallow | /*/school-2u- |
| Disallow | /*/school-3u- |
| Disallow | /*/school-4u- |
| Disallow | /*/school-5u- |
| Disallow | /*/school-6u- |
| Disallow | /*/school-7u- |
| Disallow | /*/school-8u- |
| Disallow | /*/school-9u- |
| Disallow | /*/school-10u- |
| Disallow | /*/saz-/ |
| Disallow | /*/garage- |
| Disallow | /*/sqft- |
| Disallow | /*/built- |
| Disallow | /*/dom- |
| Disallow | /*/sold- |
| Disallow | /*/listedbymovoto/ |
| Disallow | /*/selftour/ |
| Disallow | /*/kw-fixerupper%2Cphotos |
| Disallow | /lexchatbot/ |
| Disallow | /sendhotlead/ |
| Disallow | /*simple%3Dprice |
| Disallow | /homes/ |
| Disallow | /redirect/app |
| Allow | /*/p-2/$ |
| Allow | /*/p-3/$ |
| Allow | /*/p-4/$ |
| Allow | /*/p-5/$ |
| Allow | /schools/*/p-*/$ |
| Allow | /*/school-district/p-*/$ |
| Allow | /sitemap/*/p-*/$ |
| Allow | /guide/p-*/$ |
| Allow | /guide/*/p-*/$ |
| Disallow | /*/p-*/$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.movoto.com/ssl/sitemap.xml |
| sitemap | https://www.movoto.com/ssl/new-activehouses/new-sitemap.xml |
| sitemap | https://www.movoto.com/ssl/sitemap.xml |
| sitemap | https://www.movoto.com/ssl/new-activehouses/new-sitemap.xml |
Warnings
- 1 invalid line.