movoto.com
robots.txt
Robots Exclusion Standard data for movoto.com
Resource Scan
Scan Details
Site Domain | movoto.com |
Base Domain | movoto.com |
Scan Status | Ok |
Last Scan | 2024-05-14T17:00:27+00:00 |
Next Scan | 2024-05-21T17:00:27+00:00 |
Last Scan
Scanned | 2024-05-14T17:00:27+00:00 |
URL | https://movoto.com/robots.txt |
Redirect | https://www.movoto.com/robots.txt |
Redirect Domain | www.movoto.com |
Redirect Base | movoto.com |
Domain IPs | 52.25.241.140 |
Redirect IPs | 52.25.241.140 |
Response IP | 52.25.241.140 |
Found | Yes |
Hash | 08c5def18a29efe44cc0b123cebdff6685d296e16435e92a19a8e7f7b9a32f1d |
SimHash | 592efbfac022 |
Groups
adsbot-google
adsbot-google-mobile
slurp
twitterbot
Rule | Path |
---|---|
Disallow | /images/ |
Disallow | /ac/ |
Disallow | /tools/ |
Disallow | /widget/ |
Disallow | /my-movoto/ |
Disallow | /unsubscribe/ |
Disallow | /?showjoin |
Disallow | /?showlogin |
Disallow | /*/wp-content/plugins/ |
Disallow | /*/wp-admin/ |
Disallow | /*/wp-includes/ |
Disallow | /wp-content/plugins/ |
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Disallow | /foundation/?s |
Disallow | /blog/?s |
Disallow | /press/?s |
Disallow | /webservices/ |
Disallow | /insurance/?zip |
Disallow | /street- |
Disallow | /for-sale/street- |
Disallow | /api/ |
Disallow | /about/bonus |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
trovitbot
exabot
sougou+web+spider
sosospider
baiduspider
yandexbot
aboundexbot
ccbot
storygizebot
clickagy+intelligence+bot
calculon+spider
getintent+crawler
maxpointcrawler
cliqzbot
storygizebot
leikibot
applebot
Rule | Path |
---|---|
Disallow | / |
netseer+crawler
Rule | Path |
---|---|
Disallow | / |
Allow | /blog/ |
Allow | /guide/ |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
*
Rule | Path |
---|---|
Disallow | /gotoseehome/ |
Disallow | /images/ |
Disallow | /ac/ |
Disallow | /tools/ |
Disallow | /widget/ |
Disallow | /my-movoto/ |
Disallow | /unsubscribe/ |
Disallow | /?showjoin |
Disallow | /?showlogin |
Disallow | /*/wp-content/plugins/ |
Disallow | /*/wp-admin/ |
Disallow | /*/wp-includes/ |
Disallow | /wp-content/plugins/ |
Disallow | /blog/wp-content/uploads/ |
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Disallow | /foundation/?s |
Disallow | /blog/?s |
Disallow | /press/?s |
Disallow | /webservices/ |
Disallow | /api/ |
Allow | /api/dosearch/ |
Disallow | /Pb7SA58F/xhr/api/v1/collector |
Disallow | /insurance/?zip |
Disallow | /for-sale/street- |
Disallow | /agents/*/write-review/? |
Disallow | /*/partialview/poilist.ejs |
Disallow | /mortgages/?lt= |
Disallow | /mortgages/*/?lt= |
Disallow | /street- |
Disallow | /address- |
Disallow | /commute- |
Allow | /street-md/ |
Disallow | /*/school-1u- |
Disallow | /*/school-2u- |
Disallow | /*/school-3u- |
Disallow | /*/school-4u- |
Disallow | /*/school-5u- |
Disallow | /*/school-6u- |
Disallow | /*/school-7u- |
Disallow | /*/school-8u- |
Disallow | /*/school-9u- |
Disallow | /*/school-10u- |
Disallow | /*/saz-/ |
Disallow | /*/type- |
Disallow | /*/status- |
Disallow | /*/hoa- |
Disallow | /*/garage- |
Disallow | /*/sqft- |
Disallow | /*/built- |
Disallow | /*/dom- |
Disallow | /*/sold- |
Disallow | /*/listedbymovoto/ |
Disallow | /*/selftour/ |
Disallow | /*/kw-fixerupper%2Cphotos |
Disallow | /lexchatbot/ |
Disallow | /sendhotlead/ |
Disallow | /*simple%3Dprice |
Disallow | /*/att-*%2C |
Disallow | /homes/ |
Disallow | /redirect/app |
Other Records
Field | Value |
---|---|
sitemap | https://www.movoto.com/ssl/sitemap.xml |
sitemap | https://www.movoto.com/ssl/new-activehouses/new-sitemap.xml |
sitemap | https://www.movoto.com/ssl/sitemap.xml |
sitemap | https://www.movoto.com/ssl/new-activehouses/new-sitemap.xml |
Warnings
- 1 invalid line.