nestaway.com
robots.txt
Robots Exclusion Standard data for nestaway.com
Resource Scan
Scan Details
Site Domain | nestaway.com |
Base Domain | nestaway.com |
Scan Status | Ok |
Last Scan | 2024-09-24T23:09:16+00:00 |
Next Scan | 2024-10-08T23:09:16+00:00 |
Last Scan
Scanned | 2024-09-24T23:09:16+00:00 |
URL | https://nestaway.com/robots.txt |
Redirect | https://www.nestaway.com/robots.txt |
Redirect Domain | www.nestaway.com |
Redirect Base | nestaway.com |
Domain IPs | 3.165.82.13, 3.165.82.60, 3.165.82.70, 3.165.82.92 |
Redirect IPs | 13.33.30.107, 13.33.30.45, 13.33.30.57, 13.33.30.90 |
Response IP | 13.33.30.57 |
Found | Yes |
Hash | 9b5b27b9ee4b845566a3b91818dda08716b9a34803cc5966dc61a156428a4a6f |
SimHash | 2819238d75e5 |
Groups
googlebot
Rule | Path |
---|---|
Disallow | /fully_furnished* |
Disallow | /404.html |
Disallow | /greater%20noida* |
Disallow | /users* |
Disallow | /profiles* |
Disallow | /care/* |
Disallow | /open_gateway* |
Disallow | /payments* |
Disallow | /api* |
Disallow | /moveout* |
Disallow | /*?auth_token=* |
Disallow | /internal_houses/* |
googlebot-mobile
Rule | Path |
---|---|
Disallow | /fully_furnished* |
Disallow | /404.html |
Disallow | /greater%20noida* |
Disallow | /users* |
Disallow | /profiles* |
Disallow | /care/* |
Disallow | /open_gateway* |
Disallow | /payments* |
Disallow | /api* |
Disallow | /moveout* |
Disallow | /*?auth_token=* |
Disallow | /internal_houses/* |
mediapartners-google
Rule | Path |
---|---|
Disallow | /fully_furnished* |
Disallow | /404.html |
Disallow | /greater%20noida* |
Disallow | /users* |
Disallow | /profiles* |
Disallow | /care/* |
Disallow | /open_gateway* |
Disallow | /payments* |
Disallow | /api* |
Disallow | /moveout* |
Disallow | /*?auth_token=* |
Disallow | /internal_houses/* |
adsbot-google
Rule | Path |
---|---|
Disallow | /fully_furnished* |
Disallow | /404.html |
Disallow | /greater%20noida* |
Disallow | /users* |
Disallow | /profiles* |
Disallow | /care/* |
Disallow | /open_gateway* |
Disallow | /payments* |
Disallow | /api* |
Disallow | /moveout* |
Disallow | /*?auth_token=* |
Disallow | /internal_houses/* |
bingbot
Rule | Path |
---|---|
Disallow | /fully_furnished* |
Disallow | /404.html |
Disallow | /greater%20noida* |
Disallow | /users* |
Disallow | /profiles* |
Disallow | /care/* |
Disallow | /open_gateway* |
Disallow | /payments* |
Disallow | /api* |
Disallow | /moveout* |
Disallow | /*?auth_token=* |
Disallow | /internal_houses/* |
twitterbot
Rule | Path |
---|---|
Disallow | /fully_furnished* |
Disallow | /404.html |
Disallow | /greater%20noida* |
Disallow | /users* |
Disallow | /profiles* |
Disallow | /care/* |
Disallow | /open_gateway* |
Disallow | /payments* |
Disallow | /api* |
Disallow | /moveout* |
Disallow | /*?auth_token=* |
Disallow | /internal_houses/* |
duckduckbot
Rule | Path |
---|---|
Disallow | /fully_furnished* |
Disallow | /404.html |
Disallow | /greater%20noida* |
Disallow | /users* |
Disallow | /profiles* |
Disallow | /care/* |
Disallow | /open_gateway* |
Disallow | /payments* |
Disallow | /api* |
Disallow | /moveout* |
Disallow | /*?auth_token=* |
Disallow | /internal_houses/* |
facebot
Rule | Path |
---|---|
Disallow | /fully_furnished* |
Disallow | /404.html |
Disallow | /greater%20noida* |
Disallow | /users* |
Disallow | /profiles* |
Disallow | /care/* |
Disallow | /open_gateway* |
Disallow | /payments* |
Disallow | /api* |
Disallow | /moveout* |
Disallow | /*?auth_token=* |
Disallow | /internal_houses/* |
applebot
Rule | Path |
---|---|
Disallow | /fully_furnished* |
Disallow | /404.html |
Disallow | /greater%20noida* |
Disallow | /users* |
Disallow | /profiles* |
Disallow | /care/* |
Disallow | /open_gateway* |
Disallow | /payments* |
Disallow | /api* |
Disallow | /moveout* |
Disallow | /*?auth_token=* |
Disallow | /internal_houses/* |
baiduspider
Rule | Path |
---|---|
Disallow | /fully_furnished* |
Disallow | /404.html |
Disallow | /greater%20noida* |
Disallow | /users* |
Disallow | /profiles* |
Disallow | /care/* |
Disallow | /open_gateway* |
Disallow | /payments* |
Disallow | /api* |
Disallow | /moveout* |
Disallow | /*?auth_token=* |
Disallow | /internal_houses/* |
msnbot
Rule | Path |
---|---|
Disallow | /fully_furnished* |
Disallow | /404.html |
Disallow | /greater%20noida* |
Disallow | /users* |
Disallow | /profiles* |
Disallow | /care/* |
Disallow | /open_gateway* |
Disallow | /payments* |
Disallow | /api* |
Disallow | /moveout* |
Disallow | /*?auth_token=* |
Disallow | /internal_houses/* |
yandex
Rule | Path |
---|---|
Disallow | /fully_furnished* |
Disallow | /404.html |
Disallow | /greater%20noida* |
Disallow | /users* |
Disallow | /profiles* |
Disallow | /care/* |
Disallow | /open_gateway* |
Disallow | /payments* |
Disallow | /api* |
Disallow | /moveout* |
Disallow | /*?auth_token=* |
Disallow | /internal_houses/* |
linkedinbot
Rule | Path |
---|---|
Disallow | /fully_furnished* |
Disallow | /404.html |
Disallow | /greater%20noida* |
Disallow | /users* |
Disallow | /profiles* |
Disallow | /care/* |
Disallow | /open_gateway* |
Disallow | /payments* |
Disallow | /api* |
Disallow | /moveout* |
Disallow | /*?auth_token=* |
Disallow | /internal_houses/* |
slurp
Rule | Path |
---|---|
Disallow | /fully_furnished* |
Disallow | /404.html |
Disallow | /greater%20noida* |
Disallow | /users* |
Disallow | /profiles* |
Disallow | /care/* |
Disallow | /open_gateway* |
Disallow | /payments* |
Disallow | /api* |
Disallow | /moveout* |
Disallow | /*?auth_token=* |
Disallow | /internal_houses/* |
ia_archiver
Rule | Path |
---|---|
Disallow | /fully_furnished* |
Disallow | /404.html |
Disallow | /greater%20noida* |
Disallow | /users* |
Disallow | /profiles* |
Disallow | /care/* |
Disallow | /open_gateway* |
Disallow | /payments* |
Disallow | /api* |
Disallow | /moveout* |
Disallow | /*?auth_token=* |
Disallow | /internal_houses/* |
facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
Rule | Path |
---|---|
Disallow | /fully_furnished* |
Disallow | /404.html |
Disallow | /greater%20noida* |
Disallow | /users* |
Disallow | /profiles* |
Disallow | /care/* |
Disallow | /open_gateway* |
Disallow | /payments* |
Disallow | /api* |
Disallow | /moveout* |
Disallow | /*?auth_token=* |
Disallow | /internal_houses/* |
facebookexternalhit/1.1
Rule | Path |
---|---|
Disallow | /fully_furnished* |
Disallow | /404.html |
Disallow | /greater%20noida* |
Disallow | /users* |
Disallow | /profiles* |
Disallow | /care/* |
Disallow | /open_gateway* |
Disallow | /payments* |
Disallow | /api* |
Disallow | /moveout* |
Disallow | /*?auth_token=* |
Disallow | /internal_houses/* |
facebookexternalhit
Rule | Path |
---|---|
Disallow | /fully_furnished* |
Disallow | /404.html |
Disallow | /greater%20noida* |
Disallow | /users* |
Disallow | /profiles* |
Disallow | /care/* |
Disallow | /open_gateway* |
Disallow | /payments* |
Disallow | /api* |
Disallow | /moveout* |
Disallow | /*?auth_token=* |
Disallow | /internal_houses/* |
semrushbot
Rule | Path |
---|---|
Disallow | /fully_furnished* |
Disallow | /404.html |
Disallow | /greater%20noida* |
Disallow | /users* |
Disallow | /profiles* |
Disallow | /care/* |
Disallow | /open_gateway* |
Disallow | /payments* |
Disallow | /api* |
Disallow | /moveout* |
Disallow | /*?auth_token=* |
Disallow | /internal_houses/* |
semrushbot-sa
Rule | Path |
---|---|
Disallow | /fully_furnished* |
Disallow | /404.html |
Disallow | /greater%20noida* |
Disallow | /users* |
Disallow | /profiles* |
Disallow | /care/* |
Disallow | /open_gateway* |
Disallow | /payments* |
Disallow | /api* |
Disallow | /moveout* |
Disallow | /*?auth_token=* |
Disallow | /internal_houses/* |
Disallow | /welcome |
Disallow | /chennai |
Disallow | /owner |
Disallow | /400/* |
Disallow | /404/* |
Disallow | /422/* |
Disallow | /_flash_app/* |
Disallow | /search_new* |
Other Records
Field | Value |
---|---|
sitemap | https://www.nestaway.com/sitemap_index.xml |
Comments