nestaway.com
robots.txt

Robots Exclusion Standard data for nestaway.com

Resource Scan

Scan Details

Site Domain nestaway.com
Base Domain nestaway.com
Scan Status Ok
Last Scan2024-09-24T23:09:16+00:00
Next Scan 2024-10-08T23:09:16+00:00

Last Scan

Scanned2024-09-24T23:09:16+00:00
URL https://nestaway.com/robots.txt
Redirect https://www.nestaway.com/robots.txt
Redirect Domain www.nestaway.com
Redirect Base nestaway.com
Domain IPs 3.165.82.13, 3.165.82.60, 3.165.82.70, 3.165.82.92
Redirect IPs 13.33.30.107, 13.33.30.45, 13.33.30.57, 13.33.30.90
Response IP 13.33.30.57
Found Yes
Hash 9b5b27b9ee4b845566a3b91818dda08716b9a34803cc5966dc61a156428a4a6f
SimHash 2819238d75e5

Groups

googlebot

Rule Path
Disallow /fully_furnished*
Disallow /404.html
Disallow /greater%20noida*
Disallow /users*
Disallow /profiles*
Disallow /care/*
Disallow /open_gateway*
Disallow /payments*
Disallow /api*
Disallow /moveout*
Disallow /*?auth_token=*
Disallow /internal_houses/*

googlebot-mobile

Rule Path
Disallow /fully_furnished*
Disallow /404.html
Disallow /greater%20noida*
Disallow /users*
Disallow /profiles*
Disallow /care/*
Disallow /open_gateway*
Disallow /payments*
Disallow /api*
Disallow /moveout*
Disallow /*?auth_token=*
Disallow /internal_houses/*

mediapartners-google

Rule Path
Disallow /fully_furnished*
Disallow /404.html
Disallow /greater%20noida*
Disallow /users*
Disallow /profiles*
Disallow /care/*
Disallow /open_gateway*
Disallow /payments*
Disallow /api*
Disallow /moveout*
Disallow /*?auth_token=*
Disallow /internal_houses/*

adsbot-google

Rule Path
Disallow /fully_furnished*
Disallow /404.html
Disallow /greater%20noida*
Disallow /users*
Disallow /profiles*
Disallow /care/*
Disallow /open_gateway*
Disallow /payments*
Disallow /api*
Disallow /moveout*
Disallow /*?auth_token=*
Disallow /internal_houses/*

bingbot

Rule Path
Disallow /fully_furnished*
Disallow /404.html
Disallow /greater%20noida*
Disallow /users*
Disallow /profiles*
Disallow /care/*
Disallow /open_gateway*
Disallow /payments*
Disallow /api*
Disallow /moveout*
Disallow /*?auth_token=*
Disallow /internal_houses/*

twitterbot

Rule Path
Disallow /fully_furnished*
Disallow /404.html
Disallow /greater%20noida*
Disallow /users*
Disallow /profiles*
Disallow /care/*
Disallow /open_gateway*
Disallow /payments*
Disallow /api*
Disallow /moveout*
Disallow /*?auth_token=*
Disallow /internal_houses/*

duckduckbot

Rule Path
Disallow /fully_furnished*
Disallow /404.html
Disallow /greater%20noida*
Disallow /users*
Disallow /profiles*
Disallow /care/*
Disallow /open_gateway*
Disallow /payments*
Disallow /api*
Disallow /moveout*
Disallow /*?auth_token=*
Disallow /internal_houses/*

facebot

Rule Path
Disallow /fully_furnished*
Disallow /404.html
Disallow /greater%20noida*
Disallow /users*
Disallow /profiles*
Disallow /care/*
Disallow /open_gateway*
Disallow /payments*
Disallow /api*
Disallow /moveout*
Disallow /*?auth_token=*
Disallow /internal_houses/*

applebot

Rule Path
Disallow /fully_furnished*
Disallow /404.html
Disallow /greater%20noida*
Disallow /users*
Disallow /profiles*
Disallow /care/*
Disallow /open_gateway*
Disallow /payments*
Disallow /api*
Disallow /moveout*
Disallow /*?auth_token=*
Disallow /internal_houses/*

baiduspider

Rule Path
Disallow /fully_furnished*
Disallow /404.html
Disallow /greater%20noida*
Disallow /users*
Disallow /profiles*
Disallow /care/*
Disallow /open_gateway*
Disallow /payments*
Disallow /api*
Disallow /moveout*
Disallow /*?auth_token=*
Disallow /internal_houses/*

msnbot

Rule Path
Disallow /fully_furnished*
Disallow /404.html
Disallow /greater%20noida*
Disallow /users*
Disallow /profiles*
Disallow /care/*
Disallow /open_gateway*
Disallow /payments*
Disallow /api*
Disallow /moveout*
Disallow /*?auth_token=*
Disallow /internal_houses/*

yandex

Rule Path
Disallow /fully_furnished*
Disallow /404.html
Disallow /greater%20noida*
Disallow /users*
Disallow /profiles*
Disallow /care/*
Disallow /open_gateway*
Disallow /payments*
Disallow /api*
Disallow /moveout*
Disallow /*?auth_token=*
Disallow /internal_houses/*

linkedinbot

Rule Path
Disallow /fully_furnished*
Disallow /404.html
Disallow /greater%20noida*
Disallow /users*
Disallow /profiles*
Disallow /care/*
Disallow /open_gateway*
Disallow /payments*
Disallow /api*
Disallow /moveout*
Disallow /*?auth_token=*
Disallow /internal_houses/*

slurp

Rule Path
Disallow /fully_furnished*
Disallow /404.html
Disallow /greater%20noida*
Disallow /users*
Disallow /profiles*
Disallow /care/*
Disallow /open_gateway*
Disallow /payments*
Disallow /api*
Disallow /moveout*
Disallow /*?auth_token=*
Disallow /internal_houses/*

ia_archiver

Rule Path
Disallow /fully_furnished*
Disallow /404.html
Disallow /greater%20noida*
Disallow /users*
Disallow /profiles*
Disallow /care/*
Disallow /open_gateway*
Disallow /payments*
Disallow /api*
Disallow /moveout*
Disallow /*?auth_token=*
Disallow /internal_houses/*

facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)

Rule Path
Disallow /fully_furnished*
Disallow /404.html
Disallow /greater%20noida*
Disallow /users*
Disallow /profiles*
Disallow /care/*
Disallow /open_gateway*
Disallow /payments*
Disallow /api*
Disallow /moveout*
Disallow /*?auth_token=*
Disallow /internal_houses/*

facebookexternalhit/1.1

Rule Path
Disallow /fully_furnished*
Disallow /404.html
Disallow /greater%20noida*
Disallow /users*
Disallow /profiles*
Disallow /care/*
Disallow /open_gateway*
Disallow /payments*
Disallow /api*
Disallow /moveout*
Disallow /*?auth_token=*
Disallow /internal_houses/*

facebookexternalhit

Rule Path
Disallow /fully_furnished*
Disallow /404.html
Disallow /greater%20noida*
Disallow /users*
Disallow /profiles*
Disallow /care/*
Disallow /open_gateway*
Disallow /payments*
Disallow /api*
Disallow /moveout*
Disallow /*?auth_token=*
Disallow /internal_houses/*

semrushbot

Rule Path
Disallow /fully_furnished*
Disallow /404.html
Disallow /greater%20noida*
Disallow /users*
Disallow /profiles*
Disallow /care/*
Disallow /open_gateway*
Disallow /payments*
Disallow /api*
Disallow /moveout*
Disallow /*?auth_token=*
Disallow /internal_houses/*

semrushbot-sa

Rule Path
Disallow /fully_furnished*
Disallow /404.html
Disallow /greater%20noida*
Disallow /users*
Disallow /profiles*
Disallow /care/*
Disallow /open_gateway*
Disallow /payments*
Disallow /api*
Disallow /moveout*
Disallow /*?auth_token=*
Disallow /internal_houses/*
Disallow /welcome
Disallow /chennai
Disallow /owner
Disallow /400/*
Disallow /404/*
Disallow /422/*
Disallow /_flash_app/*
Disallow /search_new*

Other Records

Field Value
sitemap https://www.nestaway.com/sitemap_index.xml

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file