urbanpro.com
robots.txt
Robots Exclusion Standard data for urbanpro.com
Resource Scan
Scan Details
Site Domain | urbanpro.com |
Base Domain | urbanpro.com |
Scan Status | Ok |
Last Scan | 2024-11-04T04:12:24+00:00 |
Next Scan | 2024-11-18T04:12:24+00:00 |
Last Scan
Scanned | 2024-11-04T04:12:24+00:00 |
URL | https://urbanpro.com/robots.txt |
Redirect | https://www.urbanpro.com/robots.txt |
Redirect Domain | www.urbanpro.com |
Redirect Base | urbanpro.com |
Domain IPs | 4.240.82.80 |
Redirect IPs | 4.240.82.80 |
Response IP | 4.240.82.80 |
Found | Yes |
Hash | 99ecddbdf6cb699166715aee9466766a332f5d05f4e5bd894c6bbef540554d9c |
SimHash | a95eca40e619 |
Groups
*
Rule | Path |
---|---|
Disallow | /register/enrollViaFacebook |
Disallow | /providerRecommendation/loginThroughFaceBook |
Disallow | /register/connectWithFacebook |
Disallow | /topic/needTopicAJAX |
Disallow | /locality/ajaxForLocalityAndPincode |
Disallow | /topic/searchAJAX |
Disallow | /locality/searchAJAX |
Disallow | /activityAlert/subscribe |
Disallow | /member/loginRequested |
Disallow | /provider/showBranchBehindLogin |
Disallow | /locality/ajaxForLocalityPincodeAndCity |
Disallow | /newRegister/enrollMember |
Disallow | /city/searchAJAX |
Other Records
Field | Value |
---|---|
sitemap | https://www.urbanpro.com/sitemap.xml |