mcxindia.com
robots.txt
Robots Exclusion Standard data for mcxindia.com
Resource Scan
Scan Details
Site Domain | mcxindia.com |
Base Domain | mcxindia.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-25T04:48:12+00:00 |
Next Scan | 2024-10-09T04:48:12+00:00 |
Last Successful Scan
Scanned | 2024-08-18T03:38:49+00:00 |
URL | https://mcxindia.com/robots.txt |
Redirect | https://www.mcxindia.com/robots.txt |
Redirect Domain | www.mcxindia.com |
Redirect Base | mcxindia.com |
Domain IPs | 23.215.7.18, 23.215.7.32, 2600:1413:b000:1b::17d7:712, 2600:1413:b000:1b::17d7:720 |
Redirect IPs | 125.56.219.3, 23.32.29.104 |
Response IP | 23.52.40.153 |
Found | Yes |
Hash | a6a17b8222cd9ba54860d3229e3cd83dfc04212641d3a8706573eab86729787c |
SimHash | 4d6c21bc17c1 |
Groups
googlebot
Rule | Path |
---|---|
Allow | * |
Disallow | /api/ |
Disallow | /Sitefinity/ |
Disallow | /Bloomberg/ |
Disallow | /ErrorLog/ |
Disallow | /Includes/ |
Disallow | /App_Data/ |
Disallow | /App_Master/ |
Disallow | /AppCode/ |
Disallow | /BackendRequestHandler/ |
Disallow | /BackendUserControls/ |
Disallow | /ExternalDataUserControls/ |
Disallow | /ResourcePackages/ |
Disallow | /Templates/ |
Disallow | /Tools/ |
Disallow | /UserControls/ |
Disallow | /WSPUserControls/ |
Disallow | /backpage.aspx |
Disallow | /BackPage_charting.aspx |
Disallow | /MobileBackpage.aspx |
Disallow | /login/ |
Disallow | /registration/ |
Disallow | /mymcx/ |
Disallow | /docs/ |
Disallow | /terms-and-conditions-of-usage-for-website$ |
Disallow | /sitemap$ |
Disallow | /tools$ |
Disallow | /hyperlinking-policy$ |
Disallow | /copyright$ |
Disallow | /media/ |
Disallow | /hi/* |
Disallow | /mr/* |
Disallow | /search* |
*
Rule | Path |
---|---|
Disallow | / |