roofandfloor.thehindu.com
robots.txt
Robots Exclusion Standard data for roofandfloor.thehindu.com
Resource Scan
Scan Details
Site Domain | roofandfloor.thehindu.com |
Base Domain | thehindu.com |
Scan Status | Ok |
Last Scan | 2024-05-15T09:55:18+00:00 |
Next Scan | 2024-06-14T09:55:18+00:00 |
Last Scan
Scanned | 2024-05-15T09:55:18+00:00 |
URL | https://roofandfloor.thehindu.com/robots.txt |
Domain IPs | 13.228.143.96, 52.220.150.188 |
Response IP | 52.220.150.188 |
Found | Yes |
Hash | 4c06fec44dc40cf335d2e2ef5d84f5d08ed7eb6ab8e2277628c630e929bf770d |
SimHash | 0a55c7a045b1 |
Groups
*
Rule | Path |
---|---|
Disallow | /api/ |
Disallow | /v1/ |
Disallow | /v2/ |
Disallow | /geoip/ |
Disallow | /null |
Disallow | /gihs |
Disallow | /mynest |
Disallow | /test |
Disallow | /Megapropertyshow |
Disallow | /megapropertyshow |
Disallow | /obj |
Disallow | /payments |
Disallow | /process.php |
Disallow | /sclite |
Disallow | /mclite |
Disallow | /?s= |
Disallow | /virtualfair |
Disallow | /lead-purchase |
Disallow | /undefined |
Disallow | /usersprofile |
Disallow | /collections |
Disallow | /trueview |
Disallow | /trueprice |
Disallow | /trueassist |
Disallow | /viewfound |
Disallow | /searchwidget |
Disallow | *?p= |
Disallow | *?bot=true |
Disallow | *?_ |
Disallow | /microsite/ |
Disallow | /raf/raf/real-estate-blog/wp-login.php |
Other Records
Field | Value |
---|---|
sitemap | https://roofandfloor.thehindu.com/sitemap.xml |
sitemap | https://roofandfloor.thehindu.com/search.xml |