wa-hindu-tamilthisai.azurewebsites.net
robots.txt
Robots Exclusion Standard data for wa-hindu-tamilthisai.azurewebsites.net
Resource Scan
Scan Details
Site Domain | wa-hindu-tamilthisai.azurewebsites.net |
Base Domain | wa-hindu-tamilthisai.azurewebsites.net |
Scan Status | Ok |
Last Scan | 2024-05-24T20:56:15+00:00 |
Next Scan | 2024-05-31T20:56:15+00:00 |
Last Scan
Scanned | 2024-05-24T20:56:15+00:00 |
URL | https://wa-hindu-tamilthisai.azurewebsites.net/robots.txt |
Domain IPs | 104.211.179.11 |
Response IP | 104.211.179.11 |
Found | Yes |
Hash | b5af08327571494f3b06ddda818109259c6cb26e6d61c6098bd7b13ab9241b70 |
SimHash | a9154894e392 |
Groups
*
Rule | Path |
---|---|
Disallow | /ajax/ |
Disallow | /user/ |
Disallow | /auth/ |
Disallow | /admin/ |
Disallow | /cron/ |
Disallow | /subscriptions/ |
Disallow | /comments/ |
Disallow | /api/ |
Disallow | /pwa/ |
Disallow | /templates/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.hindutamil.in/feed/sitemap.xml |
sitemap | https://www.hindutamil.in/sitemap.xml |