hindutamil.in
robots.txt
Robots Exclusion Standard data for hindutamil.in
Resource Scan
Scan Details
Site Domain | hindutamil.in |
Base Domain | hindutamil.in |
Scan Status | Ok |
Last Scan | 2024-05-19T22:37:28+00:00 |
Next Scan | 2024-05-26T22:37:28+00:00 |
Last Scan
Scanned | 2024-05-19T22:37:28+00:00 |
URL | https://hindutamil.in/robots.txt |
Redirect | https://www.hindutamil.in/robots.txt |
Redirect Domain | www.hindutamil.in |
Redirect Base | hindutamil.in |
Domain IPs | 52.172.189.212 |
Redirect IPs | 52.172.189.212 |
Response IP | 52.172.189.212 |
Found | Yes |
Hash | b5af08327571494f3b06ddda818109259c6cb26e6d61c6098bd7b13ab9241b70 |
SimHash | a9154894e392 |
Groups
*
Rule | Path |
---|---|
Disallow | /ajax/ |
Disallow | /user/ |
Disallow | /auth/ |
Disallow | /admin/ |
Disallow | /cron/ |
Disallow | /subscriptions/ |
Disallow | /comments/ |
Disallow | /api/ |
Disallow | /pwa/ |
Disallow | /templates/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.hindutamil.in/feed/sitemap.xml |
sitemap | https://www.hindutamil.in/sitemap.xml |