femina.in
robots.txt
Robots Exclusion Standard data for femina.in
Resource Scan
Scan Details
Site Domain | femina.in |
Base Domain | femina.in |
Scan Status | Ok |
Last Scan | 2024-06-22T18:21:58+00:00 |
Next Scan | 2024-06-29T18:21:58+00:00 |
Last Scan
Scanned | 2024-06-22T18:21:58+00:00 |
URL | https://femina.in/robots.txt |
Redirect | https://www.femina.in/robots.txt |
Redirect Domain | www.femina.in |
Redirect Base | femina.in |
Domain IPs | 184.50.85.148, 2600:1413:b000:1c::17d1:2ecf, 2600:1413:b000:1c::17d1:2ed9, 96.17.180.188 |
Redirect IPs | 184.28.229.106, 184.28.229.88, 2600:1417:3f::b81c:eb2b, 2600:1417:3f::b81c:eb40 |
Response IP | 96.17.180.24 |
Found | Yes |
Hash | 774b7ae646322f6843aa8c320ca2543c8f10570c0a4fbef7012e759aec15ea23 |
SimHash | 4e1e5b6cf131 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /7176/* |
Disallow | /21806551354/* |
Disallow | /temp/ |
Disallow | /2db/ |
Disallow | /static_pages/ |
Disallow | /tpl/ |
Disallow | /gateway/ |
Disallow | /common/ |
Disallow | /google_plus/ |
Disallow | /fb/ |
Disallow | /twitter_oauth/ |
Disallow | /crons/ |
Disallow | /SolrApi/ |
Disallow | /config/ |
Disallow | /api/ |
Disallow | /classes/ |
Disallow | /testEsi/ |
Disallow | /HTML/ |
Disallow | /captcha/ |
Disallow | /ssonew/ |
Disallow | /sso/ |
Disallow | /search/* |
Disallow | /hindi/search/* |
Disallow | /bengali/search/* |
Disallow | /tamil/search/* |
Disallow | /hindi/7176/* |
Disallow | /bengali/7176/* |
Disallow | /tamil/7176/* |
Disallow | /hindi/21806551354/* |
Disallow | /bengali/21806551354/* |
Disallow | /tamil/21806551354/* |
Disallow | /beauty-box/2db/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.femina.in/staticsitemap/sitemap-index.xml |
sitemap | https://www.femina.in/staticsitemap/section-subsection-sitemap.xml |
sitemap | https://www.femina.in/gImageSiteMap.xml |
sitemap | https://www.femina.in/gNewsSiteMap.xml |
sitemap | https://www.femina.in/staticsitemap/beauty-pageants-sitemap.xml |