femina.in
robots.txt

Robots Exclusion Standard data for femina.in

Resource Scan

Scan Details

Site Domain femina.in
Base Domain femina.in
Scan Status Ok
Last Scan2024-06-22T18:21:58+00:00
Next Scan 2024-06-29T18:21:58+00:00

Last Scan

Scanned2024-06-22T18:21:58+00:00
URL https://femina.in/robots.txt
Redirect https://www.femina.in/robots.txt
Redirect Domain www.femina.in
Redirect Base femina.in
Domain IPs 184.50.85.148, 2600:1413:b000:1c::17d1:2ecf, 2600:1413:b000:1c::17d1:2ed9, 96.17.180.188
Redirect IPs 184.28.229.106, 184.28.229.88, 2600:1417:3f::b81c:eb2b, 2600:1417:3f::b81c:eb40
Response IP 96.17.180.24
Found Yes
Hash 774b7ae646322f6843aa8c320ca2543c8f10570c0a4fbef7012e759aec15ea23
SimHash 4e1e5b6cf131

Groups

*

Rule Path
Allow /
Disallow /7176/*
Disallow /21806551354/*
Disallow /temp/
Disallow /2db/
Disallow /static_pages/
Disallow /tpl/
Disallow /gateway/
Disallow /common/
Disallow /google_plus/
Disallow /fb/
Disallow /twitter_oauth/
Disallow /crons/
Disallow /SolrApi/
Disallow /config/
Disallow /api/
Disallow /classes/
Disallow /testEsi/
Disallow /HTML/
Disallow /captcha/
Disallow /ssonew/
Disallow /sso/
Disallow /search/*
Disallow /hindi/search/*
Disallow /bengali/search/*
Disallow /tamil/search/*
Disallow /hindi/7176/*
Disallow /bengali/7176/*
Disallow /tamil/7176/*
Disallow /hindi/21806551354/*
Disallow /bengali/21806551354/*
Disallow /tamil/21806551354/*
Disallow /beauty-box/2db/

screaming frog seo spider

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.femina.in/staticsitemap/sitemap-index.xml
sitemap https://www.femina.in/staticsitemap/section-subsection-sitemap.xml
sitemap https://www.femina.in/gImageSiteMap.xml
sitemap https://www.femina.in/gNewsSiteMap.xml
sitemap https://www.femina.in/staticsitemap/beauty-pageants-sitemap.xml