rashifaltoday.in
robots.txt

Robots Exclusion Standard data for rashifaltoday.in

Resource Scan

Scan Details

Site Domain rashifaltoday.in
Base Domain rashifaltoday.in
Scan Status Ok
Last Scan2025-04-11T02:12:22+00:00
Next Scan 2025-04-18T02:12:22+00:00

Last Scan

Scanned2025-04-11T02:12:22+00:00
URL https://rashifaltoday.in/robots.txt
Redirect https://www.rashifaltoday.in/robots.txt
Redirect Domain www.rashifaltoday.in
Redirect Base rashifaltoday.in
Domain IPs 104.21.77.197, 172.67.211.110, 2606:4700:3030::ac43:d36e, 2606:4700:3035::6815:4dc5
Redirect IPs 104.21.77.197, 172.67.211.110, 2606:4700:3030::ac43:d36e, 2606:4700:3035::6815:4dc5
Response IP 172.67.211.110
Found Yes
Hash 240f2af0c8fc60e2a9c80c65002387d97ce35a0c18541b90fa59ba621d7400c7
SimHash 8a029a53ddd7

Groups

*

Rule Path
Allow /
Disallow /admin/*
Disallow /partnercontent/*
Disallow /xhr/*
Disallow /app-lite/*
Disallow /refer-*
Disallow /search/*
Disallow /search?*
Disallow /xhr/*
Disallow /preview/story-*
Disallow /amp/preview/story-*
Disallow /staging/*
Disallow /advertise-with-hans-India
Allow /xhr/getNewsMixin*
Allow /content/servlet/RDESController?*

Other Records

Field Value
sitemap https://www.rashifaltoday.in/sitemap/sitemap-index.xml
sitemap https://www.rashifaltoday.in/news-sitemap-daily.xml
sitemap https://www.rashifaltoday.in/sitemap-daily.xml

Comments

  • robots.txt for https://www.rashifaltoday.in/