janshakti.co.in
robots.txt

Robots Exclusion Standard data for janshakti.co.in

Resource Scan

Scan Details

Site Domain janshakti.co.in
Base Domain janshakti.co.in
Scan Status Ok
Last Scan2024-10-07T11:06:35+00:00
Next Scan 2024-10-14T11:06:35+00:00

Last Scan

Scanned2024-10-07T11:06:35+00:00
URL https://janshakti.co.in/robots.txt
Domain IPs 104.21.53.54, 172.67.209.35, 2606:4700:3032::ac43:d123, 2606:4700:3037::6815:3536
Response IP 104.21.53.54
Found Yes
Hash cb0b5e3ec09b2d49206fa3b09ec5cc49871e0565e6ee5d311c801b9a2706a4c8
SimHash 804abe4b4fc7

Groups

*

Rule Path
Allow /
Disallow /admin/*
Disallow /search/*
Disallow /search?*
Disallow /xhr/*
Disallow /preview/story-*
Disallow /amp/preview/story-*
Disallow /staging/*
Disallow /alfoo
Disallow /sildoo
Disallow /dutas
Disallow /metsmall
Allow /xhr/getNewsMixin*
Allow /content/servlet/RDESController?*

Other Records

Field Value
sitemap http://www.janshakti.co.in/sitemap/sitemap-index.xml
sitemap http://www.janshakti.co.in/news-sitemap-daily.xml
sitemap http://www.janshakti.co.in/feeds.xml

Comments

  • robots.txt for http://www.janshakti.co.in/