specialcoveragenews.in
robots.txt

Robots Exclusion Standard data for specialcoveragenews.in

Resource Scan

Scan Details

Site Domain specialcoveragenews.in
Base Domain specialcoveragenews.in
Scan Status Ok
Last Scan2024-11-14T20:06:00+00:00
Next Scan 2024-11-21T20:06:00+00:00

Last Scan

Scanned2024-11-14T20:06:00+00:00
URL https://specialcoveragenews.in/robots.txt
Redirect https://www.specialcoveragenews.in/robots.txt
Redirect Domain www.specialcoveragenews.in
Redirect Base specialcoveragenews.in
Domain IPs 104.21.86.131, 172.67.220.49, 2606:4700:3030::ac43:dc31, 2606:4700:3037::6815:5683
Redirect IPs 104.21.86.131, 172.67.220.49, 2606:4700:3030::ac43:dc31, 2606:4700:3037::6815:5683
Response IP 172.67.220.49
Found Yes
Hash 16c9f7304990f34ab91c72a33915823be47622c9c1ba949934da7c52b287277c
SimHash 80520e07cd07

Groups

*

Rule Path
Allow /
Disallow /admin/*
Disallow /search/*
Disallow /search?*
Disallow /xhr/*
Disallow /preview/story-*
Disallow /amp/preview/story-*
Disallow /staging/*
Disallow /alfoo
Disallow /sildoo
Disallow /dutas
Disallow /metsmall
Allow /xhr/getNewsMixin*
Allow /content/servlet/WEBPController?*

Other Records

Field Value
sitemap https://www.specialcoveragenews.in/sitemap/sitemap-index.xml
sitemap https://www.specialcoveragenews.in/news-sitemap-daily.xml
sitemap https://www.specialcoveragenews.in/feeds.xml

Comments

  • robots.txt for https://www.specialcoveragenews.in/