gktodaybengali.in
robots.txt

Robots Exclusion Standard data for gktodaybengali.in

Resource Scan

Scan Details

Site Domain gktodaybengali.in
Base Domain gktodaybengali.in
Scan Status Ok
Last Scan2024-09-22T11:52:52+00:00
Next Scan 2024-09-29T11:52:52+00:00

Last Scan

Scanned2024-09-22T11:52:52+00:00
URL https://gktodaybengali.in/robots.txt
Redirect https://www.gktodaybengali.in/robots.txt
Redirect Domain www.gktodaybengali.in
Redirect Base gktodaybengali.in
Domain IPs 216.239.32.21, 216.239.34.21, 216.239.36.21, 216.239.38.21
Redirect IPs 172.253.118.121, 2404:6800:4003:c02::79
Response IP 142.251.12.121
Found Yes
Hash afe418490bf68214f288b8732226f39d4fc2b503680c2fb8748b47362242963c
SimHash cf0ed9f06bd1

Groups

mediapartners-google

Rule Path
Disallow /www.gktodaybengali.in/2020/10/wbpsc-clerkship-exam-frequently-asked-questions.html?m=1
Disallow /www.gktodaybengali.in/2020/12/dakshin-dinajpur-health-recruitment.htm?m=1
Disallow /www.gktodaybengali.in/2021/03/indian-forest-recruitment.htm?m=1
Disallow /www.gktodaybengali.in/20...?m=1
Disallow /www.gktodaybengali.in/2021/10/bengali-medium-school-teacher-vacancy?m=1
Disallow /www.gktodaybengali.in/2020/09/starting-salary-of-si-of-school-I-in-west-bengal%20.html?m=1
Disallow /www.gktodaybengali.in/2020/05/west-bengal-govt-jobs-2020-1000-vacancy.html
Disallow /www.gktodaybengali.in/2022/03/madhyamik-english-question-paper-.html?m=1
Disallow /http%3A//www.gktodaybengali.in/2022/12/%C2%A0https%3A//psc.wb.gov.in/Download?param1=An_20240722141057_ews-wbcs.pdf&param2=advertisement&m=1

*

Rule Path
Disallow /search
Disallow /category/
Allow /

Other Records

Field Value
sitemap https://www.gktodaybengali.in/atom.xml?redirect=false&start-index=1&max-results=500
sitemap https://www.gktodaybengali.in/atom.xml?redirect=false&start-index=501&max-results=500
sitemap https://www.gktodaybengali.in/atom.xml?redirect=false&start-index=1001&max-results=500
sitemap https://www.gktodaybengali.in/atom.xml?redirect=false&start-index=1501&max-results=500
sitemap https://www.gktodaybengali.in/atom.xml?redirect=false&start-index=2001&max-results=500
sitemap https://www.gktodaybengali.in/atom.xml?redirect=false&start-index=1501&max-results=500
sitemap https://www.gktodaybengali.in/atom.xml?redirect=false&start-index=3001&max-results=500
sitemap https://www.gktodaybengali.in/atom.xml?redirect=false&start-index=3501&max-results=500
sitemap https://www.gktodaybengali.in/atom.xml?redirect=false&start-index=4001&max-results=500
sitemap https://www.gktodaybengali.in/atom.xml?redirect=false&start-index=4501&max-results=500

Warnings

  • 7 invalid lines.