www.ndl.iitkgp.ac.in
robots.txt

Robots Exclusion Standard data for www.ndl.iitkgp.ac.in

Resource Scan

Scan Details

Site Domain www.ndl.iitkgp.ac.in
Base Domain iitkgp.ac.in
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-07T03:17:43+00:00
Next Scan 2025-10-21T03:17:43+00:00

Last Successful Scan

Scanned2025-08-29T23:35:32+00:00
URL https://www.ndl.iitkgp.ac.in/robots.txt
Domain IPs 203.110.243.183
Response IP 203.110.243.183
Found Yes
Hash cbb88d62a5808a000ce93cc830fa8b0521cf995be91750b2d6d3ae05b99753fc
SimHash 35001854af92

Groups

*

Rule Path
Disallow /ajax/
Disallow /assets/
Disallow /vendor/

Other Records

Field Value
sitemap https://www.ndl.gov.in/spider/se.xml
sitemap https://www.ndl.gov.in/spider/he.xml
sitemap https://www.ndl.gov.in/spider/re.xml
sitemap https://www.ndl.gov.in/spider/cd.xml
sitemap https://www.ndl.gov.in/spider/ch.xml
sitemap https://www.ndl.gov.in/spider/nw.xml
sitemap https://www.ndl.gov.in/spider/pt.xml
sitemap https://www.ndl.gov.in/spider/lw.xml
sitemap https://www.ndl.gov.in/spider/sd.xml