Log In Sign Up

eresources.nlb.gov.sg
robots.txt

Robots Exclusion Standard data for eresources.nlb.gov.sg

Resource Scan

Scan Details

Site Domain eresources.nlb.gov.sg
Base Domain nlb.gov.sg
Scan Status Ok
Last Scan2024-10-29T23:09:12+00:00
Next Scan 2024-11-28T23:09:12+00:00

Last Scan

Scanned2024-10-29T23:09:12+00:00
URL https://eresources.nlb.gov.sg/robots.txt
Domain IPs 2600:9000:271a:5800:16:dd81:fd00:93a1, 2600:9000:271a:8400:16:dd81:fd00:93a1, 2600:9000:271a:a00:16:dd81:fd00:93a1, 2600:9000:271a:a400:16:dd81:fd00:93a1, 2600:9000:271a:a600:16:dd81:fd00:93a1, 2600:9000:271a:ae00:16:dd81:fd00:93a1, 2600:9000:271a:c00:16:dd81:fd00:93a1, 2600:9000:271a:f600:16:dd81:fd00:93a1, 3.165.82.101, 3.165.82.102, 3.165.82.2, 3.165.82.55
Response IP 3.165.82.55
Found Yes
Hash 9a4ad1d2308355b8f779119af8fa2f1d91098d7dba00e7a8d1e1d21d6bbfcced
SimHash 4c1cda81c795

Groups

*

Rule Path
Allow /
Disallow /webarchives/wayback/
Disallow /Main/Pages/VerifyEDatabases
Disallow /Main/Pages/VerifySPH
Disallow /Main/Pages/VerifySPHMMS

googlebot
bingbot

Rule Path
Allow /newspapers/digitised/issue

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /newspapers/digitised/
Back to top

Other Records

Field Value
sitemap https://www.nlb.gov.sg/main/sitemap.xml
Back to top