nlb.gov.sg
robots.txt

Robots Exclusion Standard data for nlb.gov.sg

Resource Scan

Scan Details

Site Domain nlb.gov.sg
Base Domain nlb.gov.sg
Scan Status Ok
Last Scan2024-09-05T08:04:26+00:00
Next Scan 2024-10-05T08:04:26+00:00

Last Scan

Scanned2024-09-05T08:04:26+00:00
URL https://nlb.gov.sg/robots.txt
Redirect https://eresources.nlb.gov.sg/robots.txt
Redirect Domain eresources.nlb.gov.sg
Redirect Base nlb.gov.sg
Domain IPs 2606:4f00::22:225, 52.128.22.225
Redirect IPs 2600:9000:271a:6000:16:dd81:fd00:93a1, 2600:9000:271a:6c00:16:dd81:fd00:93a1, 2600:9000:271a:7e00:16:dd81:fd00:93a1, 2600:9000:271a:9000:16:dd81:fd00:93a1, 2600:9000:271a:9400:16:dd81:fd00:93a1, 2600:9000:271a:9600:16:dd81:fd00:93a1, 2600:9000:271a:bc00:16:dd81:fd00:93a1, 2600:9000:271a:c00:16:dd81:fd00:93a1, 3.165.82.101, 3.165.82.102, 3.165.82.2, 3.165.82.55
Response IP 3.165.82.102
Found Yes
Hash 13ae31af16723a10e1f2283430d7fb142fa10694db4f0e437175e85d8254c2b4
SimHash 8c1ccaa3cff7

Groups

*

Rule Path
Allow /
Disallow /webarchives/wayback/
Disallow /Main/Pages/VerifyEDatabases
Disallow /Main/Pages/VerifySPH
Disallow /Main/Pages/VerifySPHMMS
Disallow /newspapers/digitised/article
Disallow /newspapers/digitised/page

Other Records

Field Value
sitemap https://www.nlb.gov.sg/main/sitemap.xml