Log In Sign Up

nlb.gov.sg
robots.txt

Robots Exclusion Standard data for nlb.gov.sg

Resource Scan

Scan Details

Site Domain nlb.gov.sg
Base Domain nlb.gov.sg
Scan Status Ok
Last Scan2024-11-04T21:22:58+00:00
Next Scan 2024-12-04T21:22:58+00:00

Last Scan

Scanned2024-11-04T21:22:58+00:00
URL https://nlb.gov.sg/robots.txt
Redirect https://eresources.nlb.gov.sg/robots.txt
Redirect Domain eresources.nlb.gov.sg
Redirect Base nlb.gov.sg
Domain IPs 2606:4f00::22:225, 52.128.22.225
Redirect IPs 2600:9000:271a:4000:16:dd81:fd00:93a1, 2600:9000:271a:400:16:dd81:fd00:93a1, 2600:9000:271a:4200:16:dd81:fd00:93a1, 2600:9000:271a:5400:16:dd81:fd00:93a1, 2600:9000:271a:8800:16:dd81:fd00:93a1, 2600:9000:271a:a600:16:dd81:fd00:93a1, 2600:9000:271a:f000:16:dd81:fd00:93a1, 2600:9000:271a:f400:16:dd81:fd00:93a1, 3.165.82.101, 3.165.82.102, 3.165.82.2, 3.165.82.55
Response IP 3.165.82.102
Found Yes
Hash 9a4ad1d2308355b8f779119af8fa2f1d91098d7dba00e7a8d1e1d21d6bbfcced
SimHash 4c1cda81c795

Groups

*

Rule Path
Allow /
Disallow /webarchives/wayback/
Disallow /Main/Pages/VerifyEDatabases
Disallow /Main/Pages/VerifySPH
Disallow /Main/Pages/VerifySPHMMS

googlebot
bingbot

Rule Path
Allow /newspapers/digitised/issue

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /newspapers/digitised/
Back to top

Other Records

Field Value
sitemap https://www.nlb.gov.sg/main/sitemap.xml
Back to top