nea.gov.sg
robots.txt

Robots Exclusion Standard data for nea.gov.sg

Resource Scan

Scan Details

Site Domain nea.gov.sg
Base Domain nea.gov.sg
Scan Status Ok
Last Scan2024-06-03T14:35:25+00:00
Next Scan 2024-07-03T14:35:25+00:00

Last Scan

Scanned2024-06-03T14:35:25+00:00
URL https://nea.gov.sg/robots.txt
Redirect https://www.nea.gov.sg/robots.txt
Redirect Domain www.nea.gov.sg
Redirect Base nea.gov.sg
Domain IPs 13.215.110.163, 18.142.191.4, 52.76.28.97
Redirect IPs 108.156.133.25, 108.156.133.32, 108.156.133.6, 108.156.133.65, 2600:9000:2488:5a00:15:1ae6:d000:93a1, 2600:9000:2488:6c00:15:1ae6:d000:93a1, 2600:9000:2488:7000:15:1ae6:d000:93a1, 2600:9000:2488:7a00:15:1ae6:d000:93a1, 2600:9000:2488:b800:15:1ae6:d000:93a1, 2600:9000:2488:d600:15:1ae6:d000:93a1, 2600:9000:2488:da00:15:1ae6:d000:93a1, 2600:9000:2488:f200:15:1ae6:d000:93a1
Response IP 108.156.133.32
Found Yes
Hash b7e7be21db593a41cfa5bdc5ece5a787cefa772ec0458f75fc69e89d1a2f65ed
SimHash 38299b8473e3

Groups

facebookcatalog
facebookexternalhit
googlebot
googlebot-image
googlebot-mobile
googlebot-news
googlebot-video
twitterbot
whatsapp

Rule Path
Disallow

*

Rule Path
Disallow /

Comments

  • facebook.com social network
  • google.com international search engine
  • twitter.com social media bot
  • whatsapp.com preview bot
  • crawling rule(s) for above bots
  • disallow all other bots