nea.gov.sg
robots.txt

Robots Exclusion Standard data for nea.gov.sg

Resource Scan

Scan Details

Site Domain nea.gov.sg
Base Domain nea.gov.sg
Scan Status Ok
Last Scan2024-10-31T18:53:58+00:00
Next Scan 2024-11-30T18:53:58+00:00

Last Scan

Scanned2024-10-31T18:53:58+00:00
URL https://nea.gov.sg/robots.txt
Redirect https://www.nea.gov.sg/robots.txt
Redirect Domain www.nea.gov.sg
Redirect Base nea.gov.sg
Domain IPs 13.215.110.163, 18.142.191.4, 52.76.28.97
Redirect IPs 13.33.30.107, 13.33.30.119, 13.33.30.123, 13.33.30.124, 2600:9000:229f:2a00:15:1ae6:d000:93a1, 2600:9000:229f:3a00:15:1ae6:d000:93a1, 2600:9000:229f:400:15:1ae6:d000:93a1, 2600:9000:229f:5e00:15:1ae6:d000:93a1, 2600:9000:229f:9200:15:1ae6:d000:93a1, 2600:9000:229f:e400:15:1ae6:d000:93a1, 2600:9000:229f:ec00:15:1ae6:d000:93a1, 2600:9000:229f:f600:15:1ae6:d000:93a1
Response IP 13.33.30.119
Found Yes
Hash 752c8934b6880a40e3f9a5c65205f4fb1987a7fd7f5159c510be7800f1ce5ea9
SimHash 7809838473e3

Groups

facebookcatalog
facebookexternalhit
googlebot
googlebot-image
googlebot-mobile
googlebot-news
googlebot-video
twitterbot
whatsapp

Rule Path
Disallow

bingbot

Rule Path
Disallow

*

Rule Path
Disallow /

Comments

  • facebook.com social network
  • google.com international search engine
  • twitter.com social media bot
  • whatsapp.com preview bot
  • crawling rule(s) for above bots
  • Allow Bingbot
  • disallow all other bots