tpgateway.gov.sg
robots.txt

Robots Exclusion Standard data for tpgateway.gov.sg

Resource Scan

Scan Details

Site Domain tpgateway.gov.sg
Base Domain tpgateway.gov.sg
Scan Status Ok
Last Scan2024-06-01T04:02:09+00:00
Next Scan 2024-07-01T04:02:09+00:00

Last Scan

Scanned2024-06-01T04:02:09+00:00
URL https://tpgateway.gov.sg/robots.txt
Redirect https://www.tpgateway.gov.sg/robots.txt
Redirect Domain www.tpgateway.gov.sg
Redirect Base tpgateway.gov.sg
Domain IPs 52.220.99.250, 52.74.238.87
Redirect IPs 13.35.18.106, 13.35.18.110, 13.35.18.83, 13.35.18.93
Response IP 13.35.18.93
Found Yes
Hash e7f2203b04fdfc9387f31c5d85bd6eee38f4a0d1fd3e1f88b70d3d45b646cee4
SimHash 4050d39467f5

Groups

*

Rule Path
Disallow /

googlebot
googlebot-image
googlebot-video
googlebot-mobile
slurp
bingbot
applebot
twitterbot
pingdom.com_bot_version_1.4_

Product Comment
googlebot https://en.wikipedia.org/wiki/Googlebot
googlebot-image Googlebot for image, https://varvy.com/googlebot.html
googlebot-video Googlebot for video, https://varvy.com/googlebot.html
googlebot-mobile Googlebot for video, https://varvy.com/googlebot.html
slurp https://help.yahoo.com/kb/SLN22600.html?guccounter=1
bingbot https://en.wikipedia.org/wiki/Bingbot
applebot http://www.apple.com/go/applebot
Rule Path
Allow /