newgate.ie
robots.txt

Robots Exclusion Standard data for newgate.ie

Resource Scan

Scan Details

Site Domain newgate.ie
Base Domain newgate.ie
Scan Status Ok
Last Scan2025-03-18T18:47:18+00:00
Next Scan 2025-04-17T18:47:18+00:00

Last Scan

Scanned2025-03-18T18:47:18+00:00
URL https://newgate.ie/robots.txt
Redirect https://www.newgate.ie/robots.txt
Redirect Domain www.newgate.ie
Redirect Base newgate.ie
Domain IPs 104.21.37.2, 172.67.201.163, 2606:4700:3035::ac43:c9a3, 2606:4700:3036::6815:2502
Redirect IPs 104.21.37.2, 172.67.201.163, 2606:4700:3035::ac43:c9a3, 2606:4700:3036::6815:2502
Response IP 104.21.37.2
Found Yes
Hash c76109da0cff032d81e95d88b25a8d652f6a612ae9484a74e626db618b2b4792
SimHash ad36db740252

Groups

baiduspider

Rule Path
Disallow /

crystalsemanticsbot

Rule Path
Disallow /

wesee:ads/pagebot (http://www.wesee.com/bot/)

Rule Path
Disallow /

wesee:ads/picturebot (http://www.wesee.com/bot/)

Rule Path
Disallow /