topflight.ie
robots.txt

Robots Exclusion Standard data for topflight.ie

Resource Scan

Scan Details

Site Domain topflight.ie
Base Domain topflight.ie
Scan Status Ok
Last Scan2024-05-13T14:01:11+00:00
Next Scan 2024-06-12T14:01:11+00:00

Last Scan

Scanned2024-05-13T14:01:11+00:00
URL https://topflight.ie/robots.txt
Redirect https://www.topflight.ie/robots.txt
Redirect Domain www.topflight.ie
Redirect Base topflight.ie
Domain IPs 99.86.229.101, 99.86.229.51, 99.86.229.79, 99.86.229.85
Redirect IPs 2600:9000:2003:0:d:f695:5c00:93a1, 2600:9000:2003:2600:d:f695:5c00:93a1, 2600:9000:2003:4200:d:f695:5c00:93a1, 2600:9000:2003:5400:d:f695:5c00:93a1, 2600:9000:2003:5600:d:f695:5c00:93a1, 2600:9000:2003:6400:d:f695:5c00:93a1, 2600:9000:2003:a000:d:f695:5c00:93a1, 2600:9000:2003:ac00:d:f695:5c00:93a1, 52.84.229.124, 52.84.229.18, 52.84.229.90, 52.84.229.98
Response IP 52.84.229.124
Found Yes
Hash 0ae7701b4f8e66eef541add1a5b1660d4b8ed141666901f2d28ca3e22c760479
SimHash 1c1355506c23

Groups

discobot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

gomezagent

Rule Path
Disallow /

gomezagent

Rule Path
Disallow /

gomezagent+1.0

Rule Path
Disallow /

gomezagent+1.0

Rule Path
Disallow /

gomezagent+2.0

Rule Path
Disallow /

gomezagent+2.0

Rule Path
Disallow /

gomezagent+3.0

Rule Path
Disallow /

gomezagent+3.0

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

googlebot

Rule Path
Disallow /*?0*

googlebot

Rule Path
Disallow /go/500

googlebot

Rule Path
Disallow /static

googlebot

Rule Path
Disallow /*quotation?*

googlebot

Rule Path
Disallow /enquiry-form

googlebot

Rule Path
Disallow /*booking?*

*

Rule Path
Disallow /go/500

*

Rule Path
Disallow /static

*

Rule Path
Disallow /*quotation?*

*

Rule Path
Disallow /enquiry-form

*

Rule Path
Disallow /*booking?*

*

Rule Path
Disallow /*?0*

petalbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

*

Rule Path
Allow /

Warnings

  • 2 invalid lines.