skimcneill.com
robots.txt

Robots Exclusion Standard data for skimcneill.com

Resource Scan

Scan Details

Site Domain skimcneill.com
Base Domain skimcneill.com
Scan Status Ok
Last Scan2024-05-29T01:33:53+00:00
Next Scan 2024-06-28T01:33:53+00:00

Last Scan

Scanned2024-05-29T01:33:53+00:00
URL https://skimcneill.com/robots.txt
Redirect https://www.skimcneill.com/robots.txt
Redirect Domain www.skimcneill.com
Redirect Base skimcneill.com
Domain IPs 99.84.108.38, 99.84.108.44, 99.84.108.75, 99.84.108.93
Redirect IPs 13.35.18.110, 13.35.18.118, 13.35.18.69, 13.35.18.95, 2600:9000:20c7:1a00:2:1dff:71c0:93a1, 2600:9000:20c7:3a00:2:1dff:71c0:93a1, 2600:9000:20c7:4e00:2:1dff:71c0:93a1, 2600:9000:20c7:8400:2:1dff:71c0:93a1, 2600:9000:20c7:c00:2:1dff:71c0:93a1, 2600:9000:20c7:d600:2:1dff:71c0:93a1, 2600:9000:20c7:f000:2:1dff:71c0:93a1, 2600:9000:20c7:fe00:2:1dff:71c0:93a1
Response IP 13.35.18.69
Found Yes
Hash 0ae7701b4f8e66eef541add1a5b1660d4b8ed141666901f2d28ca3e22c760479
SimHash 1c1355506c23

Groups

discobot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

gomezagent

Rule Path
Disallow /

gomezagent

Rule Path
Disallow /

gomezagent+1.0

Rule Path
Disallow /

gomezagent+1.0

Rule Path
Disallow /

gomezagent+2.0

Rule Path
Disallow /

gomezagent+2.0

Rule Path
Disallow /

gomezagent+3.0

Rule Path
Disallow /

gomezagent+3.0

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

googlebot

Rule Path
Disallow /*?0*

googlebot

Rule Path
Disallow /go/500

googlebot

Rule Path
Disallow /static

googlebot

Rule Path
Disallow /*quotation?*

googlebot

Rule Path
Disallow /enquiry-form

googlebot

Rule Path
Disallow /*booking?*

*

Rule Path
Disallow /go/500

*

Rule Path
Disallow /static

*

Rule Path
Disallow /*quotation?*

*

Rule Path
Disallow /enquiry-form

*

Rule Path
Disallow /*booking?*

*

Rule Path
Disallow /*?0*

petalbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

*

Rule Path
Allow /

Warnings

  • 2 invalid lines.