barnsleyfc.co.uk
robots.txt

Robots Exclusion Standard data for barnsleyfc.co.uk

Resource Scan

Scan Details

Site Domain barnsleyfc.co.uk
Base Domain barnsleyfc.co.uk
Scan Status Ok
Last Scan2024-09-17T05:47:41+00:00
Next Scan 2024-09-24T05:47:41+00:00

Last Scan

Scanned2024-09-17T05:47:41+00:00
URL https://barnsleyfc.co.uk/robots.txt
Redirect https://www.barnsleyfc.co.uk/robots.txt
Redirect Domain www.barnsleyfc.co.uk
Redirect Base barnsleyfc.co.uk
Domain IPs 54.72.127.253
Redirect IPs 2600:9000:2721:1000:1e:2b2c:480:93a1, 2600:9000:2721:5e00:1e:2b2c:480:93a1, 2600:9000:2721:8000:1e:2b2c:480:93a1, 2600:9000:2721:a000:1e:2b2c:480:93a1, 2600:9000:2721:a200:1e:2b2c:480:93a1, 2600:9000:2721:c600:1e:2b2c:480:93a1, 2600:9000:2721:e600:1e:2b2c:480:93a1, 2600:9000:2721:e800:1e:2b2c:480:93a1, 3.165.102.111, 3.165.102.129, 3.165.102.18, 3.165.102.4
Response IP 3.165.102.18
Found Yes
Hash bf88797946635eaba840b8b4370e49d75afeb6eea145a516f964d046fa13f9f6
SimHash 8110c3534577

Groups

meta-externalagent

Rule Path
Allow /