doncasterroversfc.co.uk
robots.txt

Robots Exclusion Standard data for doncasterroversfc.co.uk

Resource Scan

Scan Details

Site Domain doncasterroversfc.co.uk
Base Domain doncasterroversfc.co.uk
Scan Status Ok
Last Scan2024-09-24T05:55:06+00:00
Next Scan 2024-10-01T05:55:06+00:00

Last Scan

Scanned2024-09-24T05:55:06+00:00
URL https://doncasterroversfc.co.uk/robots.txt
Redirect https://www.doncasterroversfc.co.uk/robots.txt
Redirect Domain www.doncasterroversfc.co.uk
Redirect Base doncasterroversfc.co.uk
Domain IPs 52.214.90.51
Redirect IPs 108.156.133.100, 108.156.133.2, 108.156.133.28, 108.156.133.76, 2600:9000:2755:4000:3:dfb5:8940:93a1, 2600:9000:2755:4200:3:dfb5:8940:93a1, 2600:9000:2755:4a00:3:dfb5:8940:93a1, 2600:9000:2755:7e00:3:dfb5:8940:93a1, 2600:9000:2755:a800:3:dfb5:8940:93a1, 2600:9000:2755:b000:3:dfb5:8940:93a1, 2600:9000:2755:be00:3:dfb5:8940:93a1, 2600:9000:2755:ca00:3:dfb5:8940:93a1
Response IP 108.156.133.28
Found Yes
Hash bf88797946635eaba840b8b4370e49d75afeb6eea145a516f964d046fa13f9f6
SimHash 8110c3534577

Groups

meta-externalagent

Rule Path
Allow /