ulsterrugby.com
robots.txt

Robots Exclusion Standard data for ulsterrugby.com

Resource Scan

Scan Details

Site Domain ulsterrugby.com
Base Domain ulsterrugby.com
Scan Status Ok
Last Scan2024-10-21T10:26:54+00:00
Next Scan 2024-11-20T10:26:54+00:00

Last Scan

Scanned2024-10-21T10:26:54+00:00
URL https://www.ulsterrugby.com/robots.txt
Redirect https://ulster.rugby/robots.txt
Redirect Domain ulster.rugby
Redirect Base ulster.rugby
Domain IPs 108.157.254.2, 108.157.254.3, 108.157.254.63, 108.157.254.84, 2600:9000:2753:1600:e:ab3b:3400:93a1, 2600:9000:2753:3e00:e:ab3b:3400:93a1, 2600:9000:2753:4800:e:ab3b:3400:93a1, 2600:9000:2753:5200:e:ab3b:3400:93a1, 2600:9000:2753:600:e:ab3b:3400:93a1, 2600:9000:2753:e000:e:ab3b:3400:93a1, 2600:9000:2753:f800:e:ab3b:3400:93a1, 2600:9000:2753:fa00:e:ab3b:3400:93a1
Redirect IPs 108.157.254.2, 108.157.254.3, 108.157.254.63, 108.157.254.84
Response IP 108.157.254.63
Found Yes
Hash 90a7edafcb521b5e9be2600c912d4b6c5f570efb5da1b216ddfbb078c9dff989
SimHash 6792f037e734

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1