ulster.rugby
robots.txt

Robots Exclusion Standard data for ulster.rugby

Resource Scan

Scan Details

Site Domain ulster.rugby
Base Domain ulster.rugby
Scan Status Ok
Last Scan2024-09-20T14:17:53+00:00
Next Scan 2024-10-20T14:17:53+00:00

Last Scan

Scanned2024-09-20T14:17:53+00:00
URL https://ulster.rugby/robots.txt
Domain IPs 108.157.254.2, 108.157.254.3, 108.157.254.63, 108.157.254.84
Response IP 108.157.254.84
Found Yes
Hash 90a7edafcb521b5e9be2600c912d4b6c5f570efb5da1b216ddfbb078c9dff989
SimHash 6792f037e734

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1