justchat.co.uk
robots.txt

Robots Exclusion Standard data for justchat.co.uk

Resource Scan

Scan Details

Site Domain justchat.co.uk
Base Domain justchat.co.uk
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-22T22:27:07+00:00
Next Scan 2026-04-22T22:27:07+00:00

Last Successful Scan

Scanned2023-06-15T10:12:13+00:00
URL https://justchat.co.uk/robots.txt
Redirect https://www.justchat.co.uk/robots.txt
Redirect Domain www.justchat.co.uk
Redirect Base justchat.co.uk
Domain IPs 104.21.55.145, 172.67.149.35, 2606:4700:3033::6815:3791, 2606:4700:3037::ac43:9523
Redirect IPs 104.21.55.145, 172.67.149.35, 2606:4700:3033::6815:3791, 2606:4700:3037::ac43:9523
Response IP 172.67.149.35
Found Yes
Hash 1b57c5a999229db1905ceff8e1da03cef8f7a8adda036ed37a2bb39c55b614e4
SimHash 6a58c84083e6

Groups

*

Rule Path
Disallow *?replytocom

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Disallow *?replytocom

Other Records

Field Value
crawl-delay 30

ahrefsbot

Rule Path
Disallow *?replytocom

Other Records

Field Value
crawl-delay 120

rogerbot

Rule Path
Disallow *?replytocom

Other Records

Field Value
crawl-delay 60

paperlibot

Rule Path
Disallow *?replytocom

Other Records

Field Value
crawl-delay 60

yandex

Rule Path
Disallow /