thefishy.co.uk
robots.txt

Robots Exclusion Standard data for thefishy.co.uk

Resource Scan

Scan Details

Site Domain thefishy.co.uk
Base Domain thefishy.co.uk
Scan Status Ok
Last Scan2024-11-13T22:22:26+00:00
Next Scan 2024-11-20T22:22:26+00:00

Last Scan

Scanned2024-11-13T22:22:26+00:00
URL https://thefishy.co.uk/robots.txt
Domain IPs 20.105.232.49
Response IP 20.105.232.49
Found Yes
Hash b2e03579d31dca0c884a55c1b4dba863423b20c5fefe459d02b37e8fb3bbb61c
SimHash ab04ffc1b118

Groups

*

Rule Path
Disallow /images/

semrushbot

Rule Path
Disallow /player/

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

ahrefsbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

Other Records

Field Value
sitemap https://thefishy.co.uk/sitemap.php
sitemap https://thefishy.co.uk/sitemap3.php
sitemap https://thefishy.co.uk/sitemap4.php
sitemap https://thefishy.co.uk/sitemap5.php
sitemap https://thefishy.co.uk/sitemap6.php
sitemap https://thefishy.co.uk/sitemap7.php
sitemap https://thefishy.co.uk/sitemap7.php?start=40000
sitemap https://thefishy.co.uk/sitemap7.php?start=80000
sitemap https://thefishy.co.uk/sitemap7.php?start=120000
sitemap https://thefishy.co.uk/sitemap7.php?start=160000
sitemap https://thefishy.co.uk/sitemap7.php?start=200000
sitemap https://thefishy.co.uk/sitemap7.php?start=240000
sitemap https://thefishy.co.uk/sitemap8.php
sitemap https://thefishy.co.uk/sitemap9.php
sitemap https://thefishy.co.uk/sitemap9.php?start=40000
sitemap https://thefishy.co.uk/sitemap9.php?start=80000
sitemap https://thefishy.co.uk/sitemap9.php?start=120000
sitemap https://thefishy.co.uk/sitemap9.php?start=160000