superprof.co.uk
robots.txt

Robots Exclusion Standard data for superprof.co.uk

Resource Scan

Scan Details

Site Domain superprof.co.uk
Base Domain superprof.co.uk
Scan Status Ok
Last Scan2025-06-02T16:16:16+00:00
Next Scan 2025-07-02T16:16:16+00:00

Last Scan

Scanned2025-06-02T16:16:16+00:00
URL https://superprof.co.uk/robots.txt
Redirect https://www.superprof.co.uk/robots.txt
Redirect Domain www.superprof.co.uk
Redirect Base superprof.co.uk
Domain IPs 2600:9000:2792:2200:f:f44f:b500:93a1, 2600:9000:2792:2c00:f:f44f:b500:93a1, 2600:9000:2792:2e00:f:f44f:b500:93a1, 2600:9000:2792:4600:f:f44f:b500:93a1, 2600:9000:2792:4e00:f:f44f:b500:93a1, 2600:9000:2792:c800:f:f44f:b500:93a1, 2600:9000:2792:d400:f:f44f:b500:93a1, 2600:9000:2792:e000:f:f44f:b500:93a1, 3.166.14.124, 3.166.14.34, 3.166.14.8, 3.166.14.96
Redirect IPs 2600:9000:274a:3200:f:f44f:b500:93a1, 2600:9000:274a:4c00:f:f44f:b500:93a1, 2600:9000:274a:5000:f:f44f:b500:93a1, 2600:9000:274a:8000:f:f44f:b500:93a1, 2600:9000:274a:a00:f:f44f:b500:93a1, 2600:9000:274a:aa00:f:f44f:b500:93a1, 2600:9000:274a:dc00:f:f44f:b500:93a1, 2600:9000:274a:f400:f:f44f:b500:93a1, 3.169.71.104, 3.169.71.113, 3.169.71.19, 3.169.71.4
Response IP 18.165.72.129
Found Yes
Hash 78bdb47821d96f850a1d6e848f803c1bcb0314eb6ced12399f2fe9779dfb7536
SimHash 2907581d49b3

Groups

*

Rule Path
Disallow /connections-*
Disallow /dashboard*
Disallow /lib/
Disallow /ajax/
Disallow /a/
Disallow /blog/?s=*
Disallow /blog/?wordfence_lh=*
Disallow /resources/?s=*
Disallow /resources/?wordfence_lh=*
Disallow *?replytocom=*

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.superprof.co.uk/sitemap.xml
sitemap https://www.superprof.co.uk/blog/sitemap.xml
sitemap https://www.superprof.co.uk/resources/sitemap.xml