blacknet.co.uk
robots.txt

Robots Exclusion Standard data for blacknet.co.uk

Resource Scan

Scan Details

Site Domain blacknet.co.uk
Base Domain blacknet.co.uk
Scan Status Ok
Last Scan2025-10-28T15:08:39+00:00
Next Scan 2025-11-04T15:08:39+00:00

Last Scan

Scanned2025-10-28T15:08:39+00:00
URL https://blacknet.co.uk/robots.txt
Domain IPs 95.217.77.3
Response IP 95.217.77.3
Found Yes
Hash 4b1e9b158f17a1ca18357c678804b941e237aa73527aee4d772e58093f685541
SimHash 6108c84027b1

Groups

*

Rule Path
Allow /wp-content/uploads/
Disallow /wp-content/plugins/
Disallow /wp-admin/
Disallow /readme.html
Disallow /refer/

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://blacknet.co.uk/sitemap_index.xml