spinbot.uk
robots.txt

Robots Exclusion Standard data for spinbot.uk

Resource Scan

Scan Details

Site Domain spinbot.uk
Base Domain spinbot.uk
Scan Status Ok
Last Scan2025-09-09T04:04:26+00:00
Next Scan 2025-09-16T04:04:26+00:00

Last Scan

Scanned2025-09-09T04:04:26+00:00
URL https://spinbot.uk/robots.txt
Domain IPs 2a02:4780:84:1b35:c4be:681b:1d90:69ba, 2a02:4780:84:3989:d37d:8b1c:9ed5:c5b9, 77.37.115.125, 93.127.201.6
Response IP 191.101.228.26
Found Yes
Hash d1ed30c9f13ecf8780cd0f1ab1cf0c56f1b8e9430d259202928decce19f47cbf
SimHash 18021d5ea791

Groups

*

Rule Path
Disallow /sample/
Disallow /core/
Disallow /images/
Disallow /admin/
Disallow /css/
Disallow /js/
Disallow /php/

Other Records

Field Value
sitemap https://spinbot.uk/sitemap.xml

Comments

  • robotstxt.org/