webcity.co.uk
robots.txt

Robots Exclusion Standard data for webcity.co.uk

Resource Scan

Scan Details

Site Domain webcity.co.uk
Base Domain webcity.co.uk
Scan Status Ok
Last Scan5/28/2025, 10:05:46 PM
Next Scan 6/4/2025, 10:05:46 PM

Last Scan

Scanned5/28/2025, 10:05:46 PM
URL https://webcity.co.uk/robots.txt
Domain IPs 104.21.26.130, 172.67.168.73, 2606:4700:3031::6815:1a82, 2606:4700:3037::ac43:a849
Response IP 104.21.26.130
Found Yes
Hash ca54b7d16157f6cedd4789a86b3844c3d927746996ee5b0d38a4be505b2fa0f6
SimHash 02281cf0e033

Groups

*

Rule Path
Disallow /account/
Disallow /login/
Disallow /logout*
Disallow /lost-password*
Disallow /register*
Disallow /admin.php
Disallow /conversations/
Disallow */write$
Disallow */viewing$
Disallow */add-reply$
Disallow */new-posts?f=*
Allow /

mediapartners-google

Rule Path
Allow /

webreaper

Rule Path
Disallow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://webcity.co.uk/sitemap.xml