webcity.co.uk
robots.txt
Robots Exclusion Standard data for webcity.co.uk
Resource Scan
Scan Details
Site Domain | webcity.co.uk |
Base Domain | webcity.co.uk |
Scan Status | Ok |
Last Scan | 5/28/2025, 10:05:46 PM |
Next Scan | 6/4/2025, 10:05:46 PM |
Last Scan
Scanned | 5/28/2025, 10:05:46 PM |
URL | https://webcity.co.uk/robots.txt |
Domain IPs | 104.21.26.130, 172.67.168.73, 2606:4700:3031::6815:1a82, 2606:4700:3037::ac43:a849 |
Response IP | 104.21.26.130 |
Found | Yes |
Hash | ca54b7d16157f6cedd4789a86b3844c3d927746996ee5b0d38a4be505b2fa0f6 |
SimHash | 02281cf0e033 |
Groups
*
Rule | Path |
---|---|
Disallow | /account/ |
Disallow | /login/ |
Disallow | /logout* |
Disallow | /lost-password* |
Disallow | /register* |
Disallow | /admin.php |
Disallow | /conversations/ |
Disallow | */write$ |
Disallow | */viewing$ |
Disallow | */add-reply$ |
Disallow | */new-posts?f=* |
Allow | / |
Other Records
Field | Value |
---|---|
sitemap | https://webcity.co.uk/sitemap.xml |