databasedev.co.uk
robots.txt
Robots Exclusion Standard data for databasedev.co.uk
Resource Scan
Scan Details
Site Domain | databasedev.co.uk |
Base Domain | databasedev.co.uk |
Scan Status | Ok |
Last Scan | 2024-06-25T04:19:39+00:00 |
Next Scan | 2024-07-02T04:19:39+00:00 |
Last Scan
Scanned | 2024-06-25T04:19:39+00:00 |
URL | http://databasedev.co.uk/robots.txt |
Domain IPs | 217.172.141.197 |
Response IP | 217.172.141.197 |
Found | Yes |
Hash | 3c7db29aae36fe92849fece372a48f2102fb6010fce899b9b8e1f5d223ea8b0f |
SimHash | a33dd0fbcfb7 |
Groups
*
Rule | Path |
---|---|
Disallow | /you_stupid_spider.html |
Disallow | /aspbanner/ |
Disallow | /dev/ |
Disallow | /downloads/ |
Disallow | /data_models/ |
Disallow | /access-db-design-and-programming-review.htm |
Disallow | /competition.asp |
Disallow | /competition_terms.asp |
Disallow | /redirect.asp |
Disallow | /click_view.asp |
Disallow | /click_viewer.asp |
Disallow | /test_clicks.html |
Disallow | /access_user_seminar.html |
Comments