foe.co.uk
robots.txt
Robots Exclusion Standard data for foe.co.uk
Resource Scan
Scan Details
Site Domain | foe.co.uk |
Base Domain | foe.co.uk |
Scan Status | Ok |
Last Scan | 2024-06-12T01:23:41+00:00 |
Next Scan | 2024-07-12T01:23:41+00:00 |
Last Scan
Scanned | 2024-06-12T01:23:41+00:00 |
URL | https://foe.co.uk/robots.txt |
Redirect | https://friendsoftheearth.uk/robots.txt |
Redirect Domain | friendsoftheearth.uk |
Redirect Base | friendsoftheearth.uk |
Domain IPs | 104.26.14.180, 104.26.15.180, 172.67.69.174, 2606:4700:20::681a:eb4, 2606:4700:20::681a:fb4, 2606:4700:20::ac43:45ae |
Redirect IPs | 172.66.41.20, 172.66.42.236, 2606:4700:3108::ac42:2914, 2606:4700:3108::ac42:2aec |
Response IP | 172.66.41.20 |
Found | Yes |
Hash | 9235c8a6311bd5914168e9a8f27834b9cba4f85d93fa56747a90eae9023c69a6 |
SimHash | 3896bf03ce60 |
Groups
*
Rule | Path |
---|---|
Allow | /core/*.css$ |
Allow | /core/*.css? |
Allow | /core/*.js$ |
Allow | /core/*.js? |
Allow | /core/*.gif |
Allow | /core/*.jpg |
Allow | /core/*.jpeg |
Allow | /core/*.png |
Allow | /core/*.svg |
Allow | /profiles/*.css$ |
Allow | /profiles/*.css? |
Allow | /profiles/*.js$ |
Allow | /profiles/*.js? |
Allow | /profiles/*.gif |
Allow | /profiles/*.jpg |
Allow | /profiles/*.jpeg |
Allow | /profiles/*.png |
Allow | /profiles/*.svg |
Disallow | /core/ |
Disallow | /profiles/ |
Disallow | /README.txt |
Disallow | /web.config |
Disallow | /admin/ |
Disallow | /comment/reply/ |
Disallow | /filter/tips/ |
Disallow | /node/add/ |
Disallow | /search/ |
Disallow | /user/register/ |
Disallow | /user/password/ |
Disallow | /user/login/ |
Disallow | /user/logout/ |
Disallow | /index.php/admin/ |
Disallow | /index.php/comment/reply/ |
Disallow | /index.php/filter/tips/ |
Disallow | /index.php/node/add/ |
Disallow | /index.php/search/ |
Disallow | /index.php/user/password/ |
Disallow | /index.php/user/register/ |
Disallow | /index.php/user/login/ |
Disallow | /index.php/user/logout/ |
Disallow | /applications/ecards/ |
Disallow | /rss/ |
Disallow | /blog/ |
Disallow | /green-blog/ |
Disallow | /living/ |
Disallow | /news/ |
Disallow | /file/ |
Disallow | /modules/ |
Disallow | /node/ |
Disallow | /page/ |
Disallow | /system/ |
Disallow | /users/ |
Disallow | /views/ajax/ |
Comments