oldgoogle.neocities.org
robots.txt
Robots Exclusion Standard data for oldgoogle.neocities.org
Resource Scan
Scan Details
| Site Domain | oldgoogle.neocities.org |
| Base Domain | neocities.org |
| Scan Status | Ok |
| Last Scan | 2025-11-28T18:53:18+00:00 |
| Next Scan | 2025-12-28T18:53:18+00:00 |
Last Scan
| Scanned | 2025-11-28T18:53:18+00:00 |
| URL | https://oldgoogle.neocities.org/robots.txt |
| Domain IPs | 23.143.32.9, 2620:2:6000::a:1 |
| Response IP | 23.143.32.9 |
| Found | Yes |
| Hash | f661cc9064a97ac72eccfb1e6b068771c60f5d553086f4e3582ffd229beaf1cf |
| SimHash | b416c2e0a239 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /Legacy/* |
| Disallow | /news/* |
| Disallow | /extern_js/* |
| Disallow | /1998/* |
| Disallow | /2009/* |
| Disallow | /2010/* |
| Disallow | /2011/* |
| Disallow | /2013/* |
| Disallow | /2015/* |
| Disallow | /1998/ |
| Disallow | /2009/ |
| Disallow | /2010/ |
| Disallow | /2011/ |
| Disallow | /2013/ |
| Disallow | /2015/ |
| Disallow | /intl/en_ALL/images/* |
| Disallow | /intl/en_ALL/* |
| Disallow | /config/* |
| Disallow | /more/* |
| Disallow | /2009/webhp/ |
| Disallow | /2009/webhp/? |
| Disallow | /2009/webhp |
| Disallow | /2010/webhp/ |
| Disallow | /2010/webhp/? |
| Disallow | /2010/webhp |
| Disallow | /2011/webhp/ |
| Disallow | /2011/webhp/? |
| Disallow | /2011/webhp |
| Disallow | /2013/webhp/ |
| Disallow | /2013/webhp/? |
| Disallow | /2013/webhp |
| Disallow | /2009/search/ |
| Disallow | /2009/search/? |
| Disallow | /2009/search |
| Disallow | /2010/search/ |
| Disallow | /2010/search/? |
| Disallow | /2010/search |
| Disallow | /2011/search/ |
| Disallow | /2011/search/? |
| Disallow | /2011/search |
| Disallow | /newlogo.png |
| Allow | /intl/en/ |
| Allow | /intl/en/about/ |
| Allow | /intl/en/labs/ |
| Allow | /intl/en/terms/ |
| Allow | /intl/en/privacy/ |
| Allow | /intl/en/products/ |