archive.4plebs.org
robots.txt
Robots Exclusion Standard data for archive.4plebs.org
Resource Scan
Scan Details
| Site Domain | archive.4plebs.org |
| Base Domain | 4plebs.org |
| Scan Status | Ok |
| Last Scan | 2025-06-12T00:55:10+00:00 |
| Next Scan | 2025-07-12T00:55:10+00:00 |
Last Scan
| Scanned | 2025-06-12T00:55:10+00:00 |
| URL | https://archive.4plebs.org/robots.txt |
| Domain IPs | 104.26.0.173, 104.26.1.173, 172.67.68.218, 2606:4700:20::681a:1ad, 2606:4700:20::681a:ad, 2606:4700:20::ac43:44da |
| Response IP | 172.67.68.218 |
| Found | Yes |
| Hash | 9a3616a99febfa4cbcf91a244a67e0177d44aa482e271204b5ca0dc83bc9ddf5 |
| SimHash | 11f42b57a4e0 |
Groups
googlebot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /_/articles/* |
| Allow | /_/transparency/* |
| Disallow | /_/* |
| Disallow | /*/last/* |
| Disallow | /search/* |
| Disallow | /*/search/* |
| Disallow | /admin/* |
| Disallow | /application/* |
| Disallow | /system/* |
| Disallow | /*/report/* |
| Disallow | /*/delete/* |
| Disallow | /cdn-cgi/* |
| Disallow | /*?task=* |
| Disallow | /dl/* |
| Disallow | /pol/thread/111900149/ |
| Disallow | /pol/thread/130881717/ |
| Disallow | /pol/thread/131118917/ |
| Disallow | /pol/thread/108534578/ |
| Disallow | /pol/thread/115527482/ |
| Disallow | /pol/thread/121528984/ |
| Disallow | /pol/thread/127469407/ |
| Disallow | /pol/thread/119133783/ |
| Disallow | /pol/thread/119397149/ |
| Disallow | /pol/thread/87118323/ |
| Disallow | /pol/thread/146277483/ |
| Disallow | /pol/thread/121771319/ |
| Disallow | /pol/thread/151045412/ |
| Disallow | /pol/thread/153765281/ |
| Disallow | /pol/thread/131837895/ |
| Disallow | /pol/thread/121362522/ |
| Disallow | /pol/thread/123547007/ |
| Disallow | /pol/thread/126916059/ |
| Disallow | /pol/thread/127322924/ |
| Disallow | /pol/thread/142927565/ |
| Disallow | /pol/thread/151174354/ |
| Disallow | /pol/thread/130597257/ |
| Disallow | /pol/thread/132766397/ |
| Disallow | /pol/thread/119265944/ |
| Disallow | /pol/thread/129948234/ |
| Disallow | /pol/thread/127461698/ |
| Disallow | /pol/thread/120463651/ |
| Disallow | /pol/thread/147205875/ |
| Disallow | /pol/thread/123621316/ |
| Disallow | /pol/thread/129952011/ |
| Disallow | /pol/thread/150333833/ |
| Disallow | /pol/thread/117422809/ |
| Disallow | /pol/thread/131513376/ |
| Disallow | /pol/thread/104614404/ |
| Disallow | /pol/thread/150511578/ |
| Disallow | /pol/thread/114673539/ |
| Disallow | /pol/thread/125310305/ |
| Disallow | /pol/thread/108440031/ |
| Disallow | /pol/thread/147518734/ |
| Disallow | /pol/thread/128619670/ |
| Disallow | /pol/thread/130588986/ |
| Disallow | /pol/thread/148858759/ |
| Disallow | /pol/thread/104130095/ |
| Disallow | /pol/thread/115926547/ |
| Disallow | /pol/thread/134381850/ |
| Disallow | /mlpol/thread/126257/ |
| Disallow | /pol/thread/91211744/ |
| Disallow | /pol/thread/143016069/ |
| Disallow | /pol/thread/119480507/ |
| Disallow | /pol/thread/116018083/ |
| Disallow | /pol/thread/104593600/ |
| Disallow | /pol/thread/116924310/ |
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /_/articles/* |
| Allow | /_/transparency/* |
| Disallow | /_/* |
| Disallow | /search/* |
| Disallow | /admin/* |
| Disallow | /application/* |
| Disallow | /system/* |
| Disallow | /*/search/* |
| Disallow | /*/report/* |
| Disallow | /*/delete/* |
| Disallow | /cdn-cgi/* |
| Disallow | /*?task=* |
Warnings
- 2 invalid lines.