boingboing.net
robots.txt
Robots Exclusion Standard data for boingboing.net
Resource Scan
Scan Details
Site Domain | boingboing.net |
Base Domain | boingboing.net |
Scan Status | Ok |
Last Scan | 2024-04-22T05:41:23+00:00 |
Next Scan | 2024-04-29T05:41:23+00:00 |
Last Scan
Scanned | 2024-04-22T05:41:23+00:00 |
URL | https://boingboing.net/robots.txt |
Domain IPs | 104.22.40.69, 104.22.41.69, 172.67.22.113, 2606:4700:10::6816:2845, 2606:4700:10::6816:2945, 2606:4700:10::ac43:1671 |
Response IP | 104.22.41.69 |
Found | Yes |
Hash | f274ac44a98475171cb15ab1827eb54975e78ecac0717d796e726a606c8d1798 |
SimHash | 9806e1c40520 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin |
Disallow | /cdn-cgi |
Disallow | /wp-json/wp/v2 |
Disallow | /wp-content/themes/2012/ads/ |
Disallow | /wp-content/themes/2012/ad_* |