penji.co
robots.txt
Robots Exclusion Standard data for penji.co
Resource Scan
Scan Details
Site Domain | penji.co |
Base Domain | penji.co |
Scan Status | Ok |
Last Scan | 2024-06-15T21:21:00+00:00 |
Next Scan | 2024-06-29T21:21:00+00:00 |
Last Scan
Scanned | 2024-06-15T21:21:00+00:00 |
URL | https://penji.co/robots.txt |
Domain IPs | 104.26.6.20, 104.26.7.20, 172.67.75.36, 2606:4700:20::681a:614, 2606:4700:20::681a:714, 2606:4700:20::ac43:4b24 |
Response IP | 172.67.75.36 |
Found | Yes |
Hash | ed8a0022ad57d860d3219066b8fed74ccbfb85eef6b11a22637e1417f9298fb3 |
SimHash | 49005972c112 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Disallow | /list_press/ |
Disallow | /post_right_ads/ |
Disallow | /review/ |
Other Records
Field | Value |
---|---|
sitemap | https://penji.co/sitemap_index.xml |