psmaga.com
robots.txt
Robots Exclusion Standard data for psmaga.com
Resource Scan
Scan Details
Site Domain | psmaga.com |
Base Domain | psmaga.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-27T20:46:31+00:00 |
Next Scan | 2024-10-04T20:46:31+00:00 |
Last Successful Scan
Scanned | 2024-09-19T20:36:01+00:00 |
URL | https://psmaga.com/robots.txt |
Domain IPs | 39.110.243.80 |
Response IP | 39.110.243.80 |
Found | Yes |
Hash | c96c367d139164c973f43d0385a09f003b8c8aa83017b107ad2dff9f5a6ae589 |
SimHash | 506c0d0245b2 |
Groups
*
Rule | Path |
---|---|
Allow | /db/ |
Allow | /special/ |
Allow | /ct/festa/totsugeki |
Allow | /mobile/e/totsugeki |
Allow | /fromeditor/toko.php |
Disallow | /ameblo/ |
Disallow | /admin/ |
Disallow | /action/ |
Disallow | /css/ |
Disallow | /*.inc$ |
Disallow | /TEST/ |
Disallow | /om/ |
Disallow | /niconico/ |
Disallow | /channel/ |
Disallow | /magazine_info_test/ |
Disallow | /registration/ |
Disallow | /fromediter/ |
Disallow | /fromeditor/ |
Disallow | /mobile/tools/ |
Comments