nekopencil.com
robots.txt
Robots Exclusion Standard data for nekopencil.com
Resource Scan
Scan Details
| Site Domain | nekopencil.com |
| Base Domain | nekopencil.com |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-11-13T00:27:34+00:00 |
| Next Scan | 2024-11-27T00:27:34+00:00 |
Last Successful Scan
| Scanned | 2024-10-28T18:45:07+00:00 |
| URL | https://nekopencil.com/robots.txt |
| Domain IPs | 2001:df7:5300:9::32, 36.50.77.50 |
| Response IP | 36.50.77.50 |
| Found | Yes |
| Hash | 117659a9faa5b06b199e22d6710681ce591d97c05318d148c69ee7eeba978b2a |
| SimHash | 20a08ae018ba |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /wp- |
| Disallow | /?s= |
| Disallow | *%26s%3D |
| Disallow | /search |
| Disallow | /author/ |
| Disallow | *?attachment_id= |
| Disallow | */feed |
| Disallow | */rss |
| Disallow | */embed |
| Allow | /wp-content/uploads/ |
| Allow | /wp-content/themes/ |
| Allow | /*/*.js |
| Allow | /*/*.css |
| Allow | /wp-*.png |
| Allow | /wp-*.jpg |
| Allow | /wp-*.jpeg |
| Allow | /wp-*.gif |
| Allow | /wp-*.svg |
| Allow | /wp-*.pdf |
*
| Rule | Path |
|---|---|
| Disallow |
Other Records
| Field | Value |
|---|---|
| sitemap | https://nekopencil.com/sitemap.xml |
| sitemap | https://nekopencil.com/sitemap_index.xml |
Comments