cleanerprofy.com
robots.txt
Robots Exclusion Standard data for cleanerprofy.com
Resource Scan
Scan Details
| Site Domain | cleanerprofy.com |
| Base Domain | cleanerprofy.com |
| Scan Status | Ok |
| Last Scan | 2024-10-09T09:34:32+00:00 |
| Next Scan | 2024-10-16T09:34:32+00:00 |
Last Scan
| Scanned | 2024-10-09T09:34:32+00:00 |
| URL | https://cleanerprofy.com/robots.txt |
| Domain IPs | 2406:da18:9d0:143f:2124:4e9c:36a9:d9de, 52.221.42.138 |
| Response IP | 52.221.42.138 |
| Found | Yes |
| Hash | 8f6463118e252f09c2cbf005f52c03b827ebca622b6e318f26ea82c88584b2a6 |
| SimHash | 1116c855cc37 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /wp-includes* |
| Disallow | */page/ |
| Disallow | /author/ |
| Disallow | /my-bookmarks/ |
| Allow | */uploads |
| Allow | /wp-content/themes/*.css* |
| Allow | /wp-content/plugins/*.css* |
| Allow | /wp-content/uploads/*.css* |
| Allow | /wp-content/themes/*.js* |
| Allow | /wp-content/plugins/*.js* |
| Allow | /wp-content/uploads/*.js* |
| Allow | /wp-content/themes/*.png* |
| Allow | /wp-content/themes/*.jpg* |
| Allow | /wp-content/plugins/*.gif* |
| Allow | /wp-content/plugins/*.woff* |
| Allow | /wp-content/plugins/*.ttf* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://cleanerprofy.com/sitemap.xml |
Warnings
- 1 invalid line.