kpop-idols.com
robots.txt
Robots Exclusion Standard data for kpop-idols.com
Resource Scan
Scan Details
| Site Domain | kpop-idols.com |
| Base Domain | kpop-idols.com |
| Scan Status | Ok |
| Last Scan | 2024-09-27T03:30:06+00:00 |
| Next Scan | 2024-10-04T03:30:06+00:00 |
Last Scan
| Scanned | 2024-09-27T03:30:06+00:00 |
| URL | https://kpop-idols.com/robots.txt |
| Domain IPs | 104.21.39.38, 172.67.142.174, 2606:4700:3031::6815:2726, 2606:4700:3034::ac43:8eae |
| Response IP | 104.21.39.38 |
| Found | Yes |
| Hash | 13ca9758678fff74dc19424824eddd0bef845891a97f078885d3290a4c36922b |
| SimHash | a1d85850c835 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /wp-content/uploads/* |
| Allow | /wp-content/*js |
| Allow | /wp-includes/*js |
| Allow | /wp-content/plugins/*css |
| Allow | /wp-content/plugins/*js |
| Allow | /wp-includes/*css |
| Allow | /wp-content/themes/*js |
| Allow | /wp-content/themes/*css |
| Disallow | /wp-login |
| Disallow | /cgi-bin |
| Disallow | /wp-content/themes/ |
| Disallow | /wp-includes/ |
| Disallow | /attachment |
| Disallow | /xmlrpc.php |
| Disallow | /page |
| Allow | */page-sitemap.xml |
| Disallow | /?attachment_id |
| Disallow | /feed |
| Disallow | /comments |
| Disallow | /trackback |
| Disallow | /?add-to-cart |
| Disallow | /?wc_view_mode |
| Disallow | /?gclid |
| Disallow | /?remove_item |
| Disallow | /?_wpnonce |
| Disallow | /%26attachment_id |
| Disallow | /%26add-to-cart |
| Disallow | /%26wc_view_mode |
| Disallow | /%26gclid |
| Disallow | /%26remove_item |
| Disallow | %26_wpnonce |
| Disallow | %26attribute_material |
| Disallow | /carrito |
| Disallow | /mi-cuenta* |
| Disallow | /*? |
*
| Rule | Path |
|---|---|
| Disallow | /?s= |
| Disallow | /search |
*
| Rule | Path |
|---|---|
| Allow | /*.css$ |
| Allow | /*.js$ |
| Allow | /*.jpg$ |
| Allow | /*.png$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://kpop-idols.com/sitemap_index.xml |
Warnings
- 1 invalid line.
Comments