bitgrup.com
robots.txt
Robots Exclusion Standard data for bitgrup.com
Resource Scan
Scan Details
| Site Domain | bitgrup.com |
| Base Domain | bitgrup.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-07-13T01:19:55+00:00 |
| Next Scan | 2025-08-12T01:19:55+00:00 |
Last Successful Scan
| Scanned | 2025-05-22T00:54:50+00:00 |
| URL | https://bitgrup.com/robots.txt |
| Redirect | https://www.wdna.com/robots.txt |
| Redirect Domain | www.wdna.com |
| Redirect Base | wdna.com |
| Domain IPs | 51.68.24.11 |
| Redirect IPs | 2001:8d8:100f:f000::2d1, 217.160.0.42 |
| Response IP | 217.160.0.42 |
| Found | Yes |
| Hash | 0489a573a03dd783e567f5884dd2f55003b5e697196049355793d78cf15f08ec |
| SimHash | 689c4f12c031 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /backend/ |
| Disallow | /admin/ |
| Disallow | /search |
| Disallow | /?random%2F |
| Disallow | /author/ |
| Disallow | /*/comment-page-* |
| Disallow | /comments/feed |
| Disallow | /*/feed/ |
| Disallow | /feed/ |
| Disallow | /feed/$ |
| Disallow | /*/feed/$ |
| Allow | /feed/$ |
| Disallow | /feed |
| Disallow | /comments/feed |
| Disallow | /*/feed/$ |
| Disallow | /*/feed/rss/$ |
| Disallow | /*/trackback/$ |
| Disallow | /*/*/feed/$ |
| Disallow | /*/*/feed/rss/$ |
| Disallow | /*/*/trackback/$ |
| Disallow | /*/*/*/feed/$ |
| Disallow | /*/*/*/feed/rss/$ |
| Disallow | /cgi-bin |
| Disallow | /wp-content/plugins/ |
| Disallow | /wp-content/themes/ |
| Disallow | /wp-includes/ |
| Disallow | /*/attachment/ |
| Disallow | /tag/*/page/ |
| Disallow | /tag/*/feed/ |
| Disallow | /etiqueta/*/page/ |
| Disallow | /etiqueta/*/feed/ |
| Disallow | /page/ |
| Disallow | /comments/ |
| Disallow | /xmlrpc.php |
| Disallow | /?attachment_id* |
| Disallow | /*/*/*/trackback/$ |
| Allow | /*.js$ |
| Allow | /*.css$ |
| Disallow | /*.pdf$ |
*
| Rule | Path |
|---|---|
| Disallow | /?s= |
| Disallow | /search |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.wdna.com/sitemap.xml |
| sitemap | https://www.wdna.com/sitemap-en.xml |
| sitemap | https://www.wdna.com/sitemap-de.xml |
Warnings
- 1 invalid line.
Comments