bitmedia.io
robots.txt
Robots Exclusion Standard data for bitmedia.io
Resource Scan
Scan Details
| Site Domain | bitmedia.io |
| Base Domain | bitmedia.io |
| Scan Status | Ok |
| Last Scan | 2024-05-30T15:05:55+00:00 |
| Next Scan | 2024-06-29T15:05:55+00:00 |
Last Scan
| Scanned | 2024-05-30T15:05:55+00:00 |
| URL | https://bitmedia.io/robots.txt |
| Domain IPs | 104.26.10.103, 104.26.11.103, 172.67.70.106, 2606:4700:20::681a:a67, 2606:4700:20::681a:b67, 2606:4700:20::ac43:466a |
| Response IP | 172.67.70.106 |
| Found | Yes |
| Hash | 04a37fc2fe689ddb8b052123f95270c1f7d8cea53586ac49fec6ada0121f64a7 |
| SimHash | 21319f729e78 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /wp-admin/admin-ajax.php |
| Allow | */uploads |
| Allow | /*/*.js |
| Allow | /*/*.css |
| Allow | /wp-*.pdf |
| Allow | /wp-*.png |
| Allow | /wp-*.jpg |
| Allow | /wp-*.jpeg |
| Allow | /wp-*.gif |
| Allow | /wp-*.svg |
| Allow | /wp-*.pdf |
| Disallow | /category/* |
| Disallow | /search |
| Disallow | /author/ |
| Disallow | */page/ |
| Disallow | /wp- |
| Disallow | /wp-admin |
| Disallow | /wp-includes |
| Disallow | /wp-content/plugins |
| Disallow | /wp-json/ |
| Disallow | /wp-login.php |
| Disallow | /wp-register.php |
| Disallow | */embed |
| Disallow | */feed |
| Disallow | */rss |
| Disallow | /cgi-bin |
| Disallow | *?s= |
Other Records
| Field | Value |
|---|---|
| sitemap | https://bitmedia.io/sitemap.xml |
Warnings
- `host` is not a known field.
Comments