freemagazinepdf.com
robots.txt
Robots Exclusion Standard data for freemagazinepdf.com
Resource Scan
Scan Details
| Site Domain | freemagazinepdf.com |
| Base Domain | freemagazinepdf.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-09-26T08:23:43+00:00 |
| Next Scan | 2024-12-25T08:23:43+00:00 |
Last Successful Scan
| Scanned | 2024-06-05T08:22:17+00:00 |
| URL | https://freemagazinepdf.com/robots.txt |
| Domain IPs | 104.21.94.244, 172.67.141.219, 2606:4700:3030::6815:5ef4, 2606:4700:3037::ac43:8ddb |
| Response IP | 172.67.141.219 |
| Found | Yes |
| Hash | 6f3bf1e8175290f3f8e8ae04a1ecf6150afa4c8857ce15b67fc10b2b32c7f785 |
| SimHash | 7861fd1743b0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /tag/ |
| Disallow | */feed |
| Disallow | */trackback |
| Disallow | */page |
| Disallow | /author/* |
| Disallow | /201* |
| Disallow | /*android-app* |
| Disallow | /*/null/ |
| Disallow | /*/undefined/ |
| Disallow | /template.html |
| Disallow | /readme.html |
| Disallow | /wp-login.php |
| Disallow | /wp-register.php |
| Disallow | /xmlrpc.php |
| Disallow | *?replytocom |
| Disallow | *?* |
| Allow | */uploads |
| Allow | *.js |
| Allow | *.css |
| Allow | *.png |
| Allow | *.gif |
Other Records
| Field | Value |
|---|---|
| sitemap | https://freemagazinepdf.com//sitemap_index.xml |
Warnings
- `host` is not a known field.