headlineplus.com
robots.txt
Robots Exclusion Standard data for headlineplus.com
Resource Scan
Scan Details
| Site Domain | headlineplus.com |
| Base Domain | headlineplus.com |
| Scan Status | Ok |
| Last Scan | 2025-12-31T08:49:52+00:00 |
| Next Scan | 2026-01-30T08:49:52+00:00 |
Last Scan
| Scanned | 2025-12-31T08:49:52+00:00 |
| URL | https://headlineplus.com/robots.txt |
| Domain IPs | 179.61.189.85, 2a02:4780:15:f33:7d2d:8aaf:a4d1:56e1, 2a02:4780:16:fb9c:389f:db7b:4a1f:e0f0, 77.37.115.173 |
| Response IP | 93.127.196.152 |
| Found | Yes |
| Hash | 6b0d46230a7808b9ac1b26175736e45eb69984ae8976d5aede5c20bf6a8a13cd |
| SimHash | 6b08cc408bb2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
*
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 120 |
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Disallow | /wp-login.php |
| Allow | /wp-admin/admin-ajax.php |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.headlineplus.com/sitemap_index.xml |