dlaobituarios.com
robots.txt
Robots Exclusion Standard data for dlaobituarios.com
Resource Scan
Scan Details
Site Domain | dlaobituarios.com |
Base Domain | dlaobituarios.com |
Scan Status | Ok |
Last Scan | 2024-05-26T08:23:18+00:00 |
Next Scan | 2024-06-02T08:23:18+00:00 |
Last Scan
Scanned | 2024-05-26T08:23:18+00:00 |
URL | https://www.dlaobituarios.com/robots.txt |
Domain IPs | 104.26.6.249, 104.26.7.249, 172.67.75.104, 2606:4700:20::681a:6f9, 2606:4700:20::681a:7f9, 2606:4700:20::ac43:4b68 |
Response IP | 172.67.75.104 |
Found | Yes |
Hash | fda73e11b809729011a31128d426b031737e78037a0151e879bafcb4ffa738a7 |
SimHash | 6b0537730be7 |
Groups
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 30 |
*
Rule | Path |
---|---|
Disallow | /*?*search_type* |
*
Rule | Path |
---|---|
Disallow | /search* |
*
Rule | Path |
---|---|
Disallow | /*?*ap_search_* |
*
Rule | Path |
---|---|
Disallow | /ajax/post_form/ |
*
Rule | Path |
---|---|
Disallow | /admin/ |
*
Rule | Path |
---|---|
Disallow | /*-admin/ |
*
Rule | Path |
---|---|
Disallow | /manage-*/ |
*
Rule | Path |
---|---|
Disallow | /create-*/ |
*
Rule | Path |
---|---|
Disallow | /edit-*/ |
*
Rule | Path |
---|---|
Disallow | /claim-*/ |
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Allow | /wp-admin/admin-ajax.php |
Warnings
- 8 invalid lines.
Comments