crimespreemag.com
robots.txt

Robots Exclusion Standard data for crimespreemag.com

Resource Scan

Scan Details

Site Domain crimespreemag.com
Base Domain crimespreemag.com
Scan Status Ok
Last Scan2026-01-25T21:39:52+00:00
Next Scan 2026-02-24T21:39:52+00:00

Last Scan

Scanned2026-01-25T21:39:52+00:00
URL https://crimespreemag.com/robots.txt
Domain IPs 162.241.252.14
Response IP 162.241.252.14
Found Yes
Hash 9295cd7ac78c487785cc214589aad812ed69056ca7f2866151712d0c27d037f0
SimHash 610888020bb2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

*

Rule Path
Disallow /wp-content/uploads/wpo/wpo-plugins-tables-list.json

Other Records

Field Value
sitemap https://crimespreemag.com/wp-sitemap.xml