therecursive.com
robots.txt

Robots Exclusion Standard data for therecursive.com

Resource Scan

Scan Details

Site Domain therecursive.com
Base Domain therecursive.com
Scan Status Ok
Last Scan2024-06-23T01:34:35+00:00
Next Scan 2024-07-23T01:34:35+00:00

Last Scan

Scanned2024-06-23T01:34:35+00:00
URL https://therecursive.com/robots.txt
Domain IPs 104.26.6.75, 104.26.7.75, 172.67.72.176, 2606:4700:20::681a:64b, 2606:4700:20::681a:74b, 2606:4700:20::ac43:48b0
Response IP 172.67.72.176
Found Yes
Hash a4493f8d8a4d003d3669f3dafc92160e57eadeb5265e1318d9df649f015c269b
SimHash 4100d8408fb3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://therecursive.com/sitemap_index.xml