theprepreneur.com
robots.txt

Robots Exclusion Standard data for theprepreneur.com

Resource Scan

Scan Details

Site Domain theprepreneur.com
Base Domain theprepreneur.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-02-13T16:50:10+00:00
Next Scan 2025-05-14T16:50:10+00:00

Last Successful Scan

Scanned2023-07-02T00:02:06+00:00
URL https://theprepreneur.com/robots.txt
Domain IPs 104.21.64.177, 172.67.187.54, 2606:4700:3030::6815:40b1, 2606:4700:3034::ac43:bb36
Response IP 104.21.64.177
Found Yes
Hash 2572fddd8dae7482d7e20315126a65ccb40ffe9086614a08e265422b0ca2a2c2
SimHash 490158400db2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://theprepreneur.com/wp-sitemap.xml