natewren.com
robots.txt

Robots Exclusion Standard data for natewren.com

Resource Scan

Scan Details

Site Domain natewren.com
Base Domain natewren.com
Scan Status Ok
Last Scan2025-05-17T21:26:55+00:00
Next Scan 2025-05-24T21:26:55+00:00

Last Scan

Scanned2025-05-17T21:26:55+00:00
URL https://natewren.com/robots.txt
Domain IPs 104.21.58.29, 172.67.155.75, 2606:4700:3032::6815:3a1d, 2606:4700:3035::ac43:9b4b
Response IP 104.21.58.29
Found Yes
Hash 2e6ac7d855f74424a33e3a6ec7532649f53c6040ab3884bab6e87de7087b22ed
SimHash 1e051d016472

Groups

*

Rule Path
Disallow /themes/*
Disallow /themes/

Other Records

Field Value
sitemap https://natewren.com/sitemap_index.xml

Comments

  • This robots.txt file controls crawling of URLs under https://natewren.com/.