gregkoch.com
robots.txt

Robots Exclusion Standard data for gregkoch.com

Resource Scan

Scan Details

Site Domain gregkoch.com
Base Domain gregkoch.com
Scan Status Ok
Last Scan2025-10-19T03:55:07+00:00
Next Scan 2025-11-18T03:55:07+00:00

Last Scan

Scanned2025-10-19T03:55:07+00:00
URL https://gregkoch.com/robots.txt
Redirect https://www.gregkoch.com/robots.txt
Redirect Domain www.gregkoch.com
Redirect Base gregkoch.com
Domain IPs 199.34.228.67
Redirect IPs 199.34.228.67
Response IP 199.34.228.67
Found Yes
Hash 1b0247c5c8b4626a98ee8ee6e99d963ea25bf40f9d501479decf598c322c1a8b
SimHash aa04c874a793

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /social.html
Disallow /greg-koch-master-class.html
Disallow /new-page---save-items.html

Other Records

Field Value
sitemap https://www.gregkoch.com/sitemap.xml