jimstromberg.com
robots.txt

Robots Exclusion Standard data for jimstromberg.com

Resource Scan

Scan Details

Site Domain jimstromberg.com
Base Domain jimstromberg.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-04T07:02:47+00:00
Next Scan 2026-03-04T07:02:47+00:00

Last Successful Scan

Scanned2025-02-08T06:54:57+00:00
URL https://jimstromberg.com/robots.txt
Domain IPs 144.208.77.100
Response IP 144.208.77.100
Found Yes
Hash b8369b712ddc117172bf0d3e8f902f4705869136a130411b09e60f088ee10874
SimHash 44509a5343a5

Groups

googlebot

Rule Path
Disallow

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

slurp

Rule Path
Disallow

*

Rule Path
Disallow /

Comments

  • Allow Googlebot full access
  • Allow Bingbot full access
  • Allow Yahoo's Slurp Bot full access
  • Disallow access for all other user agents