Log In Sign Up

codingalchemist.com
robots.txt

Robots Exclusion Standard data for codingalchemist.com

Resource Scan

Scan Details

Site Domain codingalchemist.com
Base Domain codingalchemist.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2026-03-01T12:48:46+00:00
Next Scan 2026-05-30T12:48:46+00:00

Last Successful Scan

Scanned2023-10-20T14:40:21+00:00
URL https://codingalchemist.com/robots.txt
Domain IPs 104.21.20.155, 172.67.193.43, 2606:4700:3033::6815:149b, 2606:4700:3037::ac43:c12b
Response IP 172.67.193.43
Found Yes
Hash 2062c49c0c30b514dd9545397e51c06129c40038707edf5d608ab42db3520ab0
SimHash ab949a85c577

Groups

googlebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

slurp

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

duckduckbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

facebot

Rule Path
Allow /

ia_archiver

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

*

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.codingalchemist.com/sitemaps/sitemap.xml.gz
Back to top

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • Google
  • Yahoo
  • MS Bing
  • DuckDuckBot
  • facebot
  • Amazon
  • LinkedInBot
  • All others
Back to top