Log In Sign Up

circuitbasics.com
robots.txt

Robots Exclusion Standard data for circuitbasics.com

Resource Scan

Scan Details

Site Domain circuitbasics.com
Base Domain circuitbasics.com
Scan Status Ok
Last Scan2025-11-08T07:01:28+00:00
Next Scan 2025-11-15T07:01:28+00:00

Last Scan

Scanned2025-11-08T07:01:28+00:00
URL https://circuitbasics.com/robots.txt
Domain IPs 50.6.111.35
Response IP 50.6.111.35
Found Yes
Hash 7b9fe908b38196a92b5e4eedeb1a992004f59aa43806a1dfea2a3b0e87d79975
SimHash 609e4959e083

Groups

imagesiftbot

Rule Path
Disallow /

img2dataset

Rule Path
Disallow /

tineye-bot

Rule Path
Disallow /

bpimagewalker

Rule Path
Disallow /

pinterestbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

youbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

applebot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

msai

Rule Path
Disallow /
Back to top

Warnings

  • 4 invalid lines.
Back to top