genesearch.com
robots.txt

Robots Exclusion Standard data for genesearch.com

Resource Scan

Scan Details

Site Domain genesearch.com
Base Domain genesearch.com
Scan Status Ok
Last Scan2026-01-13T04:20:35+00:00
Next Scan 2026-01-20T04:20:35+00:00

Last Scan

Scanned2026-01-13T04:20:35+00:00
URL https://genesearch.com/robots.txt
Redirect https://www.genesearch.com/robots.txt
Redirect Domain www.genesearch.com
Redirect Base genesearch.com
Domain IPs 104.21.40.149, 172.67.153.14, 2606:4700:3030::ac43:990e, 2606:4700:3032::6815:2895
Redirect IPs 104.21.40.149, 172.67.153.14, 2606:4700:3030::ac43:990e, 2606:4700:3032::6815:2895
Response IP 172.67.153.14
Found Yes
Hash 9f3190c73c58d7f267f99bee7a70c42985b3d2aeba468a01f9667d3963016307
SimHash f0960900c277

Groups

gptbot

Rule Path
Disallow /family-stories/

chatgpt-user

Rule Path
Disallow /family-stories/

google-extended

Rule Path
Disallow /family-stories/

googlebot-image

Rule Path
Disallow /family-stories/kathryn-minnie-kreft/kathryn-kreft-tricycle.jpg
Disallow /family-stories/kathryn-minnie-kreft/kathryn-kreft-annie-kammann-with-ford-car-1024.jpg
Disallow /family-stories/kathryn-minnie-kreft/leon-keene.jpg
Disallow /family-stories/kathryn-minnie-kreft/elmira-keene-KC-Post-9-13-1913-500px.jpg
Disallow /family-stories/kathryn-minnie-kreft/kathryn-kreft-fred-and-annie-hibbeler-750.jpg

ccbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

ai2bot

Rule Path
Disallow /

kangaroo bot

Rule Path
Disallow /

pangubot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

cohere-training-data-crawler

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

meta-externalfetcher

Rule Path
Disallow /

midjourneybot

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

webzio-extended

Rule Path
Disallow /