getnofilter.com
robots.txt

Robots Exclusion Standard data for getnofilter.com

Resource Scan

Scan Details

Site Domain getnofilter.com
Base Domain getnofilter.com
Scan Status Ok
Last Scan2026-02-19T21:26:04+00:00
Next Scan 2026-02-26T21:26:04+00:00

Last Scan

Scanned2026-02-19T21:26:04+00:00
URL https://getnofilter.com/robots.txt
Domain IPs 216.198.79.1
Response IP 216.198.79.1
Found Yes
Hash fd2387c4df1a407f6952e6dfffce3f39cf6109806245d8e90a575a397d2528a8
SimHash 664209500031

Groups

*

Rule Path
Allow /

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

googleother

Rule Path
Allow /

googleother-image

Rule Path
Allow /

google-extended

Rule Path
Allow /

gemini

Rule Path
Allow /

ccbot

Rule Path
Allow /

claudebot

Rule Path
Allow /

anthropic-ai

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

applebot-image

Rule Path
Allow /

Other Records

Field Value
sitemap https://getnofilter.com/sitemap.xml

Comments

  • Default crawling rules
  • Generative AI and research crawlers
  • See /ai.txt for data usage preferences