apexmovement.tech
robots.txt

Robots Exclusion Standard data for apexmovement.tech

Resource Scan

Scan Details

Site Domain apexmovement.tech
Base Domain apexmovement.tech
Scan Status Ok
Last Scan2025-11-15T18:22:40+00:00
Next Scan 2025-12-15T18:22:40+00:00

Last Scan

Scanned2025-11-15T18:22:40+00:00
URL https://apexmovement.tech/robots.txt
Domain IPs 104.21.47.217, 172.67.172.208, 2606:4700:3033::6815:2fd9, 2606:4700:3033::ac43:acd0
Response IP 172.67.172.208
Found Yes
Hash 780139e9bb7e8e47abcd825f60170f00d465dc341e313965b7d8eb49632be51f
SimHash 71145940c010

Groups

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

youbot

Rule Path
Disallow /

Comments

  • Taken from https://www.cyberciti.biz/web-developer/block-openai-bard-bing-ai-crawler-bots-using-robots-txt-file/