forum.freecad.org
robots.txt

Robots Exclusion Standard data for forum.freecad.org

Resource Scan

Scan Details

Site Domain forum.freecad.org
Base Domain freecad.org
Scan Status Ok
Last Scan2025-08-30T08:13:55+00:00
Next Scan 2025-09-29T08:13:55+00:00

Last Scan

Scanned2025-08-30T08:13:55+00:00
URL https://forum.freecad.org/robots.txt
Domain IPs 134.122.91.70
Response IP 134.122.91.70
Found Yes
Hash 95a0b443508473fd9e291755872e17170fa4c8c820d50a15921f848f74df69cc
SimHash 6214484882b5

Groups

*

Rule Path
Disallow /admin/
Disallow /includes/
Disallow /common.php
Disallow /config.php
Disallow /groupcp.php
Disallow /memberlist.php
Disallow /modcp.php
Disallow /profile.php
Disallow /viewtopic.php?p

Other Records

Field Value
crawl-delay 10

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /