free3d.com
robots.txt

Robots Exclusion Standard data for free3d.com

Resource Scan

Scan Details

Site Domain free3d.com
Base Domain free3d.com
Scan Status Ok
Last Scan2024-10-28T14:11:37+00:00
Next Scan 2024-11-27T14:11:37+00:00

Last Scan

Scanned2024-10-28T14:11:37+00:00
URL https://free3d.com/robots.txt
Domain IPs 13.33.88.101, 13.33.88.25, 13.33.88.33, 13.33.88.85
Response IP 13.33.88.33
Found Yes
Hash 3b0140d4da16b9466ff725a7dbe728bf87c3ce29614580534d537eef853dfa5b
SimHash a8b559e4e792

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /tmp/
Disallow /include/
Disallow /aws-tf3dm/
Disallow /affiliate/
Disallow /panel/
Disallow /scraper/
Disallow /webfonts/

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Comments

  • Disallow public gptbot
  • Disallow CCBot