free3d.com
robots.txt

Robots Exclusion Standard data for free3d.com

Resource Scan

Scan Details

Site Domain free3d.com
Base Domain free3d.com
Scan Status Ok
Last Scan2024-08-29T14:10:46+00:00
Next Scan 2024-09-28T14:10:46+00:00

Last Scan

Scanned2024-08-29T14:10:46+00:00
URL https://free3d.com/robots.txt
Domain IPs 13.35.18.117, 13.35.18.35, 13.35.18.4, 13.35.18.79
Response IP 13.35.18.79
Found Yes
Hash 3b0140d4da16b9466ff725a7dbe728bf87c3ce29614580534d537eef853dfa5b
SimHash a8b559e4e792

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /tmp/
Disallow /include/
Disallow /aws-tf3dm/
Disallow /affiliate/
Disallow /panel/
Disallow /scraper/
Disallow /webfonts/

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Comments

  • Disallow public gptbot
  • Disallow CCBot