Log In Sign Up

creatif.agency
robots.txt

Robots Exclusion Standard data for creatif.agency

Resource Scan

Scan Details

Site Domain creatif.agency
Base Domain creatif.agency
Scan Status Ok
Last Scan2026-01-04T07:28:30+00:00
Next Scan 2026-02-03T07:28:30+00:00

Last Scan

Scanned2026-01-04T07:28:30+00:00
URL https://creatif.agency/robots.txt
Domain IPs 172.66.40.212, 172.66.43.44, 2606:4700:3108::ac42:28d4, 2606:4700:3108::ac42:2b2c
Response IP 172.66.43.44
Found Yes
Hash f1a4e598c7a5aab114696889f1ff5d01edcec3d05487d884e4780fb22b1ea1fc
SimHash 7064bf826db3

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /privacy-policy
Allow /

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

claudebot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

google-extended

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://creatif.agency/sitemap_index.xml
Back to top

Comments

  • Default rule for all crawlers
  • Allow AI crawlers to access content
  • Sitemap for crawling & indexing
Back to top