creactivit.com
robots.txt

Robots Exclusion Standard data for creactivit.com

Resource Scan

Scan Details

Site Domain creactivit.com
Base Domain creactivit.com
Scan Status Ok
Last Scan2025-11-04T09:19:43+00:00
Next Scan 2025-12-04T09:19:43+00:00

Last Scan

Scanned2025-11-04T09:19:43+00:00
URL https://creactivit.com/robots.txt
Domain IPs 2001:41d0:1:1b00:213:186:33:17, 213.186.33.17
Response IP 213.186.33.17
Found Yes
Hash 4c9fdc6395d201cbd0c9fbcd99570a62c1d35320a1df59caf462912172564150
SimHash 7e8248488af2

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php
Disallow */trackback
Disallow /*/feed
Disallow /*/comments
Disallow /cgi-bin
Disallow /*.php$
Disallow /*.inc$
Disallow /*gz
Disallow /*.cgi
Disallow /*?parameter=

etaospider

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

googleagent-mariner

Rule Path
Disallow /

googleagent-shopping

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

devin

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

ai2bot

Rule Path
Disallow /

gemini-deep-research

Rule Path
Disallow /

pangubot

Rule Path
Disallow /

mistralai-user

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

sidetrade indexer bot

Rule Path
Disallow /

google-notebooklm

Rule Path
Disallow /

duckassistbot

Rule Path
Disallow /

copilot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.creactivit.com/sitemap.xml