creativefabrica.com
robots.txt

Robots Exclusion Standard data for creativefabrica.com

Resource Scan

Scan Details

Site Domain creativefabrica.com
Base Domain creativefabrica.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-25T04:53:10+00:00
Next Scan 2024-09-23T04:53:10+00:00

Last Successful Scan

Scanned2023-05-30T15:10:40+00:00
URL https://creativefabrica.com/robots.txt
Redirect https://www.creativefabrica.com/robots.txt
Redirect Domain www.creativefabrica.com
Redirect Base creativefabrica.com
Domain IPs 104.18.6.235, 104.18.7.235, 2606:4700::6812:6eb, 2606:4700::6812:7eb
Redirect IPs 104.18.6.235, 104.18.7.235, 2606:4700::6812:6eb, 2606:4700::6812:7eb
Response IP 104.18.6.235
Found Yes
Hash 8581345bb2a61fad0349a2cbe22bd5b8e423dae2f4971e1de748e40e52392ce3
SimHash c006538bfe18

Groups

*

Rule Path
Disallow /wp-admin/*
Disallow /?s=
Disallow /search/*
Disallow */crafter*/followers
Disallow /es/nl/*
Disallow /es/nl/*
Disallow /es/it/*
Disallow /de/es/*
Disallow /it/es/*
Disallow /nl/es/*
Disallow /pt/es/*
Disallow /pl/es/*
Disallow /fr/es/*
Disallow /de/de/*
Disallow /it/de/*
Disallow /nl/de/*
Disallow /pt/de/*
Disallow /pl/de/*
Disallow /fr/de/*
Disallow /de/it/*
Disallow /it/it/*
Disallow /nl/it/*
Disallow /pt/it/*
Disallow /pl/it/*
Disallow /fr/it/*
Disallow /de/nl/*
Disallow /it/nl/*
Disallow /nl/nl/*
Disallow /pt/nl/*
Disallow /pl/nl/*
Disallow /fr/nl/*
Disallow /de/pt/*
Disallow /it/pt/*
Disallow /nl/pt/*
Disallow /pt/pt/*
Disallow /pl/pt/*
Disallow /fr/pt/*
Disallow /de/pl/*
Disallow /it/pl/*
Disallow /nl/pl/*
Disallow /pt/pl/*
Disallow /pl/pl/*
Disallow /fr/pl/*
Disallow /de/fr/*
Disallow /it/fr/*
Disallow /nl/fr/*
Disallow /pt/fr/*
Disallow /pl/fr/*
Disallow /fr/fr/*

baiduspider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

sogou spider2

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /es
Disallow /de
Disallow /designer/
Disallow /crafter/

Other Records

Field Value
crawl-delay 10

rogerbot

Rule Path
Disallow /es
Disallow /de
Disallow /designer/
Disallow /crafter/

Other Records

Field Value
crawl-delay 10

dotbot

Rule Path
Disallow /es
Disallow /de
Disallow /designer/
Disallow /crafter/

Other Records

Field Value
crawl-delay 10

semrushbot

Rule Path
Disallow /crafter/

ahrefsbot

Rule Path
Disallow /crafter/