creativefabrica.com
robots.txt
Robots Exclusion Standard data for creativefabrica.com
Resource Scan
Scan Details
Site Domain | creativefabrica.com |
Base Domain | creativefabrica.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-23T04:53:28+00:00 |
Next Scan | 2024-12-22T04:53:28+00:00 |
Last Successful Scan
Scanned | 2023-05-30T15:10:40+00:00 |
URL | https://creativefabrica.com/robots.txt |
Redirect | https://www.creativefabrica.com/robots.txt |
Redirect Domain | www.creativefabrica.com |
Redirect Base | creativefabrica.com |
Domain IPs | 104.18.6.235, 104.18.7.235, 2606:4700::6812:6eb, 2606:4700::6812:7eb |
Redirect IPs | 104.18.6.235, 104.18.7.235, 2606:4700::6812:6eb, 2606:4700::6812:7eb |
Response IP | 104.18.6.235 |
Found | Yes |
Hash | 8581345bb2a61fad0349a2cbe22bd5b8e423dae2f4971e1de748e40e52392ce3 |
SimHash | c006538bfe18 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/* |
Disallow | /?s= |
Disallow | /search/* |
Disallow | */crafter*/followers |
Disallow | /es/nl/* |
Disallow | /es/nl/* |
Disallow | /es/it/* |
Disallow | /de/es/* |
Disallow | /it/es/* |
Disallow | /nl/es/* |
Disallow | /pt/es/* |
Disallow | /pl/es/* |
Disallow | /fr/es/* |
Disallow | /de/de/* |
Disallow | /it/de/* |
Disallow | /nl/de/* |
Disallow | /pt/de/* |
Disallow | /pl/de/* |
Disallow | /fr/de/* |
Disallow | /de/it/* |
Disallow | /it/it/* |
Disallow | /nl/it/* |
Disallow | /pt/it/* |
Disallow | /pl/it/* |
Disallow | /fr/it/* |
Disallow | /de/nl/* |
Disallow | /it/nl/* |
Disallow | /nl/nl/* |
Disallow | /pt/nl/* |
Disallow | /pl/nl/* |
Disallow | /fr/nl/* |
Disallow | /de/pt/* |
Disallow | /it/pt/* |
Disallow | /nl/pt/* |
Disallow | /pt/pt/* |
Disallow | /pl/pt/* |
Disallow | /fr/pt/* |
Disallow | /de/pl/* |
Disallow | /it/pl/* |
Disallow | /nl/pl/* |
Disallow | /pt/pl/* |
Disallow | /pl/pl/* |
Disallow | /fr/pl/* |
Disallow | /de/fr/* |
Disallow | /it/fr/* |
Disallow | /nl/fr/* |
Disallow | /pt/fr/* |
Disallow | /pl/fr/* |
Disallow | /fr/fr/* |
mj12bot
Rule | Path |
---|---|
Disallow | /es |
Disallow | /de |
Disallow | /designer/ |
Disallow | /crafter/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
rogerbot
Rule | Path |
---|---|
Disallow | /es |
Disallow | /de |
Disallow | /designer/ |
Disallow | /crafter/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |