critizr.com
robots.txt

Robots Exclusion Standard data for critizr.com

Resource Scan

Scan Details

Site Domain critizr.com
Base Domain critizr.com
Scan Status Ok
Last Scan2024-11-05T17:15:25+00:00
Next Scan 2024-11-19T17:15:25+00:00

Last Scan

Scanned2024-11-05T17:15:25+00:00
URL https://critizr.com/robots.txt
Domain IPs 13.107.246.59
Response IP 13.107.246.59
Found Yes
Hash a42ac2d0da98a6aa893807bed4ba20d2d952b137a9535cf0eed24e79fd59e58d
SimHash 4b143d686a1a

Groups

*

Rule Path
Disallow /categorie/
Disallow /enseignes/
Disallow /enseigne/
Disallow /connexion/
Disallow /deconnexion/
Disallow /inscription/
Disallow /mot-de-passe-oublie/
Disallow /ajax/
Disallow /api/
Disallow /monitoring/
Disallow /admin/
Disallow /pro/signup/
Disallow /pro/search/
Disallow /site_media/
Disallow /media/
Disallow /accounts/
Disallow /store_display/
Disallow /store_button/
Disallow /widgets/
Disallow /lieu/f/
Disallow /blog/
Disallow /pro/reply/
Disallow /fr/search/
Disallow /en/search/
Disallow /de/search/
Disallow /fr/signup/
Disallow /en/signup/
Disallow /de/signup/
Disallow /fr/inscription/
Disallow /en/inscription/
Disallow /de/inscription/
Disallow /fr/forgot-password/done/
Disallow /en/forgot-password/done/
Disallow /de/forgot-password/done/
Disallow /fr/forgot-password/
Disallow /en/forgot-password/
Disallow /de/forgot-password/
Disallow /fr/search/
Disallow /en/search/
Disallow /de/search/
Disallow /fr/user/
Disallow /en/user/
Disallow /de/user/
Disallow /es/
Disallow /zh-cn/
Disallow /it/
Disallow /nl/
Disallow /pl/
Disallow /ro/
Disallow /tr/
Disallow /pt/
Disallow /sv/
Disallow /sk/
Disallow /ru/
Disallow /hu/
Disallow /cs/
Disallow /sl/
Disallow /da/
Disallow /nb/
Disallow /fi/
Disallow /ja/
Disallow /ko/

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 600

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 600

semrushbot-sa

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 600

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 600

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 600

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 600

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 600

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 600