focus-emploi.com
robots.txt

Robots Exclusion Standard data for focus-emploi.com

Resource Scan

Scan Details

Site Domain focus-emploi.com
Base Domain focus-emploi.com
Scan Status Ok
Last Scan2024-06-28T02:50:26+00:00
Next Scan 2024-07-05T02:50:26+00:00

Last Scan

Scanned2024-06-28T02:50:26+00:00
URL https://focus-emploi.com/robots.txt
Redirect https://www.focus-emploi.com/robots.txt
Redirect Domain www.focus-emploi.com
Redirect Base focus-emploi.com
Domain IPs 104.21.13.57, 172.67.132.159, 2606:4700:3033::6815:d39, 2606:4700:3036::ac43:849f
Redirect IPs 104.21.13.57, 172.67.132.159, 2606:4700:3033::6815:d39, 2606:4700:3036::ac43:849f
Response IP 104.21.13.57
Found Yes
Hash 5a6561edf2ac0faff846bd7e19f6213b73ba5b65914675959090a0b82db4fe25
SimHash 225cc4705401

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /admin/
Disallow /accounts/activate/
Disallow /accounts/logout/
Disallow /accounts/unregister/
Disallow /articles/
Disallow /users/order/
Disallow /users/authors/
Disallow /users/search/
Disallow /users/password_reset/
Disallow /users/actions/
Disallow /espaces/
Disallow /flux/
Disallow /alaune/
Disallow /votes/
Disallow /forum/new-fb-comment/
Disallow /forum/create/
Disallow /forum/
Disallow /r/*
Disallow /i/
Disallow /plugins/feedback.php

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

ahrefsbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

www.integromedb.org/crawler

Rule Path
Disallow /