focus-beaute.com
robots.txt

Robots Exclusion Standard data for focus-beaute.com

Resource Scan

Scan Details

Site Domain focus-beaute.com
Base Domain focus-beaute.com
Scan Status Ok
Last Scan2024-09-25T04:15:13+00:00
Next Scan 2024-10-02T04:15:13+00:00

Last Scan

Scanned2024-09-25T04:15:13+00:00
URL https://focus-beaute.com/robots.txt
Redirect https://www.focus-beaute.com/robots.txt
Redirect Domain www.focus-beaute.com
Redirect Base focus-beaute.com
Domain IPs 104.21.10.189, 172.67.131.178, 2606:4700:3032::ac43:83b2, 2606:4700:3037::6815:abd
Redirect IPs 104.21.10.189, 172.67.131.178, 2606:4700:3032::ac43:83b2, 2606:4700:3037::6815:abd
Response IP 172.67.131.178
Found Yes
Hash 5a6561edf2ac0faff846bd7e19f6213b73ba5b65914675959090a0b82db4fe25
SimHash 225cc4705401

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /admin/
Disallow /accounts/activate/
Disallow /accounts/logout/
Disallow /accounts/unregister/
Disallow /articles/
Disallow /users/order/
Disallow /users/authors/
Disallow /users/search/
Disallow /users/password_reset/
Disallow /users/actions/
Disallow /espaces/
Disallow /flux/
Disallow /alaune/
Disallow /votes/
Disallow /forum/new-fb-comment/
Disallow /forum/create/
Disallow /forum/
Disallow /r/*
Disallow /i/
Disallow /plugins/feedback.php

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

ahrefsbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

www.integromedb.org/crawler

Rule Path
Disallow /