focus-cuisine.com
robots.txt

Robots Exclusion Standard data for focus-cuisine.com

Resource Scan

Scan Details

Site Domain focus-cuisine.com
Base Domain focus-cuisine.com
Scan Status Ok
Last Scan2024-06-23T04:27:29+00:00
Next Scan 2024-06-30T04:27:29+00:00

Last Scan

Scanned2024-06-23T04:27:29+00:00
URL https://focus-cuisine.com/robots.txt
Redirect https://www.focus-cuisine.com/robots.txt
Redirect Domain www.focus-cuisine.com
Redirect Base focus-cuisine.com
Domain IPs 104.21.64.120, 172.67.184.208, 2606:4700:3032::6815:4078, 2606:4700:3035::ac43:b8d0
Redirect IPs 104.21.64.120, 172.67.184.208, 2606:4700:3032::6815:4078, 2606:4700:3035::ac43:b8d0
Response IP 172.67.184.208
Found Yes
Hash 5a6561edf2ac0faff846bd7e19f6213b73ba5b65914675959090a0b82db4fe25
SimHash 225cc4705401

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /admin/
Disallow /accounts/activate/
Disallow /accounts/logout/
Disallow /accounts/unregister/
Disallow /articles/
Disallow /users/order/
Disallow /users/authors/
Disallow /users/search/
Disallow /users/password_reset/
Disallow /users/actions/
Disallow /espaces/
Disallow /flux/
Disallow /alaune/
Disallow /votes/
Disallow /forum/new-fb-comment/
Disallow /forum/create/
Disallow /forum/
Disallow /r/*
Disallow /i/
Disallow /plugins/feedback.php

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

ahrefsbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

www.integromedb.org/crawler

Rule Path
Disallow /