ou-dejeuner.com
robots.txt

Robots Exclusion Standard data for ou-dejeuner.com

Resource Scan

Scan Details

Site Domain ou-dejeuner.com
Base Domain ou-dejeuner.com
Scan Status Ok
Last Scan2024-09-25T00:29:08+00:00
Next Scan 2024-10-02T00:29:08+00:00

Last Scan

Scanned2024-09-25T00:29:08+00:00
URL http://ou-dejeuner.com/robots.txt
Redirect https://www.eat-list.fr/robots.txt
Redirect Domain www.eat-list.fr
Redirect Base eat-list.fr
Domain IPs 51.68.87.59
Redirect IPs 104.26.2.216, 104.26.3.216, 172.67.71.215, 2606:4700:20::681a:2d8, 2606:4700:20::681a:3d8, 2606:4700:20::ac43:47d7
Response IP 104.26.2.216
Found Yes
Hash f2a7fe7b860bd8c083af0aa7a7c32476b2db9aaeca6c4363792232c8f8f1c912
SimHash 424fd2b062ac

Groups

mj12bot
petalbot
aspiegelbot
ahrefsbot
semrushbot
dotbot
mauibot
seekportbot
mojeekbot
queryseekerspider
ias-va
apidae
dataforseobot
weborama-fetcher
clickagy
admantx
ttd-content

Rule Path
Disallow /

*

Rule Path
Disallow /doc/
Disallow /rss.xml
Disallow *error_type%3Dreservation
Disallow *intended%3D*
Disallow /client/*
Disallow *PageSpeed%3Dnoscript
Disallow /tracker

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1