bienmanger.com
robots.txt

Robots Exclusion Standard data for bienmanger.com

Resource Scan

Scan Details

Site Domain bienmanger.com
Base Domain bienmanger.com
Scan Status Ok
Last Scan2024-10-28T05:35:04+00:00
Next Scan 2024-11-27T05:35:04+00:00

Last Scan

Scanned2024-10-28T05:35:04+00:00
URL https://bienmanger.com/robots.txt
Redirect https://www.bienmanger.com/robots.txt
Redirect Domain www.bienmanger.com
Redirect Base bienmanger.com
Domain IPs 54.36.200.52
Redirect IPs 54.36.200.52
Response IP 54.36.200.52
Found Yes
Hash 69352eae26ed184395684df333ad1bf246cf28a7e7561f965949e4de028a9860
SimHash 701c5050f431

Groups

*

Rule Path
Disallow /*?IDCONTACT_MID=
Disallow /*?ordre=
Disallow /*?attr_
Disallow /*?price-
Disallow /*?category
Disallow /php/
Disallow /ajout.php*
Disallow /ajax/addProduct.php*
Disallow /ajax/ajout_produit.php*
Disallow /ajax/shipCountry.php*

bingbot
msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

mj12bot
ahrefsbot
rogerbot
semrushbot
yandex
blexbot
petalbot
ltx71
dotbot
barkrowler/0.9
semanticscholarbot
buck
ccbot
coccocbot-web
seznambot
freshbot
serendeputybot
zoominfobot
wine-searcherbot
proximic
bytespider
claudebot
sentibot
amazonbot
gptbot
imagesiftbot
awariorssbot
awariosmartbot
cocolyzebot
dataforseobot
chatgpt-user

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.bienmanger.com/sitemap_en.xml
sitemap https://www.bienmanger.com/sitemap_fr.xml