drouot.com
robots.txt
Robots Exclusion Standard data for drouot.com
Resource Scan
Scan Details
| Site Domain | drouot.com |
| Base Domain | drouot.com |
| Scan Status | Ok |
| Last Scan | 2024-09-24T06:31:34+00:00 |
| Next Scan | 2024-10-08T06:31:34+00:00 |
Last Scan
| Scanned | 2024-09-24T06:31:34+00:00 |
| URL | https://drouot.com/robots.txt |
| Domain IPs | 104.22.68.95, 104.22.69.95, 172.67.22.83, 2606:4700:10::6816:445f, 2606:4700:10::6816:455f, 2606:4700:10::ac43:1653 |
| Response IP | 104.22.69.95 |
| Found | Yes |
| Hash | 24f173ecf6f23ffaff0da8c0493d740fbb6cc66d07de058fe8cd90b21a244174 |
| SimHash | 361a5b51c0cb |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /l/* |
| Disallow | /v/* |
| Disallow | /category/ |
| Disallow | /*/category |
| Disallow | /compte/* |
| Disallow | /account/* |
| Disallow | /*/account/* |
| Disallow | /s?* |
| Disallow | /*/s?* |
| Disallow | /auctions/past |
| Disallow | /alert/* |
| Disallow | /*/alert/* |
| Disallow | /auctioneer/* |
| Disallow | /*/auctioneer/* |
| Disallow | /visite/ |
| Disallow | /*/visites/ |
| Disallow | /multiclerk-policy |
| Disallow | /lot/sendDetailStayEvent |
| Disallow | /*?*refurl=* |
| Disallow | /*?*query=* |
| Disallow | /*?*actionParam=* |
| Disallow | /*?*controllerParam=* |
| Disallow | /*?*authURL=* |
| Disallow | /*?*lang=* |
| Disallow | /*?*triSearch=* |
| Disallow | /*?*mode=* |
| Disallow | /*?*page=1 |
| Disallow | /*publicShow |
| Disallow | /*publicAjaxUpdate |
| Disallow | /lots/ |
| Disallow | /*/lots/ |
| Disallow | /cdn-cgi/ |
| Disallow | /*/cdn-cgi/ |
| Disallow | /app-fiendly/ |
amazonbot
applebot
applebot-extended
bytespider
ccbot
chatgpt-user
claude-web
claudebot
diffbot
facebookbot
friendlycrawler
gptbot
google-extended
googleother
googleother-image
googleother-video
icc-crawler
imagesiftbot
meta-externalagent
meta-externalfetcher
oai-searchbot
perplexitybot
petalbot
scrapy
timpibot
velenpublicwebcrawler
youbot
anthropic-ai
cohere-ai
facebookexternalhit
img2dataset
omgili
omgilibot
mauibot
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://drouot.com/sitemap-fr-lot.xml |
| sitemap | https://drouot.com/sitemap-fr-sale.xml |
| sitemap | https://drouot.com/sitemap-fr-category.xml |
| sitemap | https://drouot.com/sitemap-fr-news.xml |
| sitemap | https://drouot.com/sitemap-en-lot.xml |
| sitemap | https://drouot.com/sitemap-en-sale.xml |
| sitemap | https://drouot.com/sitemap-en-category.xml |
| sitemap | https://drouot.com/sitemap-en-news.xml |
| sitemap | https://drouot.com/sitemap-zh-lot.xml |
| sitemap | https://drouot.com/sitemap-zh-sale.xml |
| sitemap | https://drouot.com/sitemap-zh-category.xml |
| sitemap | https://drouot.com/sitemap-zh-news.xml |
| sitemap | https://drouot.com/sitemap-de-lot.xml |
| sitemap | https://drouot.com/sitemap-de-sale.xml |
| sitemap | https://drouot.com/sitemap-de-category.xml |
| sitemap | https://drouot.com/sitemap-de-news.xml |
| sitemap | https://drouot.com/sitemap-it-lot.xml |
| sitemap | https://drouot.com/sitemap-it-sale.xml |
| sitemap | https://drouot.com/sitemap-it-category.xml |
| sitemap | https://drouot.com/sitemap-it-news.xml |
| sitemap | https://drouot.com/sitemap-es-lot.xml |
| sitemap | https://drouot.com/sitemap-es-sale.xml |
| sitemap | https://drouot.com/sitemap-es-category.xml |
| sitemap | https://drouot.com/sitemap-es-news.xml |
Comments