moniteurdesventes.com
robots.txt
Robots Exclusion Standard data for moniteurdesventes.com
Resource Scan
Scan Details
| Site Domain | moniteurdesventes.com |
| Base Domain | moniteurdesventes.com |
| Scan Status | Ok |
| Last Scan | 2025-09-21T17:47:32+00:00 |
| Next Scan | 2025-10-05T17:47:32+00:00 |
Last Scan
| Scanned | 2025-09-21T17:47:32+00:00 |
| URL | https://moniteurdesventes.com/robots.txt |
| Redirect | https://www.moniteurdesventes.com/robots.txt |
| Redirect Domain | www.moniteurdesventes.com |
| Redirect Base | moniteurdesventes.com |
| Domain IPs | 104.26.14.76, 104.26.15.76, 172.67.69.166, 2606:4700:20::681a:e4c, 2606:4700:20::681a:f4c, 2606:4700:20::ac43:45a6 |
| Redirect IPs | 104.26.14.76, 104.26.15.76, 172.67.69.166, 2606:4700:20::681a:e4c, 2606:4700:20::681a:f4c, 2606:4700:20::ac43:45a6 |
| Response IP | 172.67.69.166 |
| Found | Yes |
| Hash | 7079c4012f72dfa597780b0e7ea071ff88a71853a7374dbe400362508b90e78f |
| SimHash | 360e59d1d05d |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /l/* |
| Disallow | /v/* |
| Disallow | /category/ |
| Disallow | /*/category |
| Disallow | /compte/* |
| Disallow | /account/* |
| Disallow | /*/account/* |
| Disallow | /s?* |
| Disallow | /*/s?* |
| Disallow | /auctions/past |
| Disallow | /alert/* |
| Disallow | /*/alert/* |
| Disallow | /visite/ |
| Disallow | /*/visites/ |
| Disallow | /multiclerk-policy |
| Disallow | /lot/sendDetailStayEvent |
| Disallow | /*?*refurl=* |
| Disallow | /*?*query=* |
| Disallow | /*?*actionParam=* |
| Disallow | /*?*controllerParam=* |
| Disallow | /*?*authURL=* |
| Disallow | /*?*lang=* |
| Disallow | /*?*triSearch=* |
| Disallow | /*?*mode=* |
| Disallow | /*?*page=1 |
| Disallow | /*publicShow |
| Disallow | /*publicAjaxUpdate |
| Disallow | /lots/ |
| Disallow | /*/lots/ |
| Disallow | /cdn-cgi/ |
| Disallow | /*/cdn-cgi/ |
| Disallow | /fr/l/1* |
| Disallow | /fr/l/20* |
| Disallow | /fr/l/21* |
| Disallow | /fr/l/22* |
| Disallow | /fr/l/23* |
| Disallow | /fr/l/24* |
| Disallow | /en/l/1* |
| Disallow | /en/l/20* |
| Disallow | /en/l/21* |
| Disallow | /en/l/22* |
| Disallow | /en/l/23* |
| Disallow | /en/l/24* |
| Disallow | /es/l/1* |
| Disallow | /es/l/20* |
| Disallow | /es/l/21* |
| Disallow | /es/l/22* |
| Disallow | /es/l/23* |
| Disallow | /es/l/24* |
| Disallow | /de/l/1* |
| Disallow | /de/l/20* |
| Disallow | /de/l/21* |
| Disallow | /de/l/22* |
| Disallow | /de/l/23* |
| Disallow | /de/l/24* |
| Disallow | /it/l/1* |
| Disallow | /it/l/20* |
| Disallow | /it/l/21* |
| Disallow | /it/l/22* |
| Disallow | /it/l/23* |
| Disallow | /it/l/24* |
| Disallow | /zh/l/1* |
| Disallow | /zh/l/20* |
| Disallow | /zh/l/21* |
| Disallow | /zh/l/22* |
| Disallow | /zh/l/23* |
| Disallow | /zh/l/24* |
| Disallow | /app-fiendly/ |
amazonbot
applebot
applebot-extended
bytespider
ccbot
chatgpt-user
claude-web
claudebot
diffbot
facebookbot
friendlycrawler
gptbot
google-extended
googleother
googleother-image
googleother-video
icc-crawler
imagesiftbot
meta-externalagent
meta-externalfetcher
oai-searchbot
perplexitybot
petalbot
scrapy
timpibot
velenpublicwebcrawler
youbot
anthropic-ai
cohere-ai
facebookexternalhit
img2dataset
omgili
omgilibot
mauibot
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.moniteurdesventes.com/sitemap.xml |
| sitemap | https://www.moniteurdesventes.com/sitemap-fr-lot.xml |
| sitemap | https://www.moniteurdesventes.com/sitemap-fr-sale.xml |
| sitemap | https://www.moniteurdesventes.com/sitemap-fr-category.xml |
| sitemap | https://www.moniteurdesventes.com/sitemap-fr-past-lot-published.xml |
| sitemap | https://www.moniteurdesventes.com/sitemap-en-lot.xml |
| sitemap | https://www.moniteurdesventes.com/sitemap-en-sale.xml |
| sitemap | https://www.moniteurdesventes.com/sitemap-en-category.xml |
| sitemap | https://www.moniteurdesventes.com/sitemap-en-past-lot-published.xml |
Comments