picclick.fr
robots.txt

Robots Exclusion Standard data for picclick.fr

Resource Scan

Scan Details

Site Domain picclick.fr
Base Domain picclick.fr
Scan Status Ok
Last Scan2024-06-02T06:18:36+00:00
Next Scan 2024-07-02T06:18:36+00:00

Last Scan

Scanned2024-06-02T06:18:36+00:00
URL https://picclick.fr/robots.txt
Domain IPs 54.176.32.72
Response IP 54.176.32.72
Found Yes
Hash f0ed18b2d3bd5a4b1fa64557c27e2b6f89718b2a0448935a74cf704a33b2b548
SimHash 524c795140d1

Groups

*

Rule Path
Disallow /searchamazon.php
Disallow /amazonsearchresults/
Disallow /ebaysearchresults/
Disallow /seller/
Disallow /item/
Disallow /track/
Disallow /pict/
Disallow /d/
Disallow /Collectibles/play/
Disallow /*?q=
Disallow /*?query=
Disallow /*?iframe=
Disallow /*?link=
Disallow /*?perma&
Disallow /*?itemsort=
Disallow /*?type=
Disallow /*?sort=
Disallow /*?categoryId=
Disallow /*?filters=
Disallow /*?directbuy=
Disallow /description.php
Disallow /feed.php
Disallow /amazon.php
Disallow /search.php
Disallow /tools/
Disallow /popularhtml.php
Disallow /sitemaphtml.php
Disallow /sitemapindex.php
Disallow /sitemap.php

serpstatbot

Rule Path
Disallow /

openindexspider
surdotlybot
seokicks
serpstatbot
mbcrawler
proximic
anthropic-ai
claude-web
pyspider
ioncrawl
scoop.it
mojeekbot
ccbot
timpibot
zoominfobot
cincraw
sitecheckerbotcrawler
yak
searchmetricsbot
trendictionbot
gnowitnewsbot
wellknownbot
bytespider
hawaiibot
mediatoolkitbot
scoop.it
seekportbot
semanticscholarbot
velenpublicwebcrawler
keys-so-bot
brightbot
exabot
friendly_crawler
friendlycrawler
gnowitnewsbot/2.0
uptimerobot/2.0
awariorssbot
awariosmartbot
brightedge crawler
claudebot
imagesiftbot
geedoproductsearch
turnitinbot
turnitin robot
seznambot
gptbot
yandex
yandexbot
dataforseobot
barkrowler
neevabot
screaming frog seo spider
qwantify
lamarkbot
yacybot
blexbot
colly
nuclei
petalbot
sogou
sogou spider
sogou web spider
ahrefsbot
mj12bot
domaincrawler
garlikcrawler
dotbot
semrushbot
semrushbot-sa
siteauditbot
semrushbot-ba
semrushbot-si
semrushbot-swa
semrushbot-ct
semrushbot-bm
splitsignalbot
semrushbot-coub
httrack
scrapy
cloudflare
zoombot
brandverity
spiderling
cloudflare always online
cloudflare alwaysonline
cloudflare-traffic-manager
cloudflare-alwaysonline
buck
tigerbot
cloudflare-amp
ltx71
ltx71 - (http://ltx71.com/)
linkfluence
bot@linkfluence.net
evc-batch
zgrab
adscanner

Rule Path
Disallow /

Other Records

Field Value
sitemap https://picclick.fr/sitemapindex.xml

Warnings

  • 1 invalid line.