xmas4u.de
robots.txt
Robots Exclusion Standard data for xmas4u.de
Resource Scan
Scan Details
| Site Domain | xmas4u.de |
| Base Domain | xmas4u.de |
| Scan Status | Ok |
| Last Scan | 2024-10-02T15:33:37+00:00 |
| Next Scan | 2024-10-16T15:33:37+00:00 |
Last Scan
| Scanned | 2024-10-02T15:33:37+00:00 |
| URL | https://xmas4u.de/robots.txt |
| Domain IPs | 80.243.46.49 |
| Response IP | 80.243.46.49 |
| Found | Yes |
| Hash | 9789bd70e996fed58a370796891fcb48594cd1a036fea28b318932379dc9cbee |
| SimHash | 3f560a708dd2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*/adm/ |
| Disallow | /*/admin/ |
| Disallow | /*/*admin/ |
| Disallow | /*/temp/ |
| Disallow | /*/tmp/ |
| Disallow | /*/*test/ |
| Disallow | /api/ |
| Disallow | /interfaces/ |
| Disallow | /*.pdf$ |
| Disallow | /*.psd$ |
| Disallow | /*.csv$ |
| Disallow | /*.xls$ |
| Disallow | /*.sql$ |
ahrefsbot
baiduspider
barkrowler
blexbot
bytespider
ccbot
chatgpt
chatgpt-user
classmarkets
claudebot
coccocbot
corpora
criteobot
dataforseobot
dotbot
emailcollector
flamingo_searchengine
go-http-client
gptbot
grapeshotcrawler
gumgum
guzzlehttp
httrack
ias_crawler
kstandbot
lcc
mj12bot
newslitbot
oai-searchbot
paloaltonetworks
penthesilea
petalbot
proximic
qwantbot
rentola
repolookoutbot
scrapy
semrushbot
seokicks
serpstatbot
seznambot
sirdatabot
startmebot
surdotlybot
telegrambot
trendictionbot
ttd-content
uptimerobot
velenpublicwebcrawler
verity/1.1
webcopier
webreaper
yandexbot
zoombot
| Rule | Path |
|---|---|
| Disallow | / |
Comments