domodi.pl
robots.txt

Robots Exclusion Standard data for domodi.pl

Resource Scan

Scan Details

Site Domain domodi.pl
Base Domain domodi.pl
Scan Status Ok
Last Scan2024-06-02T09:56:45+00:00
Next Scan 2024-06-09T09:56:45+00:00

Last Scan

Scanned2024-06-02T09:56:45+00:00
URL https://domodi.pl/robots.txt
Domain IPs 193.222.135.31, 193.222.135.32
Response IP 193.222.135.32
Found Yes
Hash e78a334178dcb2a8709946223e23cf27a1bd13d6642046db68e94b819416c627
SimHash b19e5943cf27

Groups

*

Rule Path
Disallow /kreatorkolekcji/
Disallow /kreatorkolekcji
Disallow przejdz?*
Disallow /przejdz
Disallow /przejdz/
Disallow /banned/
Disallow *?Sort=*
Disallow /account/
Disallow /product/
Disallow /profile
Disallow /profile/
Disallow /profile/scenes/*
Disallow /profile/followers/*
Disallow /profile/like/*
Disallow /look/morelike/*
Disallow /set/morelike/*
Disallow /user/morelike/*
Disallow /jsnlog2.logger
Disallow /przejdz?url=*
Disallow *%26Skip%3D*

baiduspider

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

rogerbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

lexxebot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

libwww-perl

Rule Path
Disallow /

Other Records

Field Value
sitemap https://domodi.pl/sitemap/sitemap.xml