ssangyongklub.pl
robots.txt

Robots Exclusion Standard data for ssangyongklub.pl

Resource Scan

Scan Details

Site Domain ssangyongklub.pl
Base Domain ssangyongklub.pl
Scan Status Ok
Last Scan2024-09-28T11:55:32+00:00
Next Scan 2024-10-05T11:55:32+00:00

Last Scan

Scanned2024-09-28T11:55:32+00:00
URL https://ssangyongklub.pl/robots.txt
Domain IPs 104.21.62.72, 172.67.221.18, 2606:4700:3037::6815:3e48, 2606:4700:3037::ac43:dd12
Response IP 104.21.62.72
Found Yes
Hash 3eca1ce15152f2436745277fddf795e50acf64dd6fa757bc2fafe6232268a32f
SimHash 7b1d4a918782

Groups

tinytestbot

Rule Path
Disallow /

statuscake_pagespeed_indev

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

seostar

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

seekport

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

lcc

Rule Path
Disallow /

discoverybot

Rule Path
Disallow /

marketingtracer

Rule Path
Disallow /

tigerbot

Rule Path
Disallow /

stormcrawler

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

olbicobot

Rule Path
Disallow /

matchorybot

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

opteobot

Rule Path
Disallow /

geedobot

Rule Path
Disallow /

yandexmetrika

Rule Path
Disallow /

crawler_eb_germany

Rule Path
Disallow /

deepnoc

Rule Path
Disallow /

roboter

Rule Path
Disallow /

sidetrade

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

atomseobot

Rule Path
Disallow /

tmmbot

Rule Path
Disallow /

friendlycrawler

Rule Path
Disallow /

wiederfreibot

Rule Path
Disallow /

seekport

Rule Path
Disallow /

metajobbot

Rule Path
Disallow /

duckduckgo

Rule Path
Disallow /

dnbcrawler-analytics

Rule Path
Disallow /

infotigerbot

Rule Path
Disallow /

coccocbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

duckduckbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

startmebot

Rule Path
Disallow /

arquivo

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

crazywebcrawler-spider

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

*

Rule Path
Disallow