pressakey.com
robots.txt

Robots Exclusion Standard data for pressakey.com

Resource Scan

Scan Details

Site Domain pressakey.com
Base Domain pressakey.com
Scan Status Ok
Last Scan2024-10-17T03:28:10+00:00
Next Scan 2024-11-16T03:28:10+00:00

Last Scan

Scanned2024-10-17T03:28:10+00:00
URL https://pressakey.com/robots.txt
Domain IPs 88.99.62.10
Response IP 88.99.62.10
Found Yes
Hash 8a82d3c908c4d1a405764ab341427fa3e41e2f5611765257154c01660ada7dc8
SimHash 4b155050f720

Groups

ccbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ioncrawl

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

surdotlybot/

Rule Path
Disallow /

hypestat

Rule Path
Disallow /

dataprovider

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

paracrawl

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

linguee

Rule Path
Disallow /

daum

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

nibbler

Rule Path
Disallow /

infotigerbot

Rule Path
Disallow /

adidxbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

yandexcalendar

Rule Path
Disallow /

yandexadnet

Rule Path
Disallow /

yandexblogs

Rule Path
Disallow /

yandexdirect

Rule Path
Disallow /

yandexdirectdyn

Rule Path
Disallow /

yadirectfetcher

Rule Path
Disallow /

yandeximageresizer

Rule Path
Disallow /

yandexmarket

Rule Path
Disallow /

yandexmedia

Rule Path
Disallow /

yandexmetrika

Rule Path
Disallow /

yandexvideo

Rule Path
Disallow /

yandexvideoparser

Rule Path
Disallow /

yandextracker

Rule Path
Disallow /

yandexspravbot

Rule Path
Disallow /

yandexsearchshop

Rule Path
Disallow /

yandexontodbapi

Rule Path
Disallow /

yandexontodb

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

metajobbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

linespider

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

obot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

checkmarknetwork/1.0 (+https://www.checkmarknetwork.com/spider.html)

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /community/

ahrefsbot

Rule Path
Disallow /*.jpg$
Disallow /*.png$
Disallow /*.pdf$
Disallow /*.webp$
Disallow /community/
Disallow /inc_soundtracks/
Disallow /downloads/
Disallow /*?PHPSESSID
Disallow /videohtml5.php*
Disallow /suche.php*

Other Records

Field Value
crawl-delay 1

sistrix

Rule Path
Disallow /*.jpg$
Disallow /*.png$
Disallow /*.pdf$
Disallow /*.webp$
Disallow /community/
Disallow /inc_soundtracks/
Disallow /downloads/
Disallow /*?PHPSESSID
Disallow /videohtml5.php*
Disallow /suche.php*

Other Records

Field Value
crawl-delay 5

semrushbot

Rule Path
Disallow /*.jpg$
Disallow /*.png$
Disallow /*.pdf$
Disallow /*.webp$
Disallow /community/
Disallow /inc_soundtracks/
Disallow /downloads/
Disallow /*?PHPSESSID
Disallow /videohtml5.php*
Disallow /suche.php*

Other Records

Field Value
crawl-delay 5

xovibot

Rule Path
Disallow /*.jpg$
Disallow /*.png$
Disallow /*.pdf$
Disallow /*.webp$
Disallow /community/
Disallow /inc_soundtracks/
Disallow /downloads/
Disallow /*?PHPSESSID
Disallow /videohtml5.php*
Disallow /suche.php*

Other Records

Field Value
crawl-delay 5

neevabot

Rule Path
Disallow /community/
Disallow /inc_soundtracks/
Disallow /downloads/
Disallow /*?PHPSESSID
Disallow /videohtml5.php*
Disallow /suche.php*

Other Records

Field Value
crawl-delay 10

petalbot

Rule Path
Disallow /community/
Disallow /inc_soundtracks/
Disallow /downloads/
Disallow /*?PHPSESSID
Disallow /videohtml5.php*
Disallow /suche.php*

Other Records

Field Value
crawl-delay 10

dotbot

Rule Path
Disallow /*.jpg$
Disallow /*.png$
Disallow /*.pdf$
Disallow /*.webp$
Disallow /community/
Disallow /inc_soundtracks/
Disallow /downloads/
Disallow /*?PHPSESSID
Disallow /videohtml5.php*
Disallow /suche.php*

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Disallow /inc_soundtracks/
Disallow /inc_games/
Disallow /b/
Disallow /dp/
Disallow */dp/*
Disallow /gp/new-releases/
Disallow /s?n=300992*
Disallow /downloads/
Disallow /*?PHPSESSID
Disallow /suche.php*

*

Rule Path
Disallow /inc_soundtracks/
Disallow /inc_games/
Disallow /downloads/
Disallow /login/
Disallow /*?PHPSESSID
Disallow /suche.php*

Other Records

Field Value
sitemap https://pressakey.com/sitemap.xml