phantastor.de
robots.txt

Robots Exclusion Standard data for phantastor.de

Resource Scan

Scan Details

Site Domain phantastor.de
Base Domain phantastor.de
Scan Status Ok
Last Scan2024-06-27T21:39:16+00:00
Next Scan 2024-07-27T21:39:16+00:00

Last Scan

Scanned2024-06-27T21:39:16+00:00
URL https://phantastor.de/robots.txt
Redirect https://www.phantastor.de/robots.txt
Redirect Domain www.phantastor.de
Redirect Base phantastor.de
Domain IPs 37.218.255.35
Redirect IPs 37.218.255.35
Response IP 37.218.255.35
Found Yes
Hash a5ec34b0afdd9e3e1a5214e12e294316f6fd4a3cf62cff62464698895bea8162
SimHash 16576258de10

Groups

bingbot

Rule Path
Disallow /

adidxbot

Rule Path
Disallow /

bingpreview

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

iccrawler - icjobs

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

speedy

Rule Path
Disallow /

aboutusbot

Rule Path
Disallow /

adshadow

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

builtwith

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

websitewiki

Rule Path
Disallow /

psbot

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandex bot

Rule Path
Disallow /