pegasusknight.com
robots.txt

Robots Exclusion Standard data for pegasusknight.com

Resource Scan

Scan Details

Site Domain pegasusknight.com
Base Domain pegasusknight.com
Scan Status Ok
Last Scan2024-10-21T00:14:14+00:00
Next Scan 2024-11-20T00:14:14+00:00

Last Scan

Scanned2024-10-21T00:14:14+00:00
URL https://www.pegasusknight.com/robots.txt
Domain IPs 104.21.93.200, 172.67.214.91, 2606:4700:3031::6815:5dc8, 2606:4700:3031::ac43:d65b
Response IP 104.21.93.200
Found Yes
Hash ff1a8c4c3f398d1b3df35fa9d9bd790d1f43cde610183f6ff6997211aa60a22a
SimHash 1d5cf1e28399

Groups

baiduspider
baiduspider+
baidumobaider
baiduimagespider
yandex
ia_archiver
yeti
yodaobot
mj12bot
ahrefsbot
barkrowler
blexbot
builtwith
ccbot
icc-crawler
researchscan
livelapbot
seekportbot
semrushbot
serpstatbot
yahoo pipes 1.0
megalodon
amazonbot

Rule Path
Disallow /