megapeer.vip
robots.txt
Robots Exclusion Standard data for megapeer.vip
Resource Scan
Scan Details
Site Domain | megapeer.vip |
Base Domain | megapeer.vip |
Scan Status | Ok |
Last Scan | 2025-09-05T19:48:27+00:00 |
Next Scan | 2025-10-05T19:48:27+00:00 |
Last Scan
Scanned | 2025-09-05T19:48:27+00:00 |
URL | https://megapeer.vip/robots.txt |
Domain IPs | 104.21.23.95, 172.67.210.40, 2606:4700:3034::6815:175f, 2606:4700:3035::ac43:d228 |
Response IP | 172.67.210.40 |
Found | Yes |
Hash | 6705f0549b98157200aeca326ede651c9735bb35c5002b73fb163144f264e295 |
SimHash | 250583425790 |
Groups
archive.org_bot
bingbot
duckduckbot
googlebot
googlebot-mobile
ia_archiver
yandex
Rule | Path |
---|---|
Allow | /$ |
Allow | /robots.txt |
Allow | /rss |
Allow | /themes/red/red.css |
Allow | /mega/ |
Allow | /js/ |
Allow | /pic/ |
Allow | /favicon.ico |
Allow | /*.xml |
Allow | /alltorrents |
Allow | /browse.php |
Allow | /torrent/ |
Allow | /tag/ |
Allow | /top |
Allow | /post/ |
Disallow | / |
adsbot-google
ahrefsbot
googlebot-image
mail.ru
mediapartners-google
msnbot
msnbot-media
slurp
stackrambler
yahoo-mmcrawler
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Disallow | / |