sudomemo.net
robots.txt

Robots Exclusion Standard data for sudomemo.net

Resource Scan

Scan Details

Site Domain sudomemo.net
Base Domain sudomemo.net
Scan Status Ok
Last Scan2024-09-25T11:23:41+00:00
Next Scan 2024-10-02T11:23:41+00:00

Last Scan

Scanned2024-09-25T11:23:41+00:00
URL https://sudomemo.net/robots.txt
Redirect https://www.sudomemo.net/robots.txt
Redirect Domain www.sudomemo.net
Redirect Base sudomemo.net
Domain IPs 104.21.49.98, 172.67.161.155, 2606:4700:3031::6815:3162, 2606:4700:3036::ac43:a19b
Redirect IPs 151.101.130.217, 151.101.194.217, 151.101.2.217, 151.101.66.217
Response IP 199.232.46.217
Found Yes
Hash d979b2c277ab58abf3f501c5509d5773e70637a8b5c5a50731050bce25501fe4
SimHash c80cc1a368f1

Groups

*

Rule Path
Allow /
Disallow /sudo*
Disallow /ds*
Disallow /watch/embed/*

dotbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /theatre_assets/statistics_mainpage.php
Disallow /example/*

yandex

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /theatre_assets/images/dynamic/*

mj12bot

Rule Path
Disallow /*

ahrefsbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

Comments

  • Sorry Yandex but you didn't play nice