a.yaqot.me
robots.txt
Robots Exclusion Standard data for a.yaqot.me
Resource Scan
Scan Details
Site Domain | a.yaqot.me |
Base Domain | yaqot.me |
Scan Status | Ok |
Last Scan | 2025-10-11T19:41:16+00:00 |
Next Scan | 2025-11-10T19:41:16+00:00 |
Last Scan
Scanned | 2025-10-11T19:41:16+00:00 |
URL | https://a.yaqot.me/robots.txt |
Redirect | https://r.yaqot.net/robots.txt |
Redirect Domain | r.yaqot.net |
Redirect Base | yaqot.net |
Domain IPs | 104.21.72.111, 172.67.182.16, 2606:4700:3031::ac43:b610, 2606:4700:3035::6815:486f |
Redirect IPs | 104.21.5.81, 172.67.133.50, 2606:4700:3030::ac43:8532, 2606:4700:3032::6815:551 |
Response IP | 104.21.5.81 |
Found | Yes |
Hash | 8b78270d810cc64fa7b94961664778f879a932dad2ec13de6991b8ad51ebad93 |
SimHash | 0c76531c6397 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /cPanel/ |
Disallow | /email_template/ |
Disallow | /include/ |
Disallow | /js/ |
Disallow | /lang/ |
Disallow | /players/ |
Disallow | /plugins/ |
Disallow | /Smarty/ |
Disallow | /404.php |
Disallow | /ajax.php |
Disallow | /ajax_search.php |
Disallow | /censor_words.txt |
Disallow | /comment.php |
Disallow | /config.php |
Disallow | /cron.php |
Disallow | /view.php |
Disallow | /edit-video.php |
Disallow | /edit_profile.php |
Disallow | /emoji-help.php |
Disallow | /fpembed.php |
Disallow | /login.php |
Disallow | /register.php |
Disallow | /relatedclips.php |
Disallow | /social-thumb.php |
Disallow | /suggest.php |
Disallow | /upload.php |
Disallow | /user.php |
Disallow | /videoads.php |
Disallow | /topvideos.php |
Disallow | /mobile/ |
Disallow | /view.php |
Disallow | /play.php |
Disallow | *sortby%3D* |
Disallow | *order%3D* |
Allow | /uploads/thumbs |
*
Rule | Path |
---|---|
Disallow |
Other Records
Field | Value |
---|---|
sitemap | https://ser.yaqot.net/sitemap-index.xml |
sitemap | https://ser.yaqot.net/video-sitemap-index.xml |