astars.tv
robots.txt

Robots Exclusion Standard data for astars.tv

Resource Scan

Scan Details

Site Domain astars.tv
Base Domain astars.tv
Scan Status Ok
Last Scan2025-10-30T11:03:34+00:00
Next Scan 2025-11-06T11:03:34+00:00

Last Scan

Scanned2025-10-30T11:03:34+00:00
URL https://astars.tv/robots.txt
Redirect https://animestars.org/robots.txt
Redirect Domain animestars.org
Redirect Base animestars.org
Domain IPs 54.215.31.113
Redirect IPs 104.26.8.138, 104.26.9.138, 172.67.71.90, 2606:4700:20::681a:88a, 2606:4700:20::681a:98a, 2606:4700:20::ac43:475a
Response IP 104.26.9.138
Found Yes
Hash cd5a882fe9e04dda6633f4d62746f44ed108b79d541977cfc982a850d655dbfa
SimHash c10c90794631

Groups

*

Rule Path
Disallow /engine/go.php
Disallow /user/
Disallow /newposts/
Disallow /statistics.html
Disallow /*subaction%3Duserinfo
Disallow /*subaction%3Dnewposts
Disallow /*do%3Dlastcomments
Disallow /*do%3Dfeedback
Disallow /*do%3Dregister
Disallow /*do%3Dlostpassword
Disallow /*do%3Daddnews
Disallow /*do%3Dstats
Disallow /*do%3Dpm
Disallow /*do%3Dsearch
Disallow /*do%3Ddownload
Disallow /*do%3Dgo
Disallow /?*
Disallow /rules.html
Disallow */f/
Disallow /xfsearch/producer/
Disallow /pm/*
Disallow */page/*
Disallow /page/*/?*
Disallow /*/page/*/?*
Disallow /%26*
Disallow /shop/*
Disallow /premium/
Disallow /trades/*
Disallow /decks/*
Disallow /clubs/*

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

criteobot/0.1

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

Other Records

Field Value
sitemap https://animestars.org/sitemap.xml

Warnings

  • `host` is not a known field.