ast.tv
robots.txt
Robots Exclusion Standard data for ast.tv
Resource Scan
Scan Details
Site Domain | ast.tv |
Base Domain | ast.tv |
Scan Status | Ok |
Last Scan | 2025-09-23T03:11:03+00:00 |
Next Scan | 2025-10-23T03:11:03+00:00 |
Last Scan
Scanned | 2025-09-23T03:11:03+00:00 |
URL | https://ast.tv/robots.txt |
Redirect | https://www.ast.tv/robots.txt |
Redirect Domain | www.ast.tv |
Redirect Base | ast.tv |
Domain IPs | 45.138.128.185 |
Redirect IPs | 45.138.128.185 |
Response IP | 45.138.128.185 |
Found | Yes |
Hash | 7788ad78e7d6c31670e98f007eb708bb9001efc2a60ec86542469d0c45402f1e |
SimHash | 404c5c18c557 |
Groups
*
Rule | Path |
---|---|
Disallow | /*?c= |
Disallow | /*ajax- |
Disallow | /profiles/ |
Disallow | /link/out/ |
Disallow | /switch/ |
Disallow | /version/ |
Disallow | /login/ |
Disallow | /registration/ |
Disallow | /support/ |
Disallow | /abuse/ |
Disallow | /advertise/ |
Disallow | /takedown/ |
Disallow | /contactus/ |
Disallow | /*search* |
Disallow | *?modelsearchSubmitCheck |
Disallow | /login.php |
Disallow | /*cgi-bin/ |
Disallow | /best-galleries |
Disallow | /best-videos |
Disallow | /*lang%3D |
Disallow | /embed/ |
Disallow | /model/*/fans |
Disallow | /documents/ |
Disallow | /de/ |
Disallow | /ru/ |
Disallow | /es/ |
Disallow | /ja/ |
Other Records
Field | Value |
---|---|
sitemap | https://cdn77.ashemaletube.com/sitemaps/ashemaletube.com/sitemaps.xml |