asthub.com
robots.txt
Robots Exclusion Standard data for asthub.com
Resource Scan
Scan Details
| Site Domain | asthub.com |
| Base Domain | asthub.com |
| Scan Status | Ok |
| Last Scan | 2025-09-18T06:27:01+00:00 |
| Next Scan | 2025-10-18T06:27:01+00:00 |
Last Scan
| Scanned | 2025-09-18T06:27:01+00:00 |
| URL | https://asthub.com/robots.txt |
| Redirect | https://www.ashemaletube.com/robots.txt |
| Redirect Domain | www.ashemaletube.com |
| Redirect Base | ashemaletube.com |
| Domain IPs | 104.21.52.29, 172.67.194.156, 2606:4700:3031::6815:341d, 2606:4700:3032::ac43:c29c |
| Redirect IPs | 104.20.23.181, 172.66.148.2, 2606:4700:10::6814:17b5, 2606:4700:10::ac42:9402 |
| Response IP | 172.66.148.2 |
| Found | Yes |
| Hash | 7788ad78e7d6c31670e98f007eb708bb9001efc2a60ec86542469d0c45402f1e |
| SimHash | 404c5c18c557 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*?c= |
| Disallow | /*ajax- |
| Disallow | /profiles/ |
| Disallow | /link/out/ |
| Disallow | /switch/ |
| Disallow | /version/ |
| Disallow | /login/ |
| Disallow | /registration/ |
| Disallow | /support/ |
| Disallow | /abuse/ |
| Disallow | /advertise/ |
| Disallow | /takedown/ |
| Disallow | /contactus/ |
| Disallow | /*search* |
| Disallow | *?modelsearchSubmitCheck |
| Disallow | /login.php |
| Disallow | /*cgi-bin/ |
| Disallow | /best-galleries |
| Disallow | /best-videos |
| Disallow | /*lang%3D |
| Disallow | /embed/ |
| Disallow | /model/*/fans |
| Disallow | /documents/ |
| Disallow | /de/ |
| Disallow | /ru/ |
| Disallow | /es/ |
| Disallow | /ja/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://cdn77.ashemaletube.com/sitemaps/ashemaletube.com/sitemaps.xml |