xxxarabgirls.com
robots.txt
Robots Exclusion Standard data for xxxarabgirls.com
Resource Scan
Scan Details
| Site Domain | xxxarabgirls.com |
| Base Domain | xxxarabgirls.com |
| Scan Status | Ok |
| Last Scan | 4/4/2025, 6:41:28 PM |
| Next Scan | 5/4/2025, 6:41:28 PM |
Last Scan
| Scanned | 4/4/2025, 6:41:28 PM |
| URL | https://xxxarabgirls.com/robots.txt |
| Redirect | https://www.xxxarabgirls.com/robots.txt |
| Redirect Domain | www.xxxarabgirls.com |
| Redirect Base | xxxarabgirls.com |
| Domain IPs | 104.21.44.91, 172.67.198.59, 2606:4700:3033::ac43:c63b, 2606:4700:3036::6815:2c5b |
| Redirect IPs | 104.21.44.91, 172.67.198.59, 2606:4700:3033::ac43:c63b, 2606:4700:3036::6815:2c5b |
| Response IP | 104.21.44.91 |
| Found | Yes |
| Hash | 71a6f22242c791e160d8dd2361435239500cd06ab2900a264d5c5bc3f449e2c6 |
| SimHash | 692515d59086 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | *blog/page-*$ |
| Allow | *shorts/page-*$ |
| Disallow | /*?enableVideoOnly |
| Disallow | /*?openedCommentMenu |
| Disallow | /*?openedMenu |
| Disallow | /cdn-cgi/ |
| Disallow | /directory/ |
| Disallow | /*/hentai/* |
| Disallow | /hentai/* |
| Disallow | /*/milf/* |
| Disallow | /milf/* |
| Disallow | /*/girls/* |
| Disallow | /girls/* |
| Disallow | /*/porn/* |
| Disallow | /porn/* |
| Disallow | /*/celeb/* |
| Disallow | /celeb/* |
| Disallow | /*/xxx-porn/* |
| Disallow | /xxx-porn/* |
| Disallow | /*/order-porn/* |
| Disallow | /order-porn/* |
| Disallow | /*/order-form/* |
| Disallow | /order-form/* |
| Disallow | /*/order/* |
| Disallow | /order/* |
| Disallow | /*/top-rated-porn/* |
| Disallow | /top-rated-porn/* |
| Disallow | /*/my-porn/* |
| Disallow | /my-porn/* |
| Disallow | /*/best-porn/* |
| Disallow | /best-porn/* |
| Disallow | /*/category/* |
| Disallow | /category/* |
| Disallow | /*/report/* |
| Disallow | /*/report |
| Disallow | /report/* |
| Disallow | /report |
| Disallow | /xxx-category/search/ |
| Disallow | /embed/ |
| Disallow | */page/ |
| Disallow | */page-*$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.xxxarabgirls.com/sitemap-xxxarabgirls.xml |
| sitemap | https://www.xxxarabgirls.com/sitemap-media-xxxarabgirls-index.xml |
| sitemap | https://www.xxxarabgirls.com/sitemap-trending-xxxarabgirls-index.xml |
| sitemap | https://www.xxxarabgirls.com/sitemap-tags-xxxarabgirls.xml |
| sitemap | https://www.xxxarabgirls.com/sitemap-collections-xxxarabgirls.xml |
Comments