rafian.com
robots.txt
Robots Exclusion Standard data for rafian.com
Resource Scan
Scan Details
| Site Domain | rafian.com |
| Base Domain | rafian.com |
| Scan Status | Ok |
| Last Scan | 2025-08-17T21:34:22+00:00 |
| Next Scan | 2025-09-16T21:34:22+00:00 |
Last Scan
| Scanned | 2025-08-17T21:34:22+00:00 |
| URL | https://rafian.com/robots.txt |
| Domain IPs | 104.21.71.235, 172.67.172.22, 2606:4700:3030::6815:47eb, 2606:4700:3034::ac43:ac16 |
| Response IP | 104.21.71.235 |
| Found | Yes |
| Hash | 1979c32eb37c66c59c0b48a96681481e3e4779a4e0bec928c5318644c9e7aec0 |
| SimHash | e86608bec9c0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /porn/*/most-viewed |
| Disallow | /porn/*/updates |
| Disallow | /porn/*/long |
| Disallow | /porn/*/top-rated |
| Disallow | /porn/*/most-viewed/* |
| Disallow | /porn/*/updates/* |
| Disallow | /porn/*/long/* |
| Disallow | /porn/*/top-rated/* |
| Disallow | /model/*/most-viewed |
| Disallow | /model/*/updates |
| Disallow | /model/*/long |
| Disallow | /model/*/top-rated |
| Disallow | /model/*/most-viewed/* |
| Disallow | /model/*/updates/* |
| Disallow | /model/*/long/* |
| Disallow | /model/*/top-rated/* |
| Disallow | /site/*/most-viewed |
| Disallow | /site/*/updates |
| Disallow | /site/*/long |
| Disallow | /site/*/top-rated |
| Disallow | /site/*/most-viewed/* |
| Disallow | /site/*/updates/* |
| Disallow | /site/*/long/* |
| Disallow | /site/*/top-rated/* |
| Disallow | *?mycountry= |
| Disallow | *?mycountry=* |
| Disallow | *?x=true |
| Disallow | *interstitial?id= |
| Disallow | *interstitial?id=* |
| Disallow | *filter%3D |
| Disallow | *filter%3D* |
| Disallow | *sort%3D |
| Disallow | *sort%3D* |
| Disallow | /recommended |
| Disallow | /history |
| Disallow | /favorites |
| Disallow | /buffer* |
| Disallow | /testtesttest* |