sportytrader.com
robots.txt
Robots Exclusion Standard data for sportytrader.com
Resource Scan
Scan Details
Site Domain | sportytrader.com |
Base Domain | sportytrader.com |
Scan Status | Ok |
Last Scan | 2025-04-07T00:49:54+00:00 |
Next Scan | 2025-05-07T00:49:54+00:00 |
Last Scan
Scanned | 2025-04-07T00:49:54+00:00 |
URL | https://sportytrader.com/robots.txt |
Redirect | https://www.sportytrader.com/robots.txt |
Redirect Domain | www.sportytrader.com |
Redirect Base | sportytrader.com |
Domain IPs | 104.18.12.181, 104.18.13.181, 2606:4700::6812:cb5, 2606:4700::6812:db5 |
Redirect IPs | 104.18.12.181, 104.18.13.181, 2606:4700::6812:cb5, 2606:4700::6812:db5 |
Response IP | 104.18.12.181 |
Found | Yes |
Hash | 8567f6420a061eac55f9ac014b184af030437ede419171b741f23e436ba07237 |
SimHash | a93488d8bc67 |
Groups
*
Rule | Path |
---|---|
Disallow | /mobile/ |
Disallow | /meilleur/ |
Disallow | /book/ |
Disallow | /async/ |
Disallow | /widgets/ |
Disallow | /*/preview/ |
Disallow | /fr-cd/ |
Disallow | /check/ |
Disallow | /link/ |
Disallow | /en/book/ |
Disallow | /en/async/ |
Disallow | /en/widgets/ |
Disallow | /pt-br/book/ |
Disallow | /pt-br/async/ |
Disallow | /pt-br/widgets/ |
Allow | /fr-be/bookmakers/ |
Allow | /en-ng/betting-sites/ |
Allow | /en-za/betting-sites/ |
Allow | /en-ng/betting-sites/ |
Allow | /en-in/betting-sites/ |
Allow | /en-gb/betting-sites/ |
Allow | /es-co/casas-apuestas/ |
Allow | /es-pe/casas-apuestas/ |
Allow | /en-ng/news/ |
Allow | /en-za/news/ |
Allow | /en-in/news/ |
Allow | /en-gb/news/ |
Disallow | /fr-be/ |
Disallow | /en-ng/ |
Disallow | /en-za/ |
Disallow | /en-in/ |
Disallow | /en-gb/ |
Disallow | /es-co/ |
Disallow | /es-pe/ |
Disallow | /app.php |
Disallow | /app.php/ |
Disallow | /app.php/en/ |
Disallow | /app.php/fr-be/ |
Disallow | /app.php/en-ng/ |
Disallow | /app.php/en-za/ |
Disallow | /cdn-cgi/ |
Disallow | /es/book/ |
Disallow | /es/async/ |
Disallow | /es/widgets/ |
Disallow | /en-in/book/ |
Disallow | /en-za/book/ |
Disallow | /en-ng/book/ |
Disallow | /en-gb/book/ |
Disallow | /us/book/ |