sportytrader.com
robots.txt

Robots Exclusion Standard data for sportytrader.com

Resource Scan

Scan Details

Site Domain sportytrader.com
Base Domain sportytrader.com
Scan Status Ok
Last Scan2025-04-07T00:49:54+00:00
Next Scan 2025-05-07T00:49:54+00:00

Last Scan

Scanned2025-04-07T00:49:54+00:00
URL https://sportytrader.com/robots.txt
Redirect https://www.sportytrader.com/robots.txt
Redirect Domain www.sportytrader.com
Redirect Base sportytrader.com
Domain IPs 104.18.12.181, 104.18.13.181, 2606:4700::6812:cb5, 2606:4700::6812:db5
Redirect IPs 104.18.12.181, 104.18.13.181, 2606:4700::6812:cb5, 2606:4700::6812:db5
Response IP 104.18.12.181
Found Yes
Hash 8567f6420a061eac55f9ac014b184af030437ede419171b741f23e436ba07237
SimHash a93488d8bc67

Groups

ia_archiver

Rule Path
Disallow /

*

Rule Path
Disallow /mobile/
Disallow /meilleur/
Disallow /book/
Disallow /async/
Disallow /widgets/
Disallow /*/preview/
Disallow /fr-cd/
Disallow /check/
Disallow /link/
Disallow /en/book/
Disallow /en/async/
Disallow /en/widgets/
Disallow /pt-br/book/
Disallow /pt-br/async/
Disallow /pt-br/widgets/
Allow /fr-be/bookmakers/
Allow /en-ng/betting-sites/
Allow /en-za/betting-sites/
Allow /en-ng/betting-sites/
Allow /en-in/betting-sites/
Allow /en-gb/betting-sites/
Allow /es-co/casas-apuestas/
Allow /es-pe/casas-apuestas/
Allow /en-ng/news/
Allow /en-za/news/
Allow /en-in/news/
Allow /en-gb/news/
Disallow /fr-be/
Disallow /en-ng/
Disallow /en-za/
Disallow /en-in/
Disallow /en-gb/
Disallow /es-co/
Disallow /es-pe/
Disallow /app.php
Disallow /app.php/
Disallow /app.php/en/
Disallow /app.php/fr-be/
Disallow /app.php/en-ng/
Disallow /app.php/en-za/
Disallow /cdn-cgi/
Disallow /es/book/
Disallow /es/async/
Disallow /es/widgets/
Disallow /en-in/book/
Disallow /en-za/book/
Disallow /en-ng/book/
Disallow /en-gb/book/
Disallow /us/book/

textbulkerbot

Rule Path
Disallow /