pepeta.com
robots.txt

Robots Exclusion Standard data for pepeta.com

Resource Scan

Scan Details

Site Domain pepeta.com
Base Domain pepeta.com
Scan Status Ok
Last Scan2024-11-11T04:43:26+00:00
Next Scan 2024-11-25T04:43:26+00:00

Last Scan

Scanned2024-11-11T04:43:26+00:00
URL https://pepeta.com/robots.txt
Domain IPs 104.18.37.208, 172.64.150.48, 2606:4700:4400::6812:25d0, 2606:4700:4400::ac40:9630
Response IP 172.64.150.48
Found Yes
Hash f4f662b9a65018192567877895158af28887de061f323b9993f807ebc3bdd316
SimHash 8521e5d66dd4

Groups

*

Rule Path
Disallow
Disallow */my-bets$
Disallow */my-bets/*
Disallow */sports$
Disallow */sports/live$
Disallow */sports/live/*
Disallow */boosted-odds$
Disallow */player-to-score$
Disallow */profile$
Disallow */profile/*
Disallow */casino-games/casino/*
Disallow */more-games$
Disallow */pepeta$
Disallow */forgot-password$
Disallow *referral%3D*

Comments

  • https://www.robotstxt.org/robotstxt.html
  • Above line allows all except those explicitly disallowed below, with exceptions via Allow