Log In Sign Up

sportytipz.com
robots.txt

Robots Exclusion Standard data for sportytipz.com

Resource Scan

Scan Details

Site Domain sportytipz.com
Base Domain sportytipz.com
Scan Status Ok
Last Scan5/21/2025, 2:45:47 AM
Next Scan 6/20/2025, 2:45:47 AM

Last Scan

Scanned5/21/2025, 2:45:47 AM
URL https://sportytipz.com/robots.txt
Redirect https://www.sportytipz.com/robots.txt
Redirect Domain www.sportytipz.com
Redirect Base sportytipz.com
Domain IPs 104.21.67.76, 172.67.218.109, 2606:4700:3034::ac43:da6d, 2606:4700:3037::6815:434c
Redirect IPs 104.21.67.76, 172.67.218.109, 2606:4700:3034::ac43:da6d, 2606:4700:3037::6815:434c
Response IP 104.21.67.76
Found Yes
Hash a2e97e5dd42f9d8a20ae65523537af0c84fb7129224e1b62f63732924465ebe8
SimHash 2c1c541606a0

Groups

*

Rule Path
Disallow
Disallow /admin/
Disallow /login/
Disallow /private/
Disallow /tmp/
Disallow /*?type=
Disallow /*?page=
Disallow /*?dt=
Disallow /*?date=
Disallow /*index.php

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

badbot

Rule Path
Disallow /
Disallow /*?sessionid=
Disallow /*?sort=

*

Rule Path
Allow /*.css$
Allow /*.js$
Allow /*.jpg$
Allow /*.png$
Allow /*.gif$
Allow /*.svg$
Allow /*.xml$
Allow /*.json$
Allow /*.txt$
Back to top

Other Records

Field Value
sitemap https://sportytipz.com/sitemap.xml
Back to top

Comments

  • Disallow specific directories
  • Disallow URLs with specific query parameters
  • Disallow URLs with index.php in the path
  • Specific user-agent rules
  • Disallow sessionid and sort query parameters
  • Allow specific file types
Back to top