morepredict.com
robots.txt

Robots Exclusion Standard data for morepredict.com

Resource Scan

Scan Details

Site Domain morepredict.com
Base Domain morepredict.com
Scan Status Ok
Last Scan2025-11-15T08:32:55+00:00
Next Scan 2025-12-15T08:32:55+00:00

Last Scan

Scanned2025-11-15T08:32:55+00:00
URL https://morepredict.com/robots.txt
Domain IPs 104.21.59.230, 172.67.184.213, 2606:4700:3030::ac43:b8d5, 2606:4700:3036::6815:3be6
Response IP 104.21.59.230
Found Yes
Hash 4f3d6fac3d65555aa9f31aa4bcd7200d8c8ab0e1e9bd46f1351d90b7489b6441
SimHash 2c1d111606f0

Groups

*

Rule Path
Disallow
Disallow /admin/
Disallow /login/
Disallow /private/
Disallow /tmp/
Disallow /*?type=
Disallow /*?page=
Disallow /*?dt=
Disallow /*?date=
Disallow /*index.php

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

badbot

Rule Path
Disallow /
Disallow /*?sessionid=
Disallow /*?sort=
Allow /*.css$
Allow /*.js$
Allow /*.jpg$
Allow /*.png$
Allow /*.gif$
Allow /*.svg$
Allow /*.xml$
Allow /*.json$
Allow /*.txt$

Other Records

Field Value
sitemap https://morepredict.com/sitemap.xml

Comments

  • Disallow specific directories
  • Disallow URLs with specific query parameters
  • Disallow URLs with index.php in the path
  • Specific user-agent rules
  • Disallow sessionid and sort query parameters
  • Allow specific file types