freesupertips.com
robots.txt

Robots Exclusion Standard data for freesupertips.com

Resource Scan

Scan Details

Site Domain freesupertips.com
Base Domain freesupertips.com
Scan Status Ok
Last Scan2024-05-22T11:14:18+00:00
Next Scan 2024-06-21T11:14:18+00:00

Last Scan

Scanned2024-05-22T11:14:18+00:00
URL https://freesupertips.com/robots.txt
Redirect https://www.freesupertips.com/robots.txt
Redirect Domain www.freesupertips.com
Redirect Base freesupertips.com
Domain IPs 18.238.243.35, 18.238.243.52, 18.238.243.63, 18.238.243.67
Redirect IPs 151.101.130.133, 151.101.194.133, 151.101.2.133, 151.101.66.133
Response IP 199.232.46.133
Found Yes
Hash 258147d70ffb2ba6245529bd80771812fa40bc87e35e62106bb16f2015e2d3d8
SimHash 682cad413711

Groups

*

Rule Path
Allow /
Disallow /wp-admin/
Disallow /login/
Disallow /ppc-free-bet-archive/
Disallow /previews/?&date=19
Disallow /previews/?&date=200
Disallow /previews/?&date=2018
Disallow /h/
Disallow /feed/
Disallow /tag/
Disallow /team/
Disallow /bookmakers/
Disallow /typeofbet/
Disallow /stat-details/
Disallow /reviews/
Disallow /clubtips/
Disallow /sortable-stats/
Disallow /freebet-redirect/
Disallow /redirect/
Disallow *?ru=*
Disallow *?bookmaker=*
Disallow *affiliateID*
Disallow *bssid*
Disallow *bsmid*
Disallow *encoded*
Disallow *multiple*
Disallow *theIDs*
Disallow *origin%3D*
Disallow *%26filter%3D*

Other Records

Field Value
sitemap https://www.freesupertips.com/sitemap_index.xml
sitemap https://www.freesupertips.com/news-sitemap.xml

Comments

  • TwentySix Digital - Robots.txt Amend - Jan 2019