clickthruserver.com
robots.txt

Robots Exclusion Standard data for clickthruserver.com

Resource Scan

Scan Details

Site Domain clickthruserver.com
Base Domain clickthruserver.com
Scan Status Ok
Last Scan2025-05-26T09:46:10+00:00
Next Scan 2025-06-25T09:46:10+00:00

Last Scan

Scanned2025-05-26T09:46:10+00:00
URL https://clickthruserver.com/robots.txt
Redirect https://www.freeones.com/robots.txt
Redirect Domain www.freeones.com
Redirect Base freeones.com
Domain IPs 45.32.2.91, 45.32.2.92, 45.32.2.93, 45.32.2.94
Redirect IPs 45.32.2.91, 45.32.2.92, 45.32.2.93, 45.32.2.94
Response IP 144.178.205.183
Found Yes
Hash ae0c8d266539e4fcc554a89780acc72d517101566a3fe5a5b9287c076257f779
SimHash 250a101a8913

Groups

*

Rule Path
Disallow /roulette
Disallow /babes-change/*
Disallow /*s%3D
Disallow /*o%3D
Disallow /*l%3D
Disallow /*performer-add
Disallow /*submit-new-link
Disallow /*claim-profile
Disallow /*claim-donation
Disallow /*xhr/
Disallow /*my/
Disallow /*download
Disallow /*upload-media
Disallow /*donate-credits
Disallow /*purchase
Disallow /*autoplay
Disallow /search$
Disallow /nl/zoeken$
Disallow /de/suche$
Disallow /es/buscar$
Disallow /fr/chercher$
Disallow /pt/procurar$
Disallow /it/ricerca$
Disallow /*p%3D1$

Other Records

Field Value
sitemap https://www.freeones.com/sitemap.xml

Comments

  • Sitemap
  • Roulette
  • Babe change page
  • Disallow first page on pagination