sextfun.com
robots.txt

Robots Exclusion Standard data for sextfun.com

Resource Scan

Scan Details

Site Domain sextfun.com
Base Domain sextfun.com
Scan Status Ok
Last Scan2026-01-20T10:52:02+00:00
Next Scan 2026-02-19T10:52:02+00:00

Last Scan

Scanned2026-01-20T10:52:02+00:00
URL https://sextfun.com/robots.txt
Redirect https://www.sextfun.com/robots.txt
Redirect Domain www.sextfun.com
Redirect Base sextfun.com
Domain IPs 104.26.0.105, 104.26.1.105, 172.67.74.202
Redirect IPs 104.26.0.105, 104.26.1.105, 172.67.74.202
Response IP 104.26.0.105
Found Yes
Hash 1c42964c41c7ad3fc47460949b381b6cf8ef74929dd7f305f35a7f8f3e0638c7
SimHash 881c0dc67370

Groups

*

Rule Path
Disallow /auth/
Disallow /assets/browser-update*.js
Disallow /my/
Disallow /email/
Disallow /session
Disallow /session/
Disallow /admin
Disallow /admin/
Disallow /user-api-key
Disallow /user-api-key/
Disallow /*?api_key*
Disallow /*?*api_key*

mauibot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

seo spider

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file