sketboy.com
robots.txt

Robots Exclusion Standard data for sketboy.com

Resource Scan

Scan Details

Site Domain sketboy.com
Base Domain sketboy.com
Scan Status Ok
Last Scan2025-06-03T18:31:38+00:00
Next Scan 2025-07-03T18:31:38+00:00

Last Scan

Scanned2025-06-03T18:31:38+00:00
URL https://sketboy.com/robots.txt
Redirect https://www.sketboy.com/robots.txt
Redirect Domain www.sketboy.com
Redirect Base sketboy.com
Domain IPs 104.21.9.159, 172.67.160.70, 2606:4700:3030::ac43:a046, 2606:4700:3035::6815:99f
Redirect IPs 104.21.9.159, 172.67.160.70, 2606:4700:3030::ac43:a046, 2606:4700:3035::6815:99f
Response IP 104.21.9.159
Found Yes
Hash b32dccd5ab3e017ff283392a964a4eb95d842671a0c35a5905cf6bdf54aa1612
SimHash 494dd382c590

Groups

*

Rule Path
Allow /
Disallow *buy_download%3D*
Disallow *buy_stream%3D*
Disallow *logout%3D1*
Disallow *sessid%3D*
Disallow *redirect%3D*
Disallow *others%3D1*
Disallow *video_id%3D*
Disallow /*/videos/regarder/*
Disallow /*/videos/my-history
Disallow /*/videos/my-unseen
Disallow /*/videos/i-will-like
Disallow /*/dvd/my-history
Disallow /*/dvd/my-unseen
Disallow /*/dvd/i-will-like
Disallow /en/histoires*
Disallow /es/histoires*
Disallow /it/histoires*
Disallow /de/histoires*

ia_archiver

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.sketboy.com/sitemap.xml