crossclip.com
robots.txt

Robots Exclusion Standard data for crossclip.com

Resource Scan

Scan Details

Site Domain crossclip.com
Base Domain crossclip.com
Scan Status Ok
Last Scan2024-09-22T19:48:29+00:00
Next Scan 2024-10-06T19:48:29+00:00

Last Scan

Scanned2024-09-22T19:48:29+00:00
URL https://crossclip.com/robots.txt
Redirect https://streamlabs.com/robots.txt
Redirect Domain streamlabs.com
Redirect Base streamlabs.com
Domain IPs 104.27.203.89, 104.27.204.89, 2606:4700:21::681b:cb59, 2606:4700:21::681b:cc59
Redirect IPs 104.16.143.22, 104.16.144.22, 2606:4700::6810:8f16, 2606:4700::6810:9016
Response IP 104.16.143.22
Found Yes
Hash 1a1199290ecba7ad4b595207d6a3a66da8935094435e347ff22fd0edec8770f7
SimHash 39080055ebb3

Groups

*

Rule Path
Allow /
Disallow /widgets/*
Disallow /alert-box/*
Disallow /logout*
Disallow /emoticons/*
Disallow /slobs/download*
Disallow /slobs/slobs-download*
Disallow /streamlabs-obs/login-success*
Disallow /best-donation-clips/*
Disallow /api/*

Other Records

Field Value
sitemap https://streamlabs.com/sitemap.xml
sitemap https://cms-marketing.streamlabs.com/sitemap.xml