crossclip.com
robots.txt
Robots Exclusion Standard data for crossclip.com
Resource Scan
Scan Details
Site Domain | crossclip.com |
Base Domain | crossclip.com |
Scan Status | Ok |
Last Scan | 2024-09-22T19:48:29+00:00 |
Next Scan | 2024-10-06T19:48:29+00:00 |
Last Scan
Scanned | 2024-09-22T19:48:29+00:00 |
URL | https://crossclip.com/robots.txt |
Redirect | https://streamlabs.com/robots.txt |
Redirect Domain | streamlabs.com |
Redirect Base | streamlabs.com |
Domain IPs | 104.27.203.89, 104.27.204.89, 2606:4700:21::681b:cb59, 2606:4700:21::681b:cc59 |
Redirect IPs | 104.16.143.22, 104.16.144.22, 2606:4700::6810:8f16, 2606:4700::6810:9016 |
Response IP | 104.16.143.22 |
Found | Yes |
Hash | 1a1199290ecba7ad4b595207d6a3a66da8935094435e347ff22fd0edec8770f7 |
SimHash | 39080055ebb3 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /widgets/* |
Disallow | /alert-box/* |
Disallow | /logout* |
Disallow | /emoticons/* |
Disallow | /slobs/download* |
Disallow | /slobs/slobs-download* |
Disallow | /streamlabs-obs/login-success* |
Disallow | /best-donation-clips/* |
Disallow | /api/* |
Other Records
Field | Value |
---|---|
sitemap | https://streamlabs.com/sitemap.xml |
sitemap | https://cms-marketing.streamlabs.com/sitemap.xml |