rask.ai
robots.txt
Robots Exclusion Standard data for rask.ai
Resource Scan
Scan Details
| Site Domain | rask.ai |
| Base Domain | rask.ai |
| Scan Status | Ok |
| Last Scan | 2024-05-02T23:03:42+00:00 |
| Next Scan | 2024-06-01T23:03:42+00:00 |
Last Scan
| Scanned | 2024-05-02T23:03:42+00:00 |
| URL | https://rask.ai/robots.txt |
| Redirect | https://www.rask.ai/robots.txt |
| Redirect Domain | www.rask.ai |
| Redirect Base | rask.ai |
| Domain IPs | 75.2.70.75, 99.83.190.102 |
| Redirect IPs | 52.197.0.54, 52.199.221.217, 54.178.223.218 |
| Response IP | 44.242.99.40 |
| Found | Yes |
| Hash | a95556d3dd18be3a51cecc2ee882904e6e493f60d15b8c425fd281236dba26cd |
| SimHash | 665cc06d2bd3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | .*?ref=.* |
| Disallow | .*?via=.* |
| Disallow | .*?utm=.* |
| Disallow | .*?__hstc=.* |
| Disallow | /test-page.html |
| Disallow | /api-old.html |
| Disallow | /shorts-page.html |
| Disallow | /edtech-old.html |
| Disallow | /edtech-old-2.html |
| Disallow | /marketers-old.html |
| Disallow | /content-creators-old.html |
| Disallow | /affiliate-old.html |
| Disallow | .*/tools/transcription/button.html |
| Disallow | .*/tools/video-translator/button.html |
| Disallow | /blog/edtech-2023-language-diversity-rankings.html |
| Disallow | /pricing-promo.html |
| Disallow | /new-services.html |
| Disallow | /academy-videos-feedback.html |
| Disallow | .*/tags-for-blog-posts/.* |
| Disallow | .*/blog-category/.* |
| Disallow | /translator-ai-video.html |
| Disallow | /ai-video-translator.html |
| Disallow | /new-tools-template.html |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.rask.ai/sitemap.xml |