wetransfer.com
robots.txt
Robots Exclusion Standard data for wetransfer.com
Resource Scan
Scan Details
| Site Domain | wetransfer.com |
| Base Domain | wetransfer.com |
| Scan Status | Ok |
| Last Scan | 2024-11-11T16:19:52+00:00 |
| Next Scan | 2024-11-18T16:19:52+00:00 |
Last Scan
| Scanned | 2024-11-11T16:19:52+00:00 |
| URL | https://wetransfer.com/robots.txt |
| Domain IPs | 13.33.183.40, 13.33.183.71, 13.33.183.96, 13.33.183.99 |
| Response IP | 3.165.82.106 |
| Found | Yes |
| Hash | b417231bd6b58c8a54155980868fb42b222d82b4be7a43c172195e3709f26e62 |
| SimHash | 6908c614cf02 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*?* |
| Disallow | /downloads/ |
| Disallow | /api/ui/ |
| Disallow | /api/ |
| Disallow | /ter-optout |
| Disallow | /pm-optout |
| Disallow | /wallpaper/ |
| Disallow | /wallpapers/ |
| Disallow | /unlisted/ |
| Disallow | /transfers/* |
| Disallow | /accounts/* |
| Disallow | /verify-mobile |
Other Records
| Field | Value |
|---|---|
| sitemap | https://wetransfer.com/sitemap.xml |