toolswift.com
robots.txt
Robots Exclusion Standard data for toolswift.com
Resource Scan
Scan Details
| Site Domain | toolswift.com |
| Base Domain | toolswift.com |
| Scan Status | Ok |
| Last Scan | 2024-11-14T02:36:04+00:00 |
| Next Scan | 2024-11-21T02:36:04+00:00 |
Last Scan
| Scanned | 2024-11-14T02:36:04+00:00 |
| URL | https://toolswift.com/robots.txt |
| Domain IPs | 104.21.82.33, 172.67.151.204, 2606:4700:3030::6815:5221, 2606:4700:3031::ac43:97cc |
| Response IP | 172.67.151.204 |
| Found | Yes |
| Hash | a6eaa9f3d644ae8843bd09f4237efa7f499a2452532e526f1b8d25c7eb89ff4a |
| SimHash | 9849e8485397 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /amazonapi/ |
| Disallow | /ask/ |
| Disallow | /cron/ |
| Disallow | /data/ |
| Disallow | /instagrab-old/ |
| Disallow | /template/ |
| Disallow | /covid-status/ |