ioffer.com
robots.txt
Robots Exclusion Standard data for ioffer.com
Resource Scan
Scan Details
| Site Domain | ioffer.com |
| Base Domain | ioffer.com |
| Scan Status | Ok |
| Last Scan | 2024-06-05T23:05:51+00:00 |
| Next Scan | 2024-07-05T23:05:51+00:00 |
Last Scan
| Scanned | 2024-06-05T23:05:51+00:00 |
| URL | https://ioffer.com/robots.txt |
| Domain IPs | 104.26.14.179, 104.26.15.179, 172.67.75.65, 2606:4700:20::681a:eb3, 2606:4700:20::681a:fb3, 2606:4700:20::ac43:4b41 |
| Response IP | 172.67.75.65 |
| Found | Yes |
| Hash | de8448845f21e2ace3c52c41d4e4324deb024e7b102a86af985f6d0d14050901 |
| SimHash | 263e15066f63 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /checkout |
| Disallow | /cart |
| Disallow | /orders |
| Disallow | /user |
| Disallow | /account |
| Disallow | /api |
| Disallow | /password |
| Disallow | /api_tokens |
| Disallow | /cart_link |
| Disallow | /account_link |
Warnings
- 2 invalid lines.
Comments