ie.webuy.com
robots.txt
Robots Exclusion Standard data for ie.webuy.com
Resource Scan
Scan Details
| Site Domain | ie.webuy.com |
| Base Domain | webuy.com |
| Scan Status | Ok |
| Last Scan | 2024-09-22T06:10:25+00:00 |
| Next Scan | 2024-10-06T06:10:25+00:00 |
Last Scan
| Scanned | 2024-09-22T06:10:25+00:00 |
| URL | https://ie.webuy.com/robots.txt |
| Domain IPs | 104.22.4.112, 104.22.5.112, 172.67.21.51, 2606:4700:10::6816:470, 2606:4700:10::6816:570, 2606:4700:10::ac43:1533 |
| Response IP | 104.22.5.112 |
| Found | Yes |
| Hash | 10401f7091ac275973cd5b498fa237fd3dd74ac479cfd2de6bc7ba53abc7c188 |
| SimHash | d830dc04af33 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /buy |
| Disallow | /mw2 |
| Disallow | /user |
| Disallow | /flag |
| Disallow | /error |
| Disallow | /icons |
| Disallow | /basket |
| Disallow | /member |
| Disallow | /mw-assets |
| Disallow | /patterns |
| Disallow | /careers-images |
| Disallow | /checkout-payment-logos |
| Disallow | /sell/basket |
| Disallow | /user/account |
| Disallow | /esfim.pdf |
| Disallow | /iefim.pdf |
| Disallow | /ptfim.pdf |
| Disallow | /ukfim.pdf |
| Disallow | /*.phtm%28l%29$ |
| Disallow | /*.php* |
| Disallow | /search*?stext= |
Comments