shop.gadgetsnow.com
robots.txt
Robots Exclusion Standard data for shop.gadgetsnow.com
Resource Scan
Scan Details
| Site Domain | shop.gadgetsnow.com |
| Base Domain | gadgetsnow.com |
| Scan Status | Ok |
| Last Scan | 2024-09-23T02:37:33+00:00 |
| Next Scan | 2024-10-07T02:37:33+00:00 |
Last Scan
| Scanned | 2024-09-23T02:37:33+00:00 |
| URL | https://shop.gadgetsnow.com/robots.txt |
| Domain IPs | 118.215.81.168, 2600:1413:b000:487::3857, 2600:1413:b000:492::3857 |
| Response IP | 23.77.6.171 |
| Found | Yes |
| Hash | 0e4c1ee706e9f013f1f6f597d85631d8fc575f419cddf4f4cbba93962d263733 |
| SimHash | ca5bf94eff53 |
Groups
teleport
teleportpro
emailcollector
emailsiphon
webbandit
webzip
webreaper
webstripper
web downloader
webcopier
offline explorer pro
httrack website copier
offline commander
leech
websnake
blackwidow
http weazel
googlebot
| Rule | Path |
|---|---|
| Disallow |
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /control/ |
| Disallow | /control/* |
| Disallow | /search/ |
| Disallow | /search/* |
| Disallow | /search_v1/* |
| Disallow | /webapp/ |
| Disallow | /*.jsp$ |
| Disallow | /mtkeywordsearch |
| Disallow | /pinpointsearch |
| Disallow | */affiliate_amazon.cms* |
| Disallow | */affiliate_tatacliq.cms* |
| Disallow | */affiliate_paytm.cms* |
| Disallow | */affiliate.cms* |
| Disallow | *? |
| Disallow | /ERR/ |
| Disallow | /ERR/* |
| Disallow | */affiliate_vijaysales.cms* |