globaldesi.in
robots.txt
Robots Exclusion Standard data for globaldesi.in
Resource Scan
Scan Details
| Site Domain | globaldesi.in |
| Base Domain | globaldesi.in |
| Scan Status | Ok |
| Last Scan | 2026-02-12T08:50:42+00:00 |
| Next Scan | 2026-03-14T08:50:42+00:00 |
Last Scan
| Scanned | 2026-02-12T08:50:42+00:00 |
| URL | https://globaldesi.in/robots.txt |
| Redirect | https://www.globaldesi.in/robots.txt |
| Redirect Domain | www.globaldesi.in |
| Redirect Base | globaldesi.in |
| Domain IPs | 10.10.0.1, 10.10.0.2, 104.17.169.185, 104.17.170.185 |
| Redirect IPs | 104.18.36.77, 172.64.151.179 |
| Response IP | 104.18.36.77 |
| Found | Yes |
| Hash | 081a275b8facde972dbc1d35851f41f3a0964d1215b4685be1b0ca3e75cc98a7 |
| SimHash | 423fd242cfe3 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /*?q=* |
| Disallow | /on/demandware.store/ |
| Disallow | /default/ |
| Disallow | /Search-ShowAjax |
| Disallow | /*?prefn* |
| Disallow | /*?prefv* |
| Disallow | /*?srule* |
| Disallow | /login/ |
| Disallow | /dashboard/ |
| Disallow | /?q=search* |
| Disallow | Baiduspider |
| Disallow | %2BBaiduspider |
| Disallow | Sosospider%2B |
| Disallow | ezooms |
| Disallow | 008 |
| Disallow | Wotbox/2.01 |
| Disallow | dwbot |
| Disallow | asterias |
| Disallow | BackDoorBot/1.0 |
| Disallow | BlowFish/1.0 |
| Disallow | BotALot |
| Disallow | BuiltBotTough |
| Disallow | Bullseye/1.0 |
| Disallow | BunnySlippers |
| Disallow | Cegbfeieh |
| Disallow | CheeseBot |
| Disallow | CherryPicker |
| Disallow | CopyRightCheck |
| Disallow | cosmos |
| Disallow | Crescent |
| Disallow | DittoSpyder |
| Disallow | EroCrawler |
| Disallow | ExtractorPro |
| Disallow | Foobot |
| Disallow | Harvest/1.5 |
| Disallow | hloader |
| Disallow | httplib |
| Disallow | humanlinks |
| Disallow | ia_archiver |
| Disallow | InfoNaviRobot |
| Disallow | JennyBot |
| Disallow | LexiBot |
| Disallow | libWeb/clsHTTP |
| Disallow | MIIxpc |
| Disallow | moget |
| Disallow | NetAnts |
| Disallow | NICErsPRO |
| Disallow | Openfind |
| Disallow | ProPowerBot/2.14 |
| Disallow | ProWebWalker |
| Disallow | RepoMonkey |
| Disallow | RMA |
| Disallow | SiteSnagger |
| Disallow | SpankBot |
| Disallow | suzuran |
| Disallow | Szukacz/1.4 |
| Disallow | Teleport |
| Disallow | TeleportPro |
| Disallow | Telesoft |
| Disallow | TheNomad |
| Disallow | TightTwatBot |
| Disallow | Titan |
| Disallow | toCrawl/UrlDispatcher |
| Disallow | True_Robot |
| Disallow | True_Robot/1.0 |
| Disallow | turingos |
| Disallow | VCI |
| Disallow | WebStripper |
| Disallow | WebZip |
| Disallow | WebZip/4.0 |
| Disallow | Wget |
| Disallow | Wget/1.5.3 |
| Disallow | Wget/1.6 |
| Disallow | WWW-Collector-E |
| Disallow | Xenu%27s |
| Disallow | Zeus |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.globaldesi.in/sitemap_index.xml |
| sitemap | https://www.globaldesi.in/sitemap_0.xml |
Warnings
- 15 invalid lines.
Comments