digitalsolutions.co.in
robots.txt
Robots Exclusion Standard data for digitalsolutions.co.in
Resource Scan
Scan Details
| Site Domain | digitalsolutions.co.in |
| Base Domain | digitalsolutions.co.in |
| Scan Status | Ok |
| Last Scan | 2025-11-20T19:01:31+00:00 |
| Next Scan | 2025-12-20T19:01:31+00:00 |
Last Scan
| Scanned | 2025-11-20T19:01:31+00:00 |
| URL | https://digitalsolutions.co.in/robots.txt |
| Domain IPs | 104.21.8.13, 172.67.156.158, 2606:4700:3031::6815:80d, 2606:4700:3036::ac43:9c9e |
| Response IP | 172.67.156.158 |
| Found | Yes |
| Hash | c65ffa529bdb2b54c05d4ad81c98d7113c2620e1ee48edba62a35cd5cc17c127 |
| SimHash | b9148ea88464 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /AhrefsBot |
| Disallow | /Baiduspider |
| Disallow | /EasouSpider |
| Disallow | /Ezooms |
| Disallow | /YandexBot |
| Disallow | /MJ12bot |
| Disallow | /SiteSucker |
| Disallow | /HTTrack |
| Disallow | /almaden |
| Disallow | /Anarchie |
| Disallow | /ASPSeek |
| Disallow | /attach |
| Disallow | /autoemailspider |
| Disallow | /BackWeb |
| Disallow | /Bandit |
| Disallow | /BatchFTP |
| Disallow | /BlackWidow |
| Disallow | /Buddy |
| Disallow | /bumblebee |
| Disallow | /CherryPicker |
| Disallow | /ChinaClaw |
| Disallow | /CICC |
| Disallow | /Collector |
| Disallow | /Copier |
| Disallow | /Crescent |
| Disallow | /Custo |
| Disallow | /DA |
| Disallow | /DIIbot |
| Disallow | /DISCo |
| Disallow | /Pump |
| Disallow | /Demon |
| Disallow | /Wonder |
| Disallow | /Downloader |
| Disallow | /Drip |
| Disallow | /DSurf15a |
| Disallow | /eCatch |
| Disallow | /EasyDL |
| Disallow | /EirGrabber |
| Disallow | /EmailCollector |
| Disallow | /EmailSiphon |
| Disallow | /EmailWolf |
| Disallow | /Express |
| Disallow | /ExtractorPro |
| Disallow | /EyeNetIE |
| Disallow | /FileHound |
| Disallow | /FlashGet |
| Disallow | /FrontPage |
| Disallow | /GetRight |
| Disallow | /GetSmart |
| Disallow | /GetWeb |
| Disallow | /gigabaz |
| Disallow | /gotit |
| Disallow | /Grabber |
| Disallow | /GrabNet |
| Disallow | /Grafula |
| Disallow | /HMView |
| Disallow | /httpdown |
| Disallow | /Stripper |
| Disallow | /Sucker |
| Disallow | /InterGET |
| Disallow | /InternetLinkagent |
| Disallow | /InternetSeer.com |
| Disallow | /Iria |
| Disallow | /JetCar |
| Disallow | /JOC |
| Disallow | /JustView |
| Disallow | /larbin |
| Disallow | /LeechFTP |
| Disallow | /LexiBot |
| Disallow | /lftp |
| Disallow | /likse |
| Disallow | /Link |
| Disallow | /LinkWalker |
| Disallow | /Magnet |
| Disallow | /Mass |
| Disallow | /Memo |
| Disallow | /Microsoft.URL |
| Disallow | /MIDown |
| Disallow | /Mirror |
| Disallow | /Mister |
| Disallow | /MSFrontPage |
| Disallow | /MSIECrawler |
| Disallow | /MSProxy |
| Disallow | /Navroad |
| Disallow | /NearSite |
| Disallow | /NetAnts |
| Disallow | /NetMechanic |
| Disallow | /NetSpider |
| Disallow | /Vampire |
| Disallow | /NetZIP |
| Disallow | /NICErsPRO |
| Disallow | /Ninja |
| Disallow | /Octopus |
| Disallow | /Openfind |
| Disallow | /PageGrabber |
| Disallow | /pavuk |
| Disallow | /pcBrowser |
| Disallow | /Ping |
| Disallow | /PingALink |
| Disallow | /Pockey |
| Disallow | /psbot |
| Disallow | /Pump |
| Disallow | /QRVA |
| Disallow | /RealDownload |
| Disallow | /Reaper |
| Disallow | /Recorder |
| Disallow | /ReGet |
| Disallow | /Scooter |
| Disallow | /Seeker |
| Disallow | /Siphon |
| Disallow | /SiteSnagger |
| Disallow | /SlySearch |
| Disallow | /SmartDownload |
| Disallow | /Snake |
| Disallow | /SpaceBison |
| Disallow | /sproose |
| Disallow | /Stripper |
| Disallow | /Sucker |
| Disallow | /SuperBot |
| Disallow | /SuperHTTP |
| Disallow | /Surfbot |
| Disallow | /Szukacz |
| Disallow | /tAkeOut |
| Disallow | /URLSpiderPro |
| Disallow | /Vacuum |
| Disallow | /VoidEYE |
| Disallow | /WebAuto |
| Disallow | /webcollage |
| Disallow | /WebCopier |
| Disallow | /WebFetch |
| Disallow | /WebHook |
| Disallow | /WebLeacher |
| Disallow | /WebMiner |
| Disallow | /WebMirror |
| Disallow | /WebReaper |
| Disallow | /WebSauger |
| Disallow | /Website |
| Disallow | /Webster |
| Disallow | /WebStripper |
| Disallow | /WebWhacker |
| Disallow | /WebZIP |
| Disallow | /Wget |
| Disallow | /Whacker |
| Disallow | /Widow |
| Disallow | /WWWOFFLE |
| Disallow | /Xenu |
| Disallow | /Zeus |
| Disallow | /Go%5C%21Zilla |
| Disallow | /Go%21Zilla |
| Disallow | /Go-Ahead-Got-It |
| Disallow | /grub-client |
| Disallow | /.*httrack.* |
| Disallow | /ia_archiver |
| Disallow | /Indy*Library |
| Disallow | /JBH*agent |
| Disallow | /Link*Sleuth |
| Disallow | /Mag-Net |
| Disallow | /Mozilla.*Indy |
| Disallow | /Mozilla.*NEW |
| Disallow | /Mozilla*MSIECrawler |
| Disallow | /sitecheck.internetseer.com |
| Disallow | /%5BWw%5Deb%5BBb%5Dandit |
| Disallow | /WebEMailExtrac. |
| Disallow | /x-Tractor |
| Disallow | /Zeus.*Webster |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.digitalsolutions.co.in/sitemap.xml |
| sitemap | https://www.digitalsolutions.co.in/sitemap.xml |
Warnings
- 12 invalid lines.