onlineqatar.com
robots.txt
Robots Exclusion Standard data for onlineqatar.com
Resource Scan
Scan Details
| Site Domain | onlineqatar.com |
| Base Domain | onlineqatar.com |
| Scan Status | Ok |
| Last Scan | 2024-09-27T15:11:54+00:00 |
| Next Scan | 2024-10-04T15:11:54+00:00 |
Last Scan
| Scanned | 2024-09-27T15:11:54+00:00 |
| URL | https://onlineqatar.com/robots.txt |
| Redirect | https://www.onlineqatar.com/robots.txt |
| Redirect Domain | www.onlineqatar.com |
| Redirect Base | onlineqatar.com |
| Domain IPs | 2406:da18:9d0:143f:2124:4e9c:36a9:d9de, 52.221.42.138 |
| Redirect IPs | 104.21.52.87, 172.67.197.71, 2606:4700:3036::ac43:c547, 2606:4700:3037::6815:3457 |
| Response IP | 172.67.197.71 |
| Found | Yes |
| Hash | a3ed2fc341410fe445a681958e750c99e428408977ccf1095f364895f42599c0 |
| SimHash | 3b1b0175c5f5 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /admin/ | - |
| Disallow | /App_Browsers/ | - |
| Disallow | /App_Code/ | - |
| Disallow | /App_Data/ | - |
| Disallow | /App_GlobalResources/ | - |
| Disallow | /bin/ | - |
| Disallow | /Components/ | - |
| Disallow | /Config/ | - |
| Disallow | /contest/ | - |
| Disallow | /controls/ | - |
| Disallow | /DesktopModules/ | - |
| Disallow | /Documentation/ | - |
| Disallow | /HttpModules/ | - |
| Disallow | /Install/ | - |
| Disallow | /js/ | - |
| Disallow | /Providers/ | - |
| Disallow | /Resources/ContentRotator/ | - |
| Disallow | /Resources/ControlPanel/ | - |
| Disallow | /Resources/Dashboard/ | - |
| Disallow | /Resources/FeedBrowser/ | - |
| Disallow | /Resources/OpenForceAd/ | - |
| Disallow | /Resources/Search/ | - |
| Disallow | /Resources/Shared/ | - |
| Disallow | /Resources/SkinWidgets/ | - |
| Disallow | /Resources/TabStrip/ | - |
| Disallow | /Resources/Widgets/ | - |
| Disallow | /Activity-Feed/userId/ | Do not index user profiles |
| Disallow | /dashboard/ | - |
| Disallow | /*?*cuisinetype= | - |
| Disallow | /*?*id= | - |
| Disallow | /*?*SubCategory= | - |
| Disallow | /*?*category= | - |
| Disallow | /*?*Category= | - |
| Disallow | /*?*returnrul= | - |
msnbot
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /App_Browsers/ |
| Disallow | /App_Code/ |
| Disallow | /App_Data/ |
| Disallow | /App_GlobalResources/ |
| Disallow | /bin/ |
| Disallow | /Components/ |
| Disallow | /Config/ |
| Disallow | /contest/ |
| Disallow | /controls/ |
| Disallow | /DesktopModules/ |
| Disallow | /Documentation/ |
| Disallow | /HttpModules/ |
| Disallow | /Install/ |
| Disallow | /js/ |
| Disallow | /Providers/ |
| Disallow | /Resources/ContentRotator/ |
| Disallow | /Resources/ControlPanel/ |
| Disallow | /Resources/Dashboard/ |
| Disallow | /Resources/FeedBrowser/ |
| Disallow | /Resources/OpenForceAd/ |
| Disallow | /Resources/Search/ |
| Disallow | /Resources/Shared/ |
| Disallow | /Resources/SkinWidgets/ |
| Disallow | /Resources/TabStrip/ |
| Disallow | /Resources/Widgets/ |
| Disallow | /Activity-Feed/userId/ |
| Disallow | /dashboard/ |
| Disallow | /*?*cuisinetype= |
| Disallow | /*?*id= |
| Disallow | /*?*SubCategory= |
| Disallow | /*?*category= |
| Disallow | /*?*Category= |
| Disallow | /*?*returnrul= |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
slurp
| Rule | Path | Comment |
|---|---|---|
| Disallow | /*/ctl/ | Slurp permits * |
| Disallow | /admin/ | - |
| Disallow | /App_Browsers/ | - |
| Disallow | /App_Code/ | - |
| Disallow | /App_Data/ | - |
| Disallow | /App_GlobalResources/ | - |
| Disallow | /bin/ | - |
| Disallow | /Components/ | - |
| Disallow | /Config/ | - |
| Disallow | /contest/ | - |
| Disallow | /controls/ | - |
| Disallow | /DesktopModules/ | - |
| Disallow | /Documentation/ | - |
| Disallow | /HttpModules/ | - |
| Disallow | /Install/ | - |
| Disallow | /js/ | - |
| Disallow | /Providers/ | - |
| Disallow | /Resources/ContentRotator/ | - |
| Disallow | /Resources/ControlPanel/ | - |
| Disallow | /Resources/Dashboard/ | - |
| Disallow | /Resources/FeedBrowser/ | - |
| Disallow | /Resources/OpenForceAd/ | - |
| Disallow | /Resources/Search/ | - |
| Disallow | /Resources/Shared/ | - |
| Disallow | /Resources/SkinWidgets/ | - |
| Disallow | /Resources/TabStrip/ | - |
| Disallow | /Resources/Widgets/ | - |
| Disallow | /Activity-Feed/userId/ | - |
| Disallow | /dashboard/ | - |
| Disallow | /*?*cuisinetype= | - |
| Disallow | /*?*id= | - |
| Disallow | /*?*SubCategory= | - |
| Disallow | /*?*category= | - |
| Disallow | /*?*Category= | - |
| Disallow | /*?*returnrul= | - |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
googlebot
| Rule | Path | Comment |
|---|---|---|
| Disallow | /*/ctl/ | Googlebot permits * |
| Disallow | /admin/ | - |
| Disallow | /App_Browsers/ | - |
| Disallow | /App_Code/ | - |
| Disallow | /App_Data/ | - |
| Disallow | /App_GlobalResources/ | - |
| Disallow | /bin/ | - |
| Disallow | /Components/ | - |
| Disallow | /Config/ | - |
| Disallow | /contest/ | - |
| Disallow | /controls/ | - |
| Disallow | /DesktopModules/ | - |
| Disallow | /Documentation/ | - |
| Disallow | /HttpModules/ | - |
| Disallow | /Install/ | - |
| Disallow | /js/ | - |
| Disallow | /Providers/ | - |
| Disallow | /Resources/ContentRotator/ | - |
| Disallow | /Resources/ControlPanel/ | - |
| Disallow | /Resources/Dashboard/ | - |
| Disallow | /Resources/FeedBrowser/ | - |
| Disallow | /Resources/OpenForceAd/ | - |
| Disallow | /Resources/Search/ | - |
| Disallow | /Resources/Shared/ | - |
| Disallow | /Resources/SkinWidgets/ | - |
| Disallow | /Resources/TabStrip/ | - |
| Disallow | /Resources/Widgets/ | - |
| Disallow | /Activity-Feed/userId/ | - |
| Disallow | /dashboard/ | - |
| Disallow | /*?*cuisinetype= | - |
| Disallow | /*?*id= | - |
| Disallow | /*?*SubCategory= | - |
| Disallow | /*?*category= | - |
| Disallow | /*?*Category= | - |
| Disallow | /*?*returnrul= | - |
yahoo pipes 1.0
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /App_Browsers/ |
| Disallow | /App_Code/ |
| Disallow | /App_Data/ |
| Disallow | /App_GlobalResources/ |
| Disallow | /bin/ |
| Disallow | /Components/ |
| Disallow | /Config/ |
| Disallow | /contest/ |
| Disallow | /controls/ |
| Disallow | /DesktopModules/ |
| Disallow | /Documentation/ |
| Disallow | /HttpModules/ |
| Disallow | /Install/ |
| Disallow | /js/ |
| Disallow | /Providers/ |
| Disallow | /Resources/ContentRotator/ |
| Disallow | /Resources/ControlPanel/ |
| Disallow | /Resources/Dashboard/ |
| Disallow | /Resources/FeedBrowser/ |
| Disallow | /Resources/OpenForceAd/ |
| Disallow | /Resources/Search/ |
| Disallow | /Resources/Shared/ |
| Disallow | /Resources/SkinWidgets/ |
| Disallow | /Resources/TabStrip/ |
| Disallow | /Resources/Widgets/ |
| Disallow | /Activity-Feed/userId/ |
| Disallow | /dashboard/ |
| Disallow | /*?*cuisinetype= |
| Disallow | /*?*id= |
| Disallow | /*?*SubCategory= |
| Disallow | /*?*category= |
| Disallow | /*?*Category= |
| Disallow | /*?*returnrul= |
Comments