drchetanagarwal.com
robots.txt
Robots Exclusion Standard data for drchetanagarwal.com
Resource Scan
Scan Details
Site Domain | drchetanagarwal.com |
Base Domain | drchetanagarwal.com |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-09-24T09:55:57+00:00 |
Next Scan | 2024-09-25T09:55:57+00:00 |
Last Successful Scan
Scanned | 2024-08-25T09:55:44+00:00 |
URL | https://www.drchetanagarwal.com/robots.txt |
Domain IPs | 13.35.18.2, 13.35.18.33, 13.35.18.53, 13.35.18.82, 2600:9000:20c7:2c00:18:c205:b400:93a1, 2600:9000:20c7:3600:18:c205:b400:93a1, 2600:9000:20c7:5000:18:c205:b400:93a1, 2600:9000:20c7:6c00:18:c205:b400:93a1, 2600:9000:20c7:9000:18:c205:b400:93a1, 2600:9000:20c7:a800:18:c205:b400:93a1, 2600:9000:20c7:b400:18:c205:b400:93a1, 2600:9000:20c7:e800:18:c205:b400:93a1 |
Response IP | 13.35.18.82 |
Found | Yes |
Hash | 75261098918943d1032ed8f44abd6698a7511cb8e9622ac20ba6ac4ffca58f22 |
SimHash | 81555c768f10 |
Groups
*
Rule | Path |
---|---|
Disallow | /cart/ |
Disallow | /checkout |
Disallow | /gmc-and-refund-policy |
Disallow | /resubscribe |
Disallow | /securepay |
Disallow | /transaction-status |
Disallow | /unsubscribe |
Disallow | /404 |
Disallow | /500 |
Disallow | /fonts/ |
Disallow | /partial/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.drchetanagarwal.com/sitemap.xml |
Comments