webdevdl.com
robots.txt
Robots Exclusion Standard data for webdevdl.com
Resource Scan
Scan Details
| Site Domain | webdevdl.com |
| Base Domain | webdevdl.com |
| Scan Status | Ok |
| Last Scan | 2025-06-20T04:12:08+00:00 |
| Next Scan | 2025-07-20T04:12:08+00:00 |
Last Scan
| Scanned | 2025-06-20T04:12:08+00:00 |
| URL | https://webdevdl.com/robots.txt |
| Domain IPs | 104.21.21.63, 172.67.196.203, 2606:4700:3034::6815:153f, 2606:4700:3035::ac43:c4cb |
| Response IP | 172.67.196.203 |
| Found | Yes |
| Hash | 77398509cb881134bc6147ddc58b85a59ce7173bda9f348b4cc5b911f681c765 |
| SimHash | 0d3165849d23 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | */Profile/* |
| Disallow | */Invoice/* |
| Disallow | */Purchase/* |
| Disallow | */Admin/* |
| Disallow | */Elmah.axd* |
| Disallow | */Hangfire* |
| Disallow | */User/* |
| Disallow | */Error/* |
| Disallow | */Comment/* |
| Disallow | */Download/* |
| Disallow | */Search/* |
| Disallow | */profile/* |
| Disallow | */invoice/* |
| Disallow | */purchase/* |
| Disallow | */admin/* |
| Disallow | */elmah.axd* |
| Disallow | */hangfire* |
| Disallow | */user/* |
| Disallow | */error/* |
| Disallow | */comment/* |
| Disallow | */download/* |
| Disallow | */search/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://webdevdl.com/sitemap |