xdc.dev
robots.txt
Robots Exclusion Standard data for xdc.dev
Resource Scan
Scan Details
| Site Domain | xdc.dev |
| Base Domain | xdc.dev |
| Scan Status | Ok |
| Last Scan | 2024-09-26T09:01:38+00:00 |
| Next Scan | 2024-10-10T09:01:38+00:00 |
Last Scan
| Scanned | 2024-09-26T09:01:38+00:00 |
| URL | https://www.xdc.dev/robots.txt |
| Domain IPs | 34.200.227.6 |
| Response IP | 34.200.227.6 |
| Found | Yes |
| Hash | 152e9b5a5f945df6bb3ce3053624274d8a22ea06df6bf390be8364eb89bf0765 |
| SimHash | 432c80402397 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*/actions_panel* |
| Disallow | /users/auth/twitter* |
| Disallow | /users/auth/github* |
| Disallow | /report-abuse?url=* |
| Disallow | /connect/%40* |
| Disallow | /search?q=* |
| Disallow | /search/?q=* |
| Disallow | /search/feed_content?* |
| Disallow | /listings*?q=* |
| Disallow | /mod/* |
| Disallow | /mod?* |
| Disallow | /admin/* |
| Disallow | /reactions?* |
| Disallow | /async_info/base_data |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.xdc.dev/sitemap-index.xml |