dylan237.github.io
robots.txt
Robots Exclusion Standard data for dylan237.github.io
Resource Scan
Scan Details
| Site Domain | dylan237.github.io |
| Base Domain | dylan237.github.io |
| Scan Status | Ok |
| Last Scan | 2024-10-29T08:03:02+00:00 |
| Next Scan | 2024-11-28T08:03:02+00:00 |
Last Scan
| Scanned | 2024-10-29T08:03:02+00:00 |
| URL | https://dylan237.github.io/robots.txt |
| Domain IPs | 185.199.108.153, 185.199.109.153, 185.199.110.153, 185.199.111.153, 2606:50c0:8000::153, 2606:50c0:8001::153, 2606:50c0:8002::153, 2606:50c0:8003::153 |
| Response IP | 185.199.110.153 |
| Found | Yes |
| Hash | ebe48cb356c7578121946ed7fcd3b689a9a61820d3ad0e2ec37ace40288a4277 |
| SimHash | 98041255e9d7 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /archives/ |
| Allow | /categories/ |
| Allow | /tags/ |
| Allow | /resources/ |
| Disallow | /vendors/ |
| Disallow | /js/ |
| Disallow | /css/ |
| Disallow | /fonts/ |
| Disallow | /vendors/ |
| Disallow | /fancybox/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://dylan237.github.io/sitemap.xml |