xlab.app
robots.txt
Robots Exclusion Standard data for xlab.app
Resource Scan
Scan Details
| Site Domain | xlab.app |
| Base Domain | xlab.app |
| Scan Status | Ok |
| Last Scan | 2024-11-15T15:18:04+00:00 |
| Next Scan | 2024-11-22T15:18:04+00:00 |
Last Scan
| Scanned | 2024-11-15T15:18:04+00:00 |
| URL | https://xlab.app/robots.txt |
| Redirect | https://blog.xlab.app/robots.txt |
| Redirect Domain | blog.xlab.app |
| Redirect Base | xlab.app |
| Domain IPs | 76.76.21.123 |
| Redirect IPs | 76.76.21.123 |
| Response IP | 76.76.21.123 |
| Found | Yes |
| Hash | ad0dde374bfb75c0099759fd3563fd031af5e67921c44ee48d9c6bf85095474f |
| SimHash | 6099d2506753 |
Groups
googlebot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /archives/ |
| Allow | /categories/ |
| Allow | /page/ |
| Allow | /p/ |
| Allow | /friends/ |
| Allow | /links/ |
| Allow | /about/ |
| Disallow | /img/ |
| Disallow | /images/ |
| Disallow | /downloads/ |
| Disallow | *.png$ |
| Disallow | *.jpg$ |
| Disallow | *.gif$ |
bingbot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /archives/ |
| Allow | /categories/ |
| Allow | /page/ |
| Allow | /p/ |
| Allow | /friends/ |
| Allow | /links/ |
| Allow | /about/ |
| Disallow | /img/ |
| Disallow | /images/ |
| Disallow | /downloads/ |
| Disallow | *.png$ |
| Disallow | *.jpg$ |
| Disallow | *.gif$ |
duckduckbot
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /archives/ |
| Allow | /categories/ |
| Allow | /page/ |
| Allow | /p/ |
| Allow | /friends/ |
| Allow | /links/ |
| Allow | /about/ |
| Disallow | /img/ |
| Disallow | /images/ |
| Disallow | /downloads/ |
| Disallow | *.png$ |
| Disallow | *.jpg$ |
| Disallow | *.gif$ |
baiduspider
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /archives/ |
| Allow | /categories/ |
| Allow | /page/ |
| Allow | /p/ |
| Allow | /friends/ |
| Allow | /links/ |
| Allow | /about/ |
| Disallow | /img/ |
| Disallow | /images/ |
| Disallow | /downloads/ |
| Disallow | *.png$ |
| Disallow | *.jpg$ |
| Disallow | *.gif$ |
*
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://blog.xlab.app/sitemap.xml |