devopslearners.com
robots.txt
Robots Exclusion Standard data for devopslearners.com
Resource Scan
Scan Details
| Site Domain | devopslearners.com |
| Base Domain | devopslearners.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server redirected incorrectly. |
| Last Scan | 2025-04-09T22:14:37+00:00 |
| Next Scan | 2025-07-08T22:14:37+00:00 |
Last Successful Scan
| Scanned | 2023-09-11T15:38:15+00:00 |
| URL | https://devopslearners.com/robots.txt |
| Redirect | https://devopslearners.com/robots.txt?gi=527b7ea15134 |
| Domain IPs | 104.21.74.6, 172.67.152.118, 2606:4700:3035::ac43:9876, 2606:4700:3037::6815:4a06 |
| Response IP | 104.21.74.6 |
| Found | Yes |
| Hash | 113fcf27edb904635f3b34a5d8cc4395fccff29c164e366f9a7ff8b39f54fdb5 |
| SimHash | 6904ba65c733 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /m/ |
| Disallow | /me/ |
| Disallow | /%40me$ |
| Disallow | /%40me/ |
| Disallow | /*/edit$ |
| Disallow | /*/*/edit$ |
| Disallow | /r/ |
| Disallow | /t/ |
| Disallow | /search?q$ |
| Disallow | /search?q= |
| Disallow | /*/*source%3D |
| Allow | /_/ |
| Allow | /_/api/users/*/meta |
| Allow | /_/api/users/*/profile/stream |
| Allow | /_/api/posts/*/responses |
| Allow | /_/api/posts/*/responsesStream |
| Allow | /_/api/posts/*/related |
Other Records
| Field | Value |
|---|---|
| sitemap | https://devopslearners.com/sitemap/sitemap.xml |