stevenkhalil.com
robots.txt
Robots Exclusion Standard data for stevenkhalil.com
Resource Scan
Scan Details
Site Domain | stevenkhalil.com |
Base Domain | stevenkhalil.com |
Scan Status | Ok |
Last Scan | 2025-06-13T07:24:13+00:00 |
Next Scan | 2025-07-13T07:24:13+00:00 |
Last Scan
Scanned | 2025-06-13T07:24:13+00:00 |
URL | https://stevenkhalil.com/robots.txt |
Domain IPs | 104.26.4.158, 104.26.5.158, 172.67.74.72, 2606:4700:20::681a:49e, 2606:4700:20::681a:59e, 2606:4700:20::ac43:4a48 |
Response IP | 104.26.5.158 |
Found | Yes |
Hash | e5bb68037174c6775ef9468d89486b07b4ea98dc2f98f22dc64a7b793fccda5e |
SimHash | 090d38a003e2 |
Groups
*
Rule | Path |
---|---|
Disallow | / |
Other Records
Field | Value |
---|---|
sitemap | https://stevenkhalil.com/sitemap_index.xml |
Warnings
- `ser-agent` is not a known field.