stevenkhalil.com
robots.txt

Robots Exclusion Standard data for stevenkhalil.com

Resource Scan

Scan Details

Site Domain stevenkhalil.com
Base Domain stevenkhalil.com
Scan Status Ok
Last Scan2025-06-13T07:24:13+00:00
Next Scan 2025-07-13T07:24:13+00:00

Last Scan

Scanned2025-06-13T07:24:13+00:00
URL https://stevenkhalil.com/robots.txt
Domain IPs 104.26.4.158, 104.26.5.158, 172.67.74.72, 2606:4700:20::681a:49e, 2606:4700:20::681a:59e, 2606:4700:20::ac43:4a48
Response IP 104.26.5.158
Found Yes
Hash e5bb68037174c6775ef9468d89486b07b4ea98dc2f98f22dc64a7b793fccda5e
SimHash 090d38a003e2

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Disallow

bingbot

Rule Path
Disallow
Disallow /*blackhole
Disallow /?blackhole

Other Records

Field Value
sitemap https://stevenkhalil.com/sitemap_index.xml

Warnings

  • `ser-agent` is not a known field.