lclstage.dev
robots.txt

Robots Exclusion Standard data for lclstage.dev

Resource Scan

Scan Details

Site Domain lclstage.dev
Base Domain lclstage.dev
Scan Status Ok
Last Scan2024-09-29T23:36:36+00:00
Next Scan 2024-10-29T23:36:36+00:00

Last Scan

Scanned2024-09-29T23:36:36+00:00
URL https://lclstage.dev/robots.txt
Redirect https://clerkstage.dev/robots.txt
Redirect Domain clerkstage.dev
Redirect Base clerkstage.dev
Domain IPs 3.131.150.69
Redirect IPs 76.76.21.241, 76.76.21.9
Response IP 76.76.21.9
Found Yes
Hash d9084363f2c1b364b27a29fc8b9912d21f71b393826045c26f55d91b933adc4d
SimHash 6d589c538731

Groups

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://clerk.com/sitemap.xml

Comments

  • *
  • Host
  • Sitemaps

Warnings

  • `host` is not a known field.