lagged.co
robots.txt

Robots Exclusion Standard data for lagged.co

Resource Scan

Scan Details

Site Domain lagged.co
Base Domain lagged.co
Scan Status Ok
Last Scan2024-11-03T17:45:16+00:00
Next Scan 2024-11-10T17:45:16+00:00

Last Scan

Scanned2024-11-03T17:45:16+00:00
URL http://lagged.co/robots.txt
Redirect https://lagged.com/robots.txt
Redirect Domain lagged.com
Redirect Base lagged.com
Domain IPs 104.244.124.198
Redirect IPs 104.18.0.238, 104.18.1.238, 2606:4700::6812:1ee, 2606:4700::6812:ee
Response IP 104.18.0.238
Found Yes
Hash ff003baae28ad2ce36eb9b8679c814a67fbd1149674a9a4c9a40718899f63d9a
SimHash 75115d50441c

Groups

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://lagged.com/sitemap.txt