nerdlevel.io
robots.txt
Robots Exclusion Standard data for nerdlevel.io
Resource Scan
Scan Details
Site Domain | nerdlevel.io |
Base Domain | nerdlevel.io |
Scan Status | Ok |
Last Scan | 2024-09-17T20:34:22+00:00 |
Next Scan | 2024-10-01T20:34:22+00:00 |
Last Scan
Scanned | 2024-09-17T20:34:22+00:00 |
URL | https://nerdlevel.io/robots.txt |
Redirect | https://academy.nerdlevel.io//robots.txt |
Redirect Domain | academy.nerdlevel.io |
Redirect Base | nerdlevel.io |
Domain IPs | 2607:f1c0:100f:f000::21e, 74.208.236.77 |
Redirect IPs | 162.159.128.53, 162.159.138.52 |
Response IP | 162.159.138.52 |
Found | Yes |
Hash | 5906134100f6ed5846b7f1ffcea2ddd014bffa19eb9f36313a2945ca486979cc |
SimHash | 3a16d040f9b3 |
Groups
*
Rule | Path |
---|---|
Disallow | /search? |
Disallow | /list? |
Disallow | /sign_in? |
Disallow | /sign_up? |
Disallow | /*?*filters=* |
Disallow | /*comments |
Disallow | /spaces/11526318* |
Disallow | /spaces/16178624* |
Disallow | /spaces/11782977* |
Disallow | /spaces/11590707* |
Disallow | /communities/ |
Other Records
Field | Value |
---|---|
sitemap | https://academy.nerdlevel.io/sitemap.xml |