starknet.io
robots.txt
Robots Exclusion Standard data for starknet.io
Resource Scan
Scan Details
Site Domain | starknet.io |
Base Domain | starknet.io |
Scan Status | Ok |
Last Scan | 2025-09-28T07:39:39+00:00 |
Next Scan | 2025-10-28T07:39:39+00:00 |
Last Scan
Scanned | 2025-09-28T07:39:39+00:00 |
URL | https://starknet.io/robots.txt |
Domain IPs | 162.159.136.54, 162.159.137.54 |
Response IP | 162.159.136.54 |
Found | Yes |
Hash | 85107a10aad28393e93e4ff9f95e9c8850d3d62183ad3729a655eafcd4d5de15 |
SimHash | 893854831672 |
Groups
*
Rule | Path |
---|---|
Disallow | /*?difficulty= |
Disallow | /*?tutorial-type= |
Disallow | /*?course= |
Disallow | /?category= |
Disallow | /*?location= |
Disallow | /*?type= |
Disallow | /*?role= |
Disallow | /*?job-type= |
Disallow | /*?media-type= |
Disallow | /*?*cpu_name=* |
Disallow | /*?*product_type=* |
Disallow | /ftp/ |
Disallow | /wp-admin |
Disallow | /wp-includes |
Disallow | /wp-login.php |
Disallow | /wp-content/plugins |
Disallow | /wp-content/cache |
Disallow | /wp-content/themes |
Disallow | /trackback |
Disallow | */trackback |
Disallow | */*/trackback |
Disallow | */*/feed/*/ |
Disallow | */feed |
Disallow | /cgi-bin |
Disallow | /*.php$ |
Disallow | /*.inc$ |
Disallow | /*.gz$ |
Disallow | /tag/ |
Disallow | /dapp-tag/ |
Allow | */uploads |
Allow | /*.js |
Allow | /*.css |
Allow | /*.png |
Allow | /*.jpg |
Allow | /*.jpeg |
Allow | /*.gif |
Allow | /*.svg |
Allow | /*.webp |
Allow |
Other Records
Field | Value |
---|---|
sitemap | https://www.starknet.io/sitemap_index.xml |
sitemap | https://www.starknet.io/page-sitemap.xml |