siliconera.com
robots.txt
Robots Exclusion Standard data for siliconera.com
Resource Scan
Scan Details
Site Domain | siliconera.com |
Base Domain | siliconera.com |
Scan Status | Ok |
Last Scan | 2024-06-08T03:03:07+00:00 |
Next Scan | 2024-06-15T03:03:07+00:00 |
Last Scan
Scanned | 2024-06-08T03:03:07+00:00 |
URL | https://siliconera.com/robots.txt |
Redirect | https://www.siliconera.com/robots.txt |
Redirect Domain | www.siliconera.com |
Redirect Base | siliconera.com |
Domain IPs | 104.18.12.113, 104.18.13.113, 2606:4700::6812:c71, 2606:4700::6812:d71 |
Redirect IPs | 104.18.12.113, 104.18.13.113, 2606:4700::6812:c71, 2606:4700::6812:d71 |
Response IP | 104.18.12.113 |
Found | Yes |
Hash | 58825402c2a4aa8e6c1fa0c2e489b765192f4a54ad2a1a9f8cf3a4fd10d75607 |
SimHash | ba2778fdbdd1 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Allow | /page/1$ |
Allow | /*/page/1$ |
Allow | /page/2$ |
Allow | /*/page/2$ |
Allow | /page/3$ |
Allow | /*/page/3$ |
Allow | /page/4$ |
Allow | /*/page/4$ |
Allow | /page/5$ |
Allow | /*/page/5$ |
Allow | /page/6$ |
Allow | /*/page/6$ |
Allow | /page/7$ |
Allow | /*/page/7$ |
Allow | /page/8$ |
Allow | /*/page/8$ |
Allow | /page/9$ |
Allow | /*/page/9$ |
Allow | /page/10$ |
Allow | /*/page/10$ |
Allow | /page/11$ |
Allow | /*/page/11$ |
Allow | /page/12$ |
Allow | /*/page/12$ |
Allow | /page/13$ |
Allow | /*/page/13$ |
Allow | /page/14$ |
Allow | /*/page/14$ |
Allow | /page/15$ |
Allow | /*/page/15$ |
Allow | /page/16$ |
Allow | /*/page/16$ |
Allow | /page/17$ |
Allow | /*/page/17$ |
Allow | /page/18$ |
Allow | /*/page/18$ |
Allow | /page/19$ |
Allow | /*/page/19$ |
Allow | /page/20$ |
Allow | /*/page/20$ |
Allow | /page/30$ |
Allow | /*/page/30$ |
Allow | /page/31$ |
Allow | /*/page/31$ |
Allow | /page/32$ |
Allow | /*/page/32$ |
Allow | /page/33$ |
Allow | /*/page/33$ |
Allow | /page/34$ |
Allow | /*/page/34$ |
Allow | /page/35$ |
Allow | /*/page/35$ |
Allow | /page/36$ |
Allow | /*/page/36$ |
Allow | /page/37$ |
Allow | /*/page/37$ |
Allow | /page/38$ |
Allow | /*/page/38$ |
Allow | /page/39$ |
Allow | /*/page/39$ |
Allow | /page/40$ |
Allow | /*/page/40$ |
Allow | /page/41$ |
Allow | /*/page/41$ |
Allow | /page/42$ |
Allow | /*/page/42$ |
Allow | /page/43$ |
Allow | /*/page/43$ |
Allow | /page/44$ |
Allow | /*/page/44$ |
Allow | /page/45$ |
Allow | /*/page/45$ |
Allow | /page/46$ |
Allow | /*/page/46$ |
Allow | /page/47$ |
Allow | /*/page/47$ |
Allow | /page/48$ |
Allow | /*/page/48$ |
Allow | /page/49$ |
Allow | /*/page/49$ |
Allow | /page/50$ |
Allow | /*/page/50$ |
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Disallow | /category/* |
Disallow | /tag/* |
Disallow | /page/* |
Disallow | /*/page/* |
Disallow | /?s=* |
Disallow | /search/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.siliconera.com/news-sitemap.xml |
sitemap | https://www.siliconera.com/sitemap_index.xml |