s-pro.io
robots.txt
Robots Exclusion Standard data for s-pro.io
Resource Scan
Scan Details
| Site Domain | s-pro.io |
| Base Domain | s-pro.io |
| Scan Status | Ok |
| Last Scan | 2025-12-05T13:40:49+00:00 |
| Next Scan | 2026-01-04T13:40:49+00:00 |
Last Scan
| Scanned | 2025-12-05T13:40:49+00:00 |
| URL | https://s-pro.io/robots.txt |
| Domain IPs | 104.26.14.73, 104.26.15.73, 172.67.75.176 |
| Response IP | 104.26.14.73 |
| Found | Yes |
| Hash | fcc9d143311958ed330d5b1d4af9438716a90418b0a984f00349f5235d0cad46 |
| SimHash | 21d8315b077e |
Groups
*
| Product | Comment |
|---|---|
| * | general rules for robots of all search engines |
| Rule | Path | Comment |
|---|---|---|
| Disallow | /cgi-bin | service folder for storing server scripts |
| Disallow | /? | all request parameters on the main |
| Disallow | /wp- | all files WP: /wp-json/, /wp-includes, /wp-content/plugins |
| Disallow | /wp/ | if there is a subdirectory / wp / where the CMS is installed (if not, |
| Disallow | *?s= | site search |
| Disallow | *%26amp%3Bs%3D | site search |
| Disallow | /search/ | site search |
| Disallow | /author/ | author's archive |
| Disallow | /users/ | user archive |
| Disallow | */trackback | trackbacks, notifications in comments about a link to a web document |
| Disallow | */feed | all feeds |
| Disallow | */rss | rss feed |
| Disallow | */embed | all embeddings |
| Disallow | */wlwmanifest.xml | xml Windows Live Writer manifest file (if not using, |
| Disallow | /xmlrpc.php | WordPress API file |
| Disallow | *utm*%3D | utm |
| Disallow | *openstat%3D | openstat tags |
| Allow | */uploads | open the folder with files uploads |
| Allow | /*/*.js | open js files |
| Allow | /*/*.css | open css files |
| Allow | /wp-*.png | allow indexing images |
| Allow | /wp-*.jpg | allow indexing images |
| Allow | /wp-*.jpeg | allow indexing images |
| Allow | /wp-*.gif | allow indexing gifs |
| Allow | /wp-admin/admin-ajax.php | allow ajax |
Other Records
| Field | Value |
|---|---|
| sitemap | https://s-pro.io/sitemap.xml |
| sitemap | https://s-pro.io//sitemap.xml.gz |
Comments