spb-post.com
robots.txt
Robots Exclusion Standard data for spb-post.com
Resource Scan
Scan Details
Site Domain | spb-post.com |
Base Domain | spb-post.com |
Scan Status | Ok |
Last Scan | 5/15/2025, 1:48:24 AM |
Next Scan | 6/14/2025, 1:48:24 AM |
Last Scan
Scanned | 5/15/2025, 1:48:24 AM |
URL | https://spb-post.com/robots.txt |
Redirect | https://www.spb-post.com/config/robots.php |
Redirect Domain | www.spb-post.com |
Redirect Base | spb-post.com |
Domain IPs | 104.21.90.211, 172.67.161.105, 2606:4700:3030::ac43:a169, 2606:4700:3031::6815:5ad3 |
Redirect IPs | 104.21.90.211, 172.67.161.105, 2606:4700:3030::ac43:a169, 2606:4700:3031::6815:5ad3 |
Response IP | 104.21.90.211 |
Found | Yes |
Hash | 54f8795cda197648cedd70e9b0cd538611eab13b988ffefc0354284c434b690d |
SimHash | 29915ae05089 |
Groups
googlebot
Rule | Path |
---|---|
Disallow | /lang/ |
Disallow | /tags_menu/ |
Disallow | /search |
Disallow | /*?id=* |
Disallow | /*?amp* |
Disallow | /*noredir%3Dtrue* |
Disallow | /*?ttc=* |
Disallow | /*?via=* |
Disallow | /*?clid=* |
Disallow | /*?__FB* |
Disallow | /*?utm_source= |
Disallow | /*%26amp%3Butm_medium%3D |
Disallow | /*%26amp%3Butm_campaign%3D |
Disallow | /*%26amp%3Butm_content%3D |
Disallow | /*%26amp%3Butm_term%3D |
Disallow | /*?sid= |
Disallow | /*?gclid= |
Disallow | /*?yclid= |
Disallow | /*?fbclid= |
Disallow | /*?sep= |
Disallow | /*%26amp%3Bsep%3D |
Disallow | /*?nw= |
yandex
Rule | Path |
---|---|
Disallow | /lang/ |
Disallow | /tags_menu/ |
Disallow | /search |
Disallow | /*?id=* |
Disallow | /*?amp* |
Disallow | /*noredir%3Dtrue* |
Disallow | /*?ttc=* |
Disallow | /*?via=* |
Disallow | /*?clid=* |
Disallow | /*?__FB* |
Disallow | /*?fbclid= |
Disallow | /*?sep= |
Disallow | /*%26amp%3Bsep%3D |
Disallow | /*?nw= |
*
Rule | Path |
---|---|
Disallow | /lang/ |
Disallow | /tags_menu/ |
Disallow | /search |
Disallow | /*?id=* |
Disallow | /*?amp* |
Disallow | /*noredir%3Dtrue* |
Disallow | /*?ttc=* |
Disallow | /*?via=* |
Disallow | /*?clid=* |
Disallow | /*?__FB* |
Disallow | /*?utm_source= |
Disallow | /*%26amp%3Butm_medium%3D |
Disallow | /*%26amp%3Butm_campaign%3D |
Disallow | /*%26amp%3Butm_content%3D |
Disallow | /*%26amp%3Butm_term%3D |
Disallow | /*?sid= |
Disallow | /*?gclid= |
Disallow | /*?yclid= |
Disallow | /*?fbclid= |
Disallow | /*?sep= |
Disallow | /*%26amp%3Bsep%3D |
Disallow | /*?nw= |
Other Records
Field | Value |
---|---|
sitemap | http://www.spb-post.com/export/sitemap_index.xml |