to.com.pl
robots.txt
Robots Exclusion Standard data for to.com.pl
Resource Scan
Scan Details
Site Domain | to.com.pl |
Base Domain | to.com.pl |
Scan Status | Ok |
Last Scan | 2024-09-14T22:55:29+00:00 |
Next Scan | 2024-09-21T22:55:29+00:00 |
Last Scan
Scanned | 2024-09-14T22:55:29+00:00 |
URL | https://to.com.pl/robots.txt |
Domain IPs | 104.18.20.46, 104.18.21.46, 2606:4700::6812:142e, 2606:4700::6812:152e |
Response IP | 104.18.20.46 |
Found | Yes |
Hash | d3ca6330fd92756ead1e718efaa35e0a78e7bbc32156042aabc90097b4162ded |
SimHash | 8900c0788cd5 |
Groups
*
Rule | Path |
---|---|
Disallow | /*?ses |
Disallow | /_ |
Disallow | /ajax/* |
Disallow | /onclick/* |
Disallow | /.well-known/amphtml/apikey.pub |
Disallow | /*link_label* |
Other Records
Field | Value |
---|---|
sitemap | https://to.com.pl/sitemapa/ |
sitemap | https://to.com.pl/sitemap/google_news.xml |