size.ly
robots.txt
Robots Exclusion Standard data for size.ly
Resource Scan
Scan Details
Site Domain | size.ly |
Base Domain | size.ly |
Scan Status | Ok |
Last Scan | 2024-11-15T07:32:19+00:00 |
Next Scan | 2024-11-22T07:32:19+00:00 |
Last Scan
Scanned | 2024-11-15T07:32:19+00:00 |
URL | https://size.ly/robots.txt |
Redirect | https://www.size.ly/robots.txt |
Redirect Domain | www.size.ly |
Redirect Base | size.ly |
Domain IPs | 172.66.41.38, 172.66.42.218, 2606:4700:3108::ac42:2926, 2606:4700:3108::ac42:2ada |
Redirect IPs | 13.200.123.229, 13.234.100.116, 65.0.79.182 |
Response IP | 52.199.221.217 |
Found | Yes |
Hash | 4225da6aae6c4bfeacf422dc49a81f6697b8056f46a6377f2de9cfbd860c4647 |
SimHash | 694d5c6403d3 |
Groups
*
Rule | Path |
---|---|
Disallow | /terms |
Disallow | /privacy |
Disallow | /pages |
Disallow | /de/grossentabelle/ |
Disallow | /de/online-marketplaces/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.size.ly/sitemap.xml |