ces.tech
robots.txt
Robots Exclusion Standard data for ces.tech
Resource Scan
Scan Details
Site Domain | ces.tech |
Base Domain | ces.tech |
Scan Status | Ok |
Last Scan | 2024-09-12T03:30:20+00:00 |
Next Scan | 2024-09-26T03:30:20+00:00 |
Last Scan
Scanned | 2024-09-12T03:30:20+00:00 |
URL | https://ces.tech/robots.txt |
Redirect | https://www.ces.tech/robots.txt |
Redirect Domain | www.ces.tech |
Redirect Base | ces.tech |
Domain IPs | 45.223.163.83, 45.223.183.83 |
Redirect IPs | 162.159.140.127, 172.66.0.125, 2606:4700:7::7d, 2a06:98c1:58::7d |
Response IP | 162.159.140.127 |
Found | Yes |
Hash | 6fb0a3fdbbcbdc641242183e575bf34bde063289bc2121d36d555782d2fc3ac4 |
SimHash | 793d7b444dd2 |
Groups
*
Rule | Path |
---|---|
Disallow | /search* |
Disallow | *?q=* |
Disallow | *type%3D* |
Disallow | *sort%3D* |
Disallow | *topics%3D* |
Disallow | *type%3D* |
Disallow | *year%3D* |
Disallow | *filters%3D* |
Other Records
Field | Value |
---|---|
sitemap | /sitemap.xml |