newtis.info
robots.txt
Robots Exclusion Standard data for newtis.info
Resource Scan
Scan Details
Site Domain | newtis.info |
Base Domain | newtis.info |
Scan Status | Ok |
Last Scan | 2024-05-12T13:01:28+00:00 |
Next Scan | 2024-05-19T13:01:28+00:00 |
Last Scan
Scanned | 2024-05-12T13:01:28+00:00 |
URL | https://newtis.info/robots.txt |
Redirect | https://www.newtis.info/robots.txt |
Redirect Domain | www.newtis.info |
Redirect Base | newtis.info |
Domain IPs | 104.26.6.50, 104.26.7.50, 172.67.71.196, 2606:4700:20::681a:632, 2606:4700:20::681a:732, 2606:4700:20::ac43:47c4 |
Redirect IPs | 104.26.6.50, 104.26.7.50, 172.67.71.196, 2606:4700:20::681a:632, 2606:4700:20::681a:732, 2606:4700:20::ac43:47c4 |
Response IP | 172.67.71.196 |
Found | Yes |
Hash | d16d68815422eed9515a653d2809ef6ce39b00da79f7259425f8701381f1a679 |
SimHash | 6972daa8e1ba |
Groups
*
Rule | Path |
---|---|
Disallow | /$ |
Disallow | /tisv2/a/en/$ |
Disallow | /tisv2/a/de/$ |
Disallow | /tisv2/a/ru/$ |
Disallow | /tisv2/u/ |
Disallow | /to_* |
Other Records
Field | Value |
---|---|
crawl-delay | 2 |