thebest.gr
robots.txt
Robots Exclusion Standard data for thebest.gr
Resource Scan
Scan Details
| Site Domain | thebest.gr |
| Base Domain | thebest.gr |
| Scan Status | Ok |
| Last Scan | 2025-05-28T23:03:45+00:00 |
| Next Scan | 2025-06-04T23:03:45+00:00 |
Last Scan
| Scanned | 2025-05-28T23:03:45+00:00 |
| URL | https://thebest.gr/robots.txt |
| Redirect | https://www.thebest.gr/robots.txt |
| Redirect Domain | www.thebest.gr |
| Redirect Base | thebest.gr |
| Domain IPs | 104.26.8.218, 104.26.9.218, 172.67.69.135, 2606:4700:20::681a:8da, 2606:4700:20::681a:9da, 2606:4700:20::ac43:4587 |
| Redirect IPs | 104.26.8.218, 104.26.9.218, 172.67.69.135, 2606:4700:20::681a:8da, 2606:4700:20::681a:9da, 2606:4700:20::ac43:4587 |
| Response IP | 104.26.8.218 |
| Found | Yes |
| Hash | 2d27d53e96f7ac4db89866f22c5b27c81cc916b47600b86903126d17447a39f7 |
| SimHash | 6520d056db95 |
Groups
*
No rules defined. All paths allowed.
Other Records
| Field | Value | Comment |
|---|---|---|
| crawl-delay | 15 | 1 page per 15 seconds |