tellows.co.za
robots.txt
Robots Exclusion Standard data for tellows.co.za
Resource Scan
Scan Details
Site Domain | tellows.co.za |
Base Domain | tellows.co.za |
Scan Status | Ok |
Last Scan | 2024-11-15T06:45:54+00:00 |
Next Scan | 2024-11-22T06:45:54+00:00 |
Last Scan
Scanned | 2024-11-15T06:45:54+00:00 |
URL | https://tellows.co.za/robots.txt |
Redirect | https://www.tellows.co.za/robots.txt |
Redirect Domain | www.tellows.co.za |
Redirect Base | tellows.co.za |
Domain IPs | 104.21.25.54, 172.67.222.247, 2606:4700:3033::6815:1936, 2606:4700:3036::ac43:def7 |
Redirect IPs | 104.21.25.54, 172.67.222.247, 2606:4700:3033::6815:1936, 2606:4700:3036::ac43:def7 |
Response IP | 104.21.25.54 |
Found | Yes |
Hash | 97d021a4b6cab65e9846857a9ec7ddfb9c798fb985d4b2e9b00b1be163d27654 |
SimHash | 1315756a3409 |
Groups
*
Rule | Path |
---|---|
Disallow | /images/mapoverlay/ |
Disallow | /clicktrack/ |
Disallow | /stats/graphdata |
Disallow | /stats/statsdata |
Disallow | /stats/partnerscoredata |
Disallow | /num/*/firmeneintrag$ |
Disallow | /login |
Disallow | /c/help-*/ |
Disallow | /c/hilfe-*/ |
Disallow | /c/static*/ |
Disallow | /num/*/spam/ |
Disallow | /ping.php |
baiduspider
Rule | Path |
---|---|
Disallow | /*.jpg$ |
Disallow | /*.jpeg$ |
Disallow | /*.gif$ |
Disallow | /*.png$ |
Disallow | /*.bmp$ |
*
Rule | Path |
---|---|
Allow | /.well-known/amphtml/apikey.pub |