afklcargo.com
robots.txt

Robots Exclusion Standard data for afklcargo.com

Resource Scan

Scan Details

Site Domain afklcargo.com
Base Domain afklcargo.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-07-14T03:44:11+00:00
Next Scan 2024-10-12T03:44:11+00:00

Last Successful Scan

Scanned2023-05-29T02:24:16+00:00
URL https://afklcargo.com/robots.txt
Redirect https://www.afklcargo.com/robots.txt
Redirect Domain www.afklcargo.com
Redirect Base afklcargo.com
Domain IPs 23.215.7.16, 23.215.7.20, 2600:1413:1::76d6:a73a, 2600:1413:1::76d6:a74f
Redirect IPs 2600:1413:1::76d6:a73a, 2600:1413:1::76d6:a74f, 96.17.180.151, 96.17.180.163
Response IP 96.17.180.151
Found Yes
Hash c4eccea02afdd648afb48f33b6d9a1d5302cc2f036fc08158d41243758726823
SimHash 2d114a47753c

Groups

*

Rule Path
Disallow /no-robots/
Disallow /GA/fr/
Disallow /NE/fr/
Disallow /IL/en/
Disallow /BF/fr/
Disallow /CI/fr/
Disallow /DZ/fr/
Disallow /MF/fr/
Disallow /ES/en/
Disallow /PF/fr/
Disallow /CG/fr/
Disallow /TZ/fr/
Disallow /AM/en/
Disallow /KZ/fr/
Disallow /TG/fr/
Disallow /US/fr/
Disallow /UG/en/
Disallow /MU/fr/
Disallow /PA/es/
Disallow /DE/de/
Disallow /GR/en/
Disallow /LR/fr/
Disallow /TZ/en/
Disallow /BG/en/
Disallow /KR/ko/
Disallow /GB/fr/
Disallow /MX/es/
Disallow /FR/en/
Disallow /BJ/en/
Disallow /GN/fr/
Disallow /KH/en/
Disallow /UA/en/
Disallow /PH/fr/
Disallow /CU/es/
Disallow /LR/en/
Disallow /GH/en/
Disallow /PL/en/
Disallow /GP/fr/
Disallow /AT/de/
Disallow /HT/fr/
Disallow /DJ/en/
Disallow /NC/fr/
Disallow /IR/en/
Disallow /DO/es/
Disallow /JO/en/
Disallow /CM/fr/
Disallow /IT/fr/
Disallow /VE/es/
Disallow /ML/fr/
Disallow /SL/fr/
Disallow /RU/ru/
Disallow /SI/en/
Disallow /NZ/en/
Disallow /LU/fr/
Disallow /NL/fr/
Disallow /RO/en/
Disallow /TW/fr/
Disallow /CD/fr/
Disallow /KZ/en/
Disallow /CH/fr/
Disallow /TR/en/
Disallow /RU/en/
Disallow /AO/en/
Disallow /SK/en/
Disallow /HR/en/
Disallow /GF/fr/
Disallow /JP/fr/
Disallow /AU/en/
Disallow /UG/fr/
Disallow /RS/en/
Disallow /EG/fr/
Disallow /MQ/fr/

Other Records

Field Value
sitemap https://www.afklcargo.com/sitemap_index.xml

Comments

  • Robots Exclusion File

Warnings

  • `visit-time` is not a known field.