satrucker.co.za
robots.txt
Robots Exclusion Standard data for satrucker.co.za
Resource Scan
Scan Details
Site Domain | satrucker.co.za |
Base Domain | satrucker.co.za |
Scan Status | Ok |
Last Scan | 2024-09-22T00:12:51+00:00 |
Next Scan | 2024-09-29T00:12:51+00:00 |
Last Scan
Scanned | 2024-09-22T00:12:51+00:00 |
URL | https://satrucker.co.za/robots.txt |
Domain IPs | 104.21.70.119, 172.67.223.99, 2606:4700:3033::ac43:df63, 2606:4700:3035::6815:4677 |
Response IP | 172.67.223.99 |
Found | Yes |
Hash | bf01f8f8949fbb8083677feed4c7e749bc980744ff2ff55973983f0021decb8a |
SimHash | 401e49707609 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Allow | /wp-admin/admin-ajax.php |
Allow | /wp-content/uploads/ |
Allow | /wp-content/themes/ |
Allow | /wp-content/plugins/ |
Disallow | /cgi-bin/ |
Disallow | /tmp/ |
Disallow | /junk/ |
Disallow | /trackback/ |
Disallow | /wp-json/ |
Disallow | /*?s= |
Disallow | /*?replytocom= |
Disallow | /*/feed/ |
Disallow | /*/comments/ |
Disallow | /*.php$ |
Other Records
Field | Value |
---|---|
sitemap | https://satrucker.co.za/sitemap.xml |