petrotimes.vn
robots.txt
Robots Exclusion Standard data for petrotimes.vn
Resource Scan
Scan Details
Site Domain | petrotimes.vn |
Base Domain | petrotimes.vn |
Scan Status | Ok |
Last Scan | 2024-10-30T04:12:57+00:00 |
Next Scan | 2024-11-06T04:12:57+00:00 |
Last Scan
Scanned | 2024-10-30T04:12:57+00:00 |
URL | https://petrotimes.vn/robots.txt |
Domain IPs | 104.21.18.168, 172.67.182.194, 2606:4700:3035::6815:12a8, 2606:4700:3036::ac43:b6c2 |
Response IP | 172.67.182.194 |
Found | Yes |
Hash | c28c9fe8ff7eefa78c4fd18406045ac4b14504e459edd90acf2074d8ee69db0c |
SimHash | 2910d8626bb3 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /modules/administrator/ |
Disallow | /ajax/ |
Disallow | /apicenter%40/ |
Disallow | /services/ |
Disallow | /utilities/ |
Disallow | /Ajax/ |
Disallow | /SP/ |
Disallow | /Services/ |
Disallow | /Utilities/ |