autobikes.vn
robots.txt
Robots Exclusion Standard data for autobikes.vn
Resource Scan
Scan Details
Site Domain | autobikes.vn |
Base Domain | autobikes.vn |
Scan Status | Ok |
Last Scan | 2024-11-11T04:42:28+00:00 |
Next Scan | 2024-11-18T04:42:28+00:00 |
Last Scan
Scanned | 2024-11-11T04:42:28+00:00 |
URL | https://autobikes.vn/robots.txt |
Domain IPs | 103.3.245.100 |
Response IP | 103.3.245.100 |
Found | Yes |
Hash | eff652bc29dadf16f07e73a050cba97765ba10c1a6d1c31b726e6bc87673f04e |
SimHash | 014cfc6463b1 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /ajax/ |
Disallow | /sp/ |
Disallow | /services/ |
Disallow | /utilities/ |
Disallow | /Ajax/ |
Disallow | /SP/ |
Disallow | /Services/ |
Disallow | /Utilities/ |
Disallow | /apiservice%40/ |
Disallow | /apicenter%40/ |
Disallow | /widgets%40/ |
Disallow | /member.api/ |
Disallow | /preview_article/ |
Disallow | /stats/ |
Disallow | /slie/ |
Disallow | /article/ |
Disallow | /login/ |
Disallow | /administrator/ |
Disallow | /*.pdf$ |
Disallow | /*.xls$ |
Disallow | /*.xlsx$ |
Disallow | /*.doc$ |
Disallow | /*.docx$ |
Disallow | /act/ |
Disallow | /adsfw/ |
Disallow | /preview_article/ |
Other Records
Field | Value |
---|---|
sitemap | https://autobikes.vn/sitemap.xml |