autobiznes.by
robots.txt
Robots Exclusion Standard data for autobiznes.by
Resource Scan
Scan Details
Site Domain | autobiznes.by |
Base Domain | autobiznes.by |
Scan Status | Ok |
Last Scan | 2024-11-14T03:47:01+00:00 |
Next Scan | 2024-12-14T03:47:01+00:00 |
Last Scan
Scanned | 2024-11-14T03:47:01+00:00 |
URL | https://autobiznes.by/robots.txt |
Domain IPs | 76.76.21.123, 76.76.21.164 |
Response IP | 76.76.21.123 |
Found | Yes |
Hash | 61650bf89eed32e5eba160d1403c7e5ce425666060b254578c75cf0a2651e142 |
SimHash | 8f7c4ebfcc02 |
Groups
*
Rule | Path |
---|---|
Disallow | *?* |
Disallow | /api/ |
Disallow | /api2/ |
Disallow | /ajax/ |
Disallow | /cashless/ |
Disallow | /request/ |
Disallow | /services/ |
Disallow | /cab/ |
Disallow | /edit_ts/ |
Disallow | /ts/ |
Disallow | /user-geo |
Disallow | /admin |
Disallow | /wp-admin |
Disallow | /login |
Disallow | /remind |
Disallow | /reglogin |
Disallow | /captcha |
Disallow | /offer |
Disallow | /create_topic |
Disallow | /buy/ |
Disallow | /sale/ |
Disallow | /add/ |
Disallow | /misc/ |
Disallow | /hot/ |
Disallow | /map/ |
Allow | / |
Allow | *.js |
Allow | *.css |
Allow | *.svg |
Allow | *.woff |
Allow | *.webp |
Other Records
Field | Value |
---|---|
sitemap | https://autobiznes.by/sitemap.xml |