malls.com
robots.txt
Robots Exclusion Standard data for malls.com
Resource Scan
Scan Details
Site Domain | malls.com |
Base Domain | malls.com |
Scan Status | Ok |
Last Scan | 2024-11-12T03:47:50+00:00 |
Next Scan | 2024-11-19T03:47:50+00:00 |
Last Scan
Scanned | 2024-11-12T03:47:50+00:00 |
URL | https://malls.com/robots.txt |
Redirect | https://www.malls.com/robots.txt |
Redirect Domain | www.malls.com |
Redirect Base | malls.com |
Domain IPs | 104.21.92.106, 172.67.191.233, 2606:4700:3033::6815:5c6a, 2606:4700:3037::ac43:bfe9 |
Redirect IPs | 104.21.92.106, 172.67.191.233, 2606:4700:3033::6815:5c6a, 2606:4700:3037::ac43:bfe9 |
Response IP | 172.67.191.233 |
Found | Yes |
Hash | d8f36190d1c58bbe81b1488a4ad109d7c39600c722b67ec3343bad4d757e3986 |
SimHash | 4b54af45e731 |
Groups
*
Rule | Path |
---|---|
Disallow | /*utm_source%3D* |
Disallow | /*utm_medium%3D* |
Disallow | /*utm_campaign%3D* |
Disallow | /*utm_content%3D* |
Disallow | /*utm_term%3D* |
Disallow | /*bxajaxid%3D* |
Disallow | /rent/ |
Disallow | /*/rent/* |
Disallow | /rest/ |
Disallow | /application/ |
Disallow | /*resize_cache* |
Disallow | /*upload/iblock* |
Disallow | /personal/ |
Disallow | /search/ |
Disallow | /*/search/ |
Disallow | /*/slide_show/ |
Disallow | /*/gallery/*order%3D* |
Disallow | /*countries%3D* |
Disallow | /*cities%3D* |
Disallow | /*letter%3D* |
Disallow | /*currencies%3D* |
Disallow | /*length%3D* |
Disallow | /*%26print%3D |
Disallow | /*register%3D |
Disallow | /*forgot_password%3D |
Disallow | /*change_password%3D |
Disallow | /*login%3D |
Disallow | /*logout%3D |
Disallow | /*auth%3D |
Disallow | /*action%3D* |
Disallow | /*backurl%3D* |
Disallow | /*BACKURL%3D* |
Disallow | /*back_url%3D* |
Disallow | /*BACK_URL%3D* |
Disallow | /*back_url_admin%3D* |
Disallow | /*print_course%3DY |
Disallow | /*COURSE_ID%3D |
Disallow | /*PAGEN_* |
Disallow | /*PAGE_* |
Disallow | /*SHOWALL |
Disallow | /*show_all%3D |
Allow | /bitrix/cache/ |
Allow | /bitrix/js/ |
Allow | /bitrix/templates/ |
Allow | /bitrix/templates/master |
Allow | /bitrix/templates/new |
Allow | /bitrix/panel/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.malls.com/sitemap.xml |
Warnings
- `host` is not a known field.