mallbg.com
robots.txt

Robots Exclusion Standard data for mallbg.com

Resource Scan

Scan Details

Site Domain mallbg.com
Base Domain mallbg.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-14T09:22:34+00:00
Next Scan 2026-04-14T09:22:34+00:00

Last Successful Scan

Scanned2025-05-26T20:30:32+00:00
URL https://mallbg.com/robots.txt
Domain IPs 104.26.2.3, 104.26.3.3, 172.67.68.125, 2606:4700:20::681a:203, 2606:4700:20::681a:303, 2606:4700:20::ac43:447d
Response IP 104.26.2.3
Found Yes
Hash 585b54b6d57b540bfd5adee0df02c8ddf9069a80304a45a4d6c27f558e1c674f
SimHash 401440c2c3f0

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow price_match.php
Disallow chart_data.php
Disallow /assets/uploads/
Disallow /upload/
Disallow /uploadt/
Disallow /manufacturers/

ia_archiver

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /