marketbrew.ai
robots.txt

Robots Exclusion Standard data for marketbrew.ai

Resource Scan

Scan Details

Site Domain marketbrew.ai
Base Domain marketbrew.ai
Scan Status Ok
Last Scan2024-09-24T21:00:24+00:00
Next Scan 2024-10-24T21:00:24+00:00

Last Scan

Scanned2024-09-24T21:00:24+00:00
URL https://marketbrew.ai/robots.txt
Domain IPs 3.233.126.24, 34.234.52.18, 52.206.163.162
Response IP 52.206.163.162
Found Yes
Hash 62f720b99ca69f2faa598e3480597400c9fcbb4dbdd818b80f048b2c6b97f041
SimHash 995478556dd0

Groups

*

Rule Path
Disallow /paypal-checkout
Disallow /checkout
Disallow /order-confirmation
Disallow /category/
Disallow /product/

Other Records

Field Value
sitemap https://marketbrew.ai/sitemap.xml

Comments

  • __ __ _ _ ____ _
  • | \/ | | | | | | _ \ (_)
  • | \ / | __ _ _ __ | | __ ___ | |_ | |_) | _ __ ___ __ __ __ _ _
  • | |\/| | / _` | | '__| | |/ / / _ \ | __| | _ < | '__| / _ \ \ \ /\ / / / _` | | |
  • | | | | | (_| | | | | < | __/ | |_ | |_) | | | | __/ \ V V / _ | (_| | | |
  • |_| |_| \__,_| |_| |_|\_\ \___| \__| |____/ |_| \___| \_/\_/ (_) \__,_| |_|