makewebbetter.com
robots.txt

Robots Exclusion Standard data for makewebbetter.com

Resource Scan

Scan Details

Site Domain makewebbetter.com
Base Domain makewebbetter.com
Scan Status Ok
Last Scan2025-09-18T21:48:20+00:00
Next Scan 2025-10-18T21:48:20+00:00

Last Scan

Scanned2025-09-18T21:48:20+00:00
URL https://makewebbetter.com/robots.txt
Domain IPs 199.250.204.126
Response IP 199.250.204.126
Found Yes
Hash f2f7ff860423560bd7053d92b4076bfa2be7b1f4382f553f7c0170d5b69b0d4d
SimHash 501058565e92

Groups

screeenly-bot 2.0

Rule Path
Disallow /

wget

Rule Path
Disallow /

*

Rule Path
Disallow /api/
Disallow /codecanyon/
Disallow /mwb-license-portal/
Disallow /wordpress/
Disallow /db/
Disallow /js/
Disallow /gift-card-api/
Disallow /gift-card-api-test/
Disallow /gift-card-pdf/
Disallow /pluginupdates/
Disallow /themeupdates/
Disallow /portfolio-type-sitemap.xml
Disallow /author/
Disallow /testimonial-sitemap.xml/
Disallow /attachment-sitemap.xml/
Disallow /compatibility-sitemap.xml/
Disallow /plan_feature-sitemap.xml/
Disallow /deal-sitemap.xml/
Disallow /dummy/
Disallow /confignew/
Disallow /v2/
Disallow /microservice-sitemap.xml/
Disallow /product_tag-sitemap.xml/
Disallow /compatibility/

Other Records

Field Value
sitemap https://makewebbetter.com/sitemap_index.xml

Comments

  • Disallow: /ads/