dbegoodfaith.com
robots.txt

Robots Exclusion Standard data for dbegoodfaith.com

Resource Scan

Scan Details

Site Domain dbegoodfaith.com
Base Domain dbegoodfaith.com
Scan Status Ok
Last Scan2026-01-25T01:44:35+00:00
Next Scan 2026-02-01T01:44:35+00:00

Last Scan

Scanned2026-01-25T01:44:35+00:00
URL https://dbegoodfaith.com/robots.txt
Domain IPs 74.208.245.76
Response IP 74.208.245.76
Found Yes
Hash b3f0aa0e6704f040960bdf76ba95ad8481a54918f3bb5903a98ed41ace84ec52
SimHash 93ba284607f3

Groups

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

*

Rule Path
Disallow /admin/
Disallow /ads/
Disallow /cache.storage/
Disallow /call_center/
Disallow /cgi-bin/
Disallow /cron/
Disallow /css/
Disallow /email_test/
Disallow /email-attach/
Disallow /fonts/
Disallow /include/
Disallow /includes/
Disallow /my-account/
Disallow /new-css/
Disallow /new-imgs/
Disallow /new-includes/
Disallow /planroom/
Disallow /plesk-state/
Disallow /respond/
Disallow /submit_order/
Disallow /test/
Disallow /user_pages/
Disallow /contact-us.php
Disallow /dbe-ads-focus-trade-journal.php
Disallow /dbe-certification-program.php
Disallow /dbe-legal-notice.php
Disallow /dbe-mbe-wbe-contracts.php
Disallow /dbe-mbe-wbe-dvbe-events.php
Disallow /dbe-mbe-wbe-dvbe-news.php
Disallow /dbe-mbe-wbe-sbe-dvbe-events.php
Disallow /get-dbe-mbe-wbe-sbe-dvbe-certified.php
Disallow /good-faith-ad.php
Disallow /good-faith-effort-services.php
Disallow /signup.php
Disallow /user-page.php
Disallow /msg.php
Disallow /verify.php

Other Records

Field Value
crawl-delay 30

Comments

  • robots.txt for https://www.dbegoodfaith.com/