oemdtc.com
robots.txt

Robots Exclusion Standard data for oemdtc.com

Resource Scan

Scan Details

Site Domain oemdtc.com
Base Domain oemdtc.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-02T22:49:31+00:00
Next Scan 2026-02-01T22:49:31+00:00

Last Successful Scan

Scanned2025-10-17T23:31:46+00:00
URL https://oemdtc.com/robots.txt
Domain IPs 104.26.10.179, 104.26.11.179, 172.67.70.95, 2606:4700:20::681a:ab3, 2606:4700:20::681a:bb3, 2606:4700:20::ac43:465f
Response IP 172.67.70.95
Found Yes
Hash 6cb4278ee7e4d2433179c2a3940a18bb878d7e3d3b9fe07951b04282599350bc
SimHash 49ccaa51e1d5

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /cdn-cgi/
Disallow /wp-includes/
Disallow /wp-content/plugins/

Other Records

Field Value
sitemap https://oemdtc.com/sitemap_index.xml
sitemap https://oemdtc.com/Sitemaps/Recalls/Recalls-Sitemap-Index.xml
sitemap https://oemdtc.com/Sitemaps/TSBs/TSBs-Sitemap-Index.xml
sitemap https://oemdtc.com/Sitemaps/Investigations/Investigations-Sitemap-Index.xml
sitemap https://oemdtc.com/Sitemaps/Complaints/Complaints-Sitemap-Index.xml

Comments

  • Allow all bots unless specified
  • Block access to WordPress admin area, but allow AJAX for frontend features
  • Block Cloudflare internal paths (performance/security scripts)
  • Optional: Block any other sensitive system folders (uncomment if needed)
  • Sitemaps for all main content types