bddreamjobs.com
robots.txt

Robots Exclusion Standard data for bddreamjobs.com

Resource Scan

Scan Details

Site Domain bddreamjobs.com
Base Domain bddreamjobs.com
Scan Status Ok
Last Scan2025-12-20T21:19:51+00:00
Next Scan 2025-12-27T21:19:51+00:00

Last Scan

Scanned2025-12-20T21:19:51+00:00
URL https://bddreamjobs.com/robots.txt
Domain IPs 104.21.70.2, 172.67.217.1, 2606:4700:3030::ac43:d901, 2606:4700:3034::6815:4602
Response IP 104.21.70.2
Found Yes
Hash 5335b9019d46d979c48aed1b330750d0e34e4b5cecdbceeaac0141d319c63d32
SimHash 7f0159536b90

Groups

*

Rule Path
Disallow /go/
Disallow /test
Disallow /wp-content/themes/astra-child/js
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /wp-content/cache/
Disallow /cgi-bin/
Disallow /xmlrpc.php
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /readme.html
Disallow /license.txt
Disallow /*?*
Disallow /*%26*
Disallow /page/
Disallow */trackback/
Disallow */feed/
Disallow */comments/
Disallow /category/
Disallow /tag/
Disallow /author/
Disallow /archives/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://bddreamjobs.com/sitemap_index.xml

Comments

  • NOTICE: The collection of content and other data on this
  • site through automated means, including any device, tool,
  • or process designed to data mine or scrape content, is
  • prohibited except (1) for the purpose of search engine indexing or
  • artificial intelligence retrieval augmented generation or (2) with express
  • written permission from this site’s operator.
  • To request permission to license our intellectual
  • property and/or other materials, please contact this
  • site’s operator directly.