beformals.com
robots.txt

Robots Exclusion Standard data for beformals.com

Resource Scan

Scan Details

Site Domain beformals.com
Base Domain beformals.com
Scan Status Ok
Last Scan2025-09-15T07:58:21+00:00
Next Scan 2025-10-15T07:58:21+00:00

Last Scan

Scanned2025-09-15T07:58:21+00:00
URL https://beformals.com/robots.txt
Domain IPs 52.10.27.176
Response IP 52.10.27.176
Found Yes
Hash eb6c4ce1dfeaf36cac144a4190bc9b80d37ed307889c9c1775657a87e444ae84
SimHash 6514de1271f4

Groups

*

Rule Path
Disallow /admin
Disallow /admin-2
Disallow /login
Disallow /cart
Disallow /checkouts
Disallow /orders
Disallow /my-account
Disallow /search
Disallow /policies
Disallow /*theme_preview_id*
Disallow /checkout-additional
Disallow /password

adsbot-google

Rule Path
Disallow /cart
Disallow /checkouts
Disallow /orders
Disallow /*theme_preview_id*
Disallow /checkout-additional

nutch

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /admin
Disallow /login
Disallow /cart
Disallow /checkouts
Disallow /orders
Disallow /my-account
Disallow /search
Disallow /policies
Disallow /*theme_preview_id*
Disallow /checkout-additional

Other Records

Field Value
crawl-delay 10

ahrefssiteaudit

Rule Path
Disallow /admin
Disallow /login
Disallow /cart
Disallow /checkouts
Disallow /orders
Disallow /my-account
Disallow /search
Disallow /policies
Disallow /*theme_preview_id*
Disallow /checkout-additional

Other Records

Field Value
crawl-delay 10

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

Other Records

Field Value Comment
sitemap https://beformals.com/sitemap.xml -
sitemap https://beformals.com/sitemap.xml This will automatically remain your current primary domain to assure correct indexing.
sitemap https://beformals.com/sitemap.xml This will automatically remain your current primary domain to assure correct indexing.

Comments

  • Google adsbot ignores robots.txt unless specifically named!