justsolvd.com
robots.txt

Robots Exclusion Standard data for justsolvd.com

Resource Scan

Scan Details

Site Domain justsolvd.com
Base Domain justsolvd.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-09-20T14:59:23+00:00
Next Scan 2025-12-19T14:59:23+00:00

Last Successful Scan

Scanned2023-07-17T14:55:00+00:00
URL https://justsolvd.com/robots.txt
Domain IPs 52.10.27.176
Response IP 52.10.27.176
Found Yes
Hash 295d5144c75072c327138a6725774a6aae16607854d429f50db2b081a0901b7d
SimHash 6515de1271f5

Groups

*

Rule Path
Disallow /admin
Disallow /admin-2
Disallow /login
Disallow /cart
Disallow /checkouts
Disallow /orders
Disallow /my-account
Disallow /search
Disallow /policies
Disallow /*theme_preview_id*
Disallow /checkout-additional
Disallow /password

adsbot-google

Rule Path
Disallow /cart
Disallow /checkouts
Disallow /orders
Disallow /*theme_preview_id*
Disallow /checkout-additional

nutch

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /admin
Disallow /login
Disallow /cart
Disallow /checkouts
Disallow /orders
Disallow /my-account
Disallow /search
Disallow /policies
Disallow /*theme_preview_id*
Disallow /checkout-additional

Other Records

Field Value
crawl-delay 10

ahrefssiteaudit

Rule Path
Disallow /admin
Disallow /login
Disallow /cart
Disallow /checkouts
Disallow /orders
Disallow /my-account
Disallow /search
Disallow /policies
Disallow /*theme_preview_id*
Disallow /checkout-additional

Other Records

Field Value
crawl-delay 10

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

Other Records

Field Value Comment
sitemap https://justsolvd.com/sitemap.xml -
sitemap https://justsolvd.com/sitemap.xml This will automatically remain your current primary domain to assure correct indexing.
sitemap https://justsolvd.com/sitemap.xml This will automatically remain your current primary domain to assure correct indexing.

Comments

  • Google adsbot ignores robots.txt unless specifically named!