walldecorvibes.onshopbase.com
robots.txt

Robots Exclusion Standard data for walldecorvibes.onshopbase.com

Resource Scan

Scan Details

Site Domain walldecorvibes.onshopbase.com
Base Domain onshopbase.com
Scan Status Ok
Last Scan2024-10-29T12:09:12+00:00
Next Scan 2024-11-28T12:09:12+00:00

Last Scan

Scanned2024-10-29T12:09:12+00:00
URL https://walldecorvibes.onshopbase.com/robots.txt
Domain IPs 13.225.4.120, 13.225.4.27, 13.225.4.57, 13.225.4.87
Response IP 13.225.4.120
Found Yes
Hash 6ca35f2c87f18ce4b2b1cd0d8896b8053526f111b2ecc5837f43f6be52070ccd
SimHash 6515de127395

Groups

*

Rule Path
Disallow /admin
Disallow /admin-2
Disallow /login
Disallow /cart
Disallow /checkouts
Disallow /orders
Disallow /my-account
Disallow /search
Disallow /policies
Disallow /*theme_preview_id*
Disallow /checkout-additional
Disallow /password

adsbot-google

Rule Path
Disallow /cart
Disallow /checkouts
Disallow /orders
Disallow /*theme_preview_id*
Disallow /checkout-additional

nutch

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /admin
Disallow /login
Disallow /cart
Disallow /checkouts
Disallow /orders
Disallow /my-account
Disallow /search
Disallow /policies
Disallow /*theme_preview_id*
Disallow /checkout-additional

Other Records

Field Value
crawl-delay 10

ahrefssiteaudit

Rule Path
Disallow /admin
Disallow /login
Disallow /cart
Disallow /checkouts
Disallow /orders
Disallow /my-account
Disallow /search
Disallow /policies
Disallow /*theme_preview_id*
Disallow /checkout-additional

Other Records

Field Value
crawl-delay 10

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

Other Records

Field Value Comment
sitemap https://walldecorvibes.onshopbase.com/sitemap.xml -
sitemap https://walldecorvibes.onshopbase.com/sitemap.xml This will automatically remain your current primary domain to assure correct indexing.
sitemap https://walldecorvibes.onshopbase.com/sitemap.xml This will automatically remain your current primary domain to assure correct indexing.

Comments

  • Google adsbot ignores robots.txt unless specifically named!