allmodern.com
robots.txt

Robots Exclusion Standard data for allmodern.com

Resource Scan

Scan Details

Site Domain allmodern.com
Base Domain allmodern.com
Scan Status Ok
Last Scan2024-11-11T13:20:40+00:00
Next Scan 2024-11-18T13:20:40+00:00

Last Scan

Scanned2024-11-11T13:20:40+00:00
URL https://allmodern.com/robots.txt
Redirect https://www.allmodern.com/robots.txt
Redirect Domain www.allmodern.com
Redirect Base allmodern.com
Domain IPs 151.101.1.252, 151.101.129.252, 151.101.193.252, 151.101.65.252
Redirect IPs 104.18.35.8, 172.64.152.248
Response IP 104.18.35.8
Found Yes
Hash 28f289c0e4f8d2b091646bbe8552780dfd30b8838806a9be280806e9006d0ac7
SimHash e9400ae5b655

Groups

ahrefsbot

Rule Path
Disallow /

*

Rule Path
Allow /v/business_account/trade_program/home
Disallow /ajax/
Disallow /filter/
Disallow /filters/
Disallow */filters/
Disallow /hl_landing.php
Disallow /imgview/
Disallow /logodownload.php
Disallow /popups/
Disallow /shop/
Disallow /v/account/
Disallow /vmlt.php
Disallow /a/product/get_product_content
Disallow /v/get_the_look/
Disallow /v/product_review_page/
Disallow /product_review_page/
Disallow /session/secure/
Disallow /asp/
Disallow /deals-and-design-ideas/p/
Disallow /dailyfair/p/
Disallow /daily-sales/se/
Allow /customerservice/shipping_info.php
Disallow /customerservice/
Disallow /ib/
Disallow /param.xml
Disallow /return_sales_items.php
Disallow /session/public/board
Disallow /Staples/
Disallow /v/category/show
Disallow /a/favorites/list/is_favorited
Disallow /a/performance_timing/log
Disallow /b/batch
Disallow /gateway.php
Disallow /pixel/%21crd_prm%21.gif
Disallow /set_location.php
Disallow /v/category/get_top_level_categories
Disallow /v/inventory/load
Disallow /v/product_image_group/get_images
Disallow /session/public/submit_review.php
Disallow /session/public/basket.php
Disallow /v/checkout/
Disallow /registry/browse/
Disallow /registry/checklist/
Disallow /v/ideaboards/
Disallow /v/favorites/
Disallow /compare.php
Disallow /visual_search/
Disallow /finds
Disallow /flashdeals
Disallow /roomplanner/
Disallow /decorator/*
Disallow /service_worker.js
Allow /session/secure/account/rewards_signup.php
Disallow /help/answer/
Disallow /help/
Disallow /Shop-The-Look/filters/
Disallow /blog/wp-content/
Disallow /v/inspiration_gallery/photo_products
Disallow /brands/
Disallow /All-C29046.html
Disallow /deals-and-design-ideas/*.html
Disallow /registry/wedding/
Disallow /roomplanner3d/
Disallow /*?*curpage=*
Disallow /retail/*
Disallow /retail/

Warnings

  • `noindex` is not a known field.