target.com
robots.txt
Robots Exclusion Standard data for target.com
Resource Scan
Scan Details
Site Domain | target.com |
Base Domain | target.com |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2025-10-13T05:21:33+00:00 |
Next Scan | 2025-10-20T05:21:33+00:00 |
Last Successful Scan
Scanned | 2025-10-05T05:06:11+00:00 |
URL | https://target.com/robots.txt |
Redirect | https://www.target.com/robots.txt |
Redirect Domain | www.target.com |
Redirect Base | target.com |
Domain IPs | 151.101.130.187, 151.101.194.187, 151.101.2.187, 151.101.66.187 |
Redirect IPs | 151.101.130.187, 151.101.194.187, 151.101.2.187, 151.101.66.187 |
Response IP | 146.75.46.187 |
Found | Yes |
Hash | fa89efa1ae24da82228da74e4a28acb2f025ee5a1e8e5bdae9ceb2b94a2d25ce |
SimHash | 2d6449b4180d |
Groups
*
Rule | Path |
---|---|
Disallow | /*/Ntk |
Disallow | /*/Ntt |
Disallow | /*/Ntx |
Disallow | /*%7Cd_ |
Disallow | /*/schoollist/ |
Disallow | /*BTWN |
Disallow | /%5Bpath%5D/ |
Disallow | /7078046/ |
Disallow | /7079046/ |
Disallow | /AddToList |
Disallow | /AddToRegistry |
Disallow | /admin |
Disallow | /advancedGiftRegistrySearchView |
Disallow | /AjaxSearchNavigationView |
Disallow | /Allons_voter |
Disallow | /bp/c/ |
Disallow | /bp/guest_mfg_brand |
Disallow | /bp/p/ |
Disallow | /CallToActionModalView |
Disallow | /cgi-bin |
Disallow | /cgi-local |
Disallow | /Checkout |
Disallow | /CheckoutEditItemsDisplayView |
Disallow | /CheckoutOrderBillingView |
Disallow | /CheckoutOrderShippingView |
Disallow | /CheckoutSignInView |
Disallow | /co- |
Disallow | /common |
Disallow | /coupons. |
Disallow | /custom-reviews/ |
Disallow | /data |
Disallow | /database/philboard.mdb |
Disallow | /deals/ |
Disallow | /dir_on_server/ |
Disallow | /EmailCartView |
Disallow | /EnlargedImageView |
Disallow | /ESPDisplayOptionsViewCmd |
Disallow | /ESPModal |
Disallow | /ExitCheckoutCmd |
Disallow | /FeaturedShowMoreOverlay |
Disallow | /FetchProdRefreshContent |
Disallow | /fiats |
Disallow | /FiatsCmd |
Disallow | /file |
Disallow | /FreeGiftDisplayView |
Disallow | /gam- |
Disallow | /GenericRegistryPortalView |
Disallow | /gc?k |
Disallow | /GiftRegistrySearchViewCmd |
Disallow | /gp/ |
Disallow | /GuestAsAnonymous |
Disallow | /guestEmailNotificationView |
Disallow | /HelpContent |
Disallow | /icons/ |
Disallow | /igp |
Disallow | /index.jhtml |
Disallow | /keyword%3D |
Disallow | /legal-contact-us/ |
Disallow | /list.id%3D1 |
Disallow | /LogonForm |
Disallow | /m/ |
Disallow | /ManageOrder |
Disallow | /ManageReturns |
Disallow | /MediaDisplayView |
Disallow | /mm/ |
Disallow | /moreinfo.cfm |
Disallow | /news |
Disallow | /np/ |
Disallow | /OpenZoomLayer |
Disallow | /OrderItemDisplay |
Disallow | /OtherDisplayView |
Disallow | /p/premium-registry |
Disallow | /PhotoUpload |
Disallow | /pl/ |
Disallow | /ProductComparisonCmd |
Disallow | /ProductDetailsTabView |
Disallow | /PromotionDetailsDisplayView |
Disallow | /PromotionDisplayView |
Disallow | /qi/ |
Disallow | /QuickInfoView |
Disallow | /ready_sit_read/index.jhtml |
Disallow | /RegistryPortalCmd |
Disallow | /ReportAbuse |
Disallow | /reviewVote |
Disallow | /script |
Disallow | /SearchNavigationView |
Disallow | /shop/ |
Disallow | /SingleShipmentOrderSummaryView |
Disallow | /SOImapPriceDisplayView |
Disallow | /SpecificationDefinitionView |
Disallow | /splitOrderItem |
Disallow | /store-locator/search-results-print |
Disallow | /supertarget/index.jhtml |
Disallow | /target_baby/ |
Disallow | /target_group |
Disallow | /targetdirect_group/ |
Disallow | /TargetListPortalView |
Disallow | /TargetStoreLocatorCmd |
Disallow | /tdir/p/kids-back-to-school/ |
Disallow | /tsa/ |
Disallow | /VariationSelectionView |
Disallow | /webapp |
Disallow | /winnt/ |
Disallow | /WriteComments |
Disallow | /WriteReviews |
Disallow | /XCSA/ |
Disallow | /yr |
Disallow | /s? |
Disallow | /cart |
Disallow | /account/ |
Disallow | /tracking |
Disallow | /config |
Disallow | /social/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.target.com/sitemap_keywords-index.xml.gz |
sitemap | https://www.target.com/sitemap_stores-index.xml.gz |
sitemap | https://www.target.com/sitemap_taxonomy-categories-index.xml.gz |
sitemap | https://www.target.com/sitemap_pdp-index.xml.gz |
sitemap | https://www.target.com/sitemap_taxonomy-brand-index.xml.gz |
sitemap | https://www.target.com/sitemap_facet-categories-index.xml.gz |