applianceparts.com
robots.txt

Robots Exclusion Standard data for applianceparts.com

Resource Scan

Scan Details

Site Domain applianceparts.com
Base Domain applianceparts.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-15T11:17:23+00:00
Next Scan 2024-12-14T11:17:23+00:00

Last Successful Scan

Scanned2023-04-30T23:48:39+00:00
URL https://applianceparts.com/robots.txt
Domain IPs 104.26.0.215, 104.26.1.215, 172.67.74.55, 2606:4700:20::681a:1d7, 2606:4700:20::681a:d7, 2606:4700:20::ac43:4a37
Response IP 104.26.1.215
Found Yes
Hash 4f5a65b5054f003f4d2ca9f53cb7a2cdac5582ec69d1a673e2b29bdb094f2bcd
SimHash 0a34db706e53

Groups

blexbot

Rule Path
Disallow /

femtosearchbot

Rule Path
Disallow *

baiduspider

Rule Path
Disallow /

weborama-fetcher

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

pricebot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

*

Rule Path
Disallow /search
Disallow /shop/model_research_docs/

Other Records

Field Value
sitemap https://applianceparts.com/sitemap/MasterSiteMap.xml