infinitipartsonline.com
robots.txt

Robots Exclusion Standard data for infinitipartsonline.com

Resource Scan

Scan Details

Site Domain infinitipartsonline.com
Base Domain infinitipartsonline.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-17T14:54:25+00:00
Next Scan 2026-02-15T14:54:25+00:00

Last Successful Scan

Scanned2024-07-02T22:48:11+00:00
URL https://infinitipartsonline.com/robots.txt
Domain IPs 35.169.109.245, 52.4.167.32, 54.198.254.208
Response IP 52.4.167.32
Found Yes
Hash a2b3e611dba8b06e02124308cf106835b15a15fdc41beca730b5224178c6ef2c
SimHash 740c9152e6a0

Groups

amazonbot
anthropic-ai
awariorssbot
awariosmartbot
baiduspider
baiduspider-image
baiduspider-video
bytespider
ccbot
chatgpt-user
claude-web
claudebot
cohere-ai
dataforseobot
dotbot
facebookexternalhit
gptbot
imagesiftbot
magpie-crawler
megaindex
megaindex crawler
mj12bot
omgili
omgilibot
peer39_crawler
peer39_crawler/1.0
perplexitybot
petalbot
rogerbot
seekportbot
semrushbot
semrushbot-sa
yandex
youbot

Rule Path
Disallow /

ahrefsbot
blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

bingbot
msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

adsbot-google
adsbot-google-mobile

Rule Path
Disallow /checkout*

*

Rule Path
Disallow /search*
Disallow /cart*
Disallow /checkout*
Disallow /account*
Disallow /policies*
Allow /