Log In Sign Up

sfpcables.com
robots.txt

Robots Exclusion Standard data for sfpcables.com

Resource Scan

Scan Details

Site Domain sfpcables.com
Base Domain sfpcables.com
Scan Status Ok
Last Scan2025-10-06T19:07:45+00:00
Next Scan 2025-11-05T19:07:45+00:00

Last Scan

Scanned2025-10-06T19:07:45+00:00
URL https://sfpcables.com/robots.txt
Domain IPs 163.181.201.182, 163.181.201.183, 163.181.201.184, 163.181.201.185, 163.181.201.186, 163.181.201.187, 163.181.201.188, 163.181.201.189
Response IP 163.181.201.184
Found Yes
Hash e7f66f32587ff53d447388a4d9dd36c59b94f38403650a81f65b7092d7bb6d19
SimHash 737912dec690

Groups

googlebot

Rule Path
Disallow /onestepcheckout/

*

Rule Path
Disallow /Html
Disallow /catalog/product/upload/
Disallow /catalog/product/view/id/
Disallow /catalogsearch/result/
Disallow /onestepcheckout/

the knowledge ai

Rule Path
Disallow /catalogsearch/result/

gptbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sogou

Rule Path
Disallow /

sosoimagespider

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

almaden

Rule Path
Disallow /

aspseek

Rule Path
Disallow /

axmo

Rule Path
Disallow /

booch

Rule Path
Disallow /

dts agent

Rule Path
Disallow /

downloader

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

expired domain sleuth

Rule Path
Disallow /

franklin locator

Rule Path
Disallow /

gaisbot

Rule Path
Disallow /

grub

Rule Path
Disallow /

hughcrawler

Rule Path
Disallow /

iaea.org

Rule Path
Disallow /

lcabotaccept

Rule Path
Disallow /

iconsurf

Rule Path
Disallow /

iltrovatore-setaccio

Rule Path
Disallow /

indy library

Rule Path
Disallow /

iupui

Rule Path
Disallow /

kittiecentral

Rule Path
Disallow /

iaea.org

Rule Path
Disallow /

larbin

Rule Path
Disallow /

lwp-trivial

Rule Path
Disallow /

metatagrobot

Rule Path
Disallow /

missigua locator

Rule Path
Disallow /

netresearchserver

Rule Path
Disallow /

nextgensearch

Rule Path
Disallow /

npbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

objectssearch

Rule Path
Disallow /

oracle ultra search

Rule Path
Disallow /

peerbot

Rule Path
Disallow /

pictureofinternet

Rule Path
Disallow /

plantynet

Rule Path
Disallow /

quepasacreep

Rule Path
Disallow /

scspider

Rule Path
Disallow /

soft411

Rule Path
Disallow /

spider.acont.de

Rule Path
Disallow /

sqworm

Rule Path
Disallow /

ssm agent

Rule Path
Disallow /

tamu

Rule Path
Disallow /

theusefulbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

tutorial crawler

Rule Path
Disallow /

tutorgig

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webzip

Rule Path
Disallow /

zipppbot

Rule Path
Disallow /

xenu

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

wget

Rule Path
Disallow /

mozdex

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

geedoproductsearch

Rule Path
Disallow /catalogsearch/result/

Other Records

Field Value
crawl-delay 30

petalbot

Rule Path
Disallow /catalogsearch/result/
Disallow /catalog/product/
Back to top

Other Records

Field Value
sitemap https://www.sfpcables.com/Sitemap.xml
Back to top