fabricpatch.net
robots.txt

Robots Exclusion Standard data for fabricpatch.net

Resource Scan

Scan Details

Site Domain fabricpatch.net
Base Domain fabricpatch.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-20T23:11:59+00:00
Next Scan 2024-12-19T23:11:59+00:00

Last Successful Scan

Scanned2024-02-01T20:18:12+00:00
URL https://www.fabricpatch.net/robots.txt
Domain IPs 2600:9000:2204:2000:19:680a:5f00:93a1, 2600:9000:2204:2c00:19:680a:5f00:93a1, 2600:9000:2204:5a00:19:680a:5f00:93a1, 2600:9000:2204:6000:19:680a:5f00:93a1, 2600:9000:2204:6a00:19:680a:5f00:93a1, 2600:9000:2204:9a00:19:680a:5f00:93a1, 2600:9000:2204:ce00:19:680a:5f00:93a1, 2600:9000:2204:f200:19:680a:5f00:93a1, 52.222.139.104, 52.222.139.123, 52.222.139.29, 52.222.139.51
Response IP 18.245.60.46
Found Yes
Hash 4626c905d2055a9b50e343d1df66b172a4815d3a7c02402ba63e848e8eb7d777
SimHash 931c55fa7fa9

Groups

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 4

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

goodzer

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

dotbot
dotbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

checkmarknetwork/1.0 (+http://www.checkmarknetwork.com/spider.html)

Rule Path
Disallow /

seekportbot
mauibot
houzzbot
baiduspider
baiduspider-image
serpstatbot
sogou blog
sogou inst spider
sogou news spider
sogou orion spider
sogou spider2
sogou web spider
uptimebot
yandex
yandexmobilebot
zoominfobot
megaindex.ru
alphaseobot-sa
proximic
amazonbot
petalbot
re-re studio
barkrowler
siteauditbot

Rule Path
Disallow /

semrushbot-ba
semrushbot

Rule Path
Disallow /

Comments

  • See if Semrush can behave - March 2023.
  • Update Nov 2023, no, they can't behave.

Warnings

  • 2 invalid lines.