barcode.monster
robots.txt

Robots Exclusion Standard data for barcode.monster

Resource Scan

Scan Details

Site Domain barcode.monster
Base Domain barcode.monster
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-12-02T08:29:32+00:00
Next Scan 2025-12-16T08:29:32+00:00

Last Successful Scan

Scanned2025-11-16T08:36:07+00:00
URL https://barcode.monster/robots.txt
Domain IPs 104.21.70.248, 172.67.141.3, 2606:4700:3031::6815:46f8, 2606:4700:3031::ac43:8d03
Response IP 104.21.70.248
Found Yes
Hash f4907651d55aa01d13422f0cb6923c55a8944de5e766b47d1f37c813c8739610
SimHash 28185c05ec83

Groups

*

Rule Path
Disallow /api/

Other Records

Field Value
crawl-delay 10

facebookexternalhit

Rule Path
Disallow /

facebot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

Other Records

Field Value
sitemap https://barcode.monster/sitemap.xml