Harbor
An agent evaluation framework designed for long-horizon, stateful tasks. It integrates with LangChain and provides the ability to track intermediate states throughout an agent's multi-step execution process, facilitating systematic assessment of agent behavior over extended interactions.
Timeline (last 90 days)
Harbor's desktop runtime states in a code comment: replaying clicks is not idempotent.
Harbor received 102 upvotes on Product Hunt, ranking 4th for the day.
Community feedback for Harbor on Product Hunt is limited, with only 1 comment.
Harbor provides full data export functionality across all plans.
Harbor is categorized under Productivity, Notes, and Privacy.
Harbor offers a one-step Evernote import feature.
Harbor covers Mac, Windows, iPhone, iPad, Android, and Web, and also provides a CLI command-line tool.
Harbor supports searching across notes, scans, PDFs, and recordings, with its OCR capability covering handwritten content.
Harbor was built by Spicer Matthews and is positioned as a private second brain, covering multiple content types including notes, scans, PDFs, and recordings.
Harbor promises a price lock for three years, after which annual increases are capped at 10%.
12 more timeline events
All Facts (19)
Harbor is a standardized platform for conducting Agent evaluations
85%UnverifiedThe ability to transform execution traces or raw data into Harbor evaluation tasks is a key skill in Agent evaluation
75%UnverifiedHarbor was originally a basic tool built with Sonnet 3.5.
60%UnverifiedHarbor's desktop runtime states in a code comment: replaying clicks is not idempotent.
50%UnverifiedHarbor promises a price lock for three years, after which annual increases are capped at 10%.
50%UnverifiedHarbor was built by Spicer Matthews and is positioned as a private second brain, covering multiple content types including notes, scans, PDFs, and recordings.
50%UnverifiedHarbor supports searching across notes, scans, PDFs, and recordings, with its OCR capability covering handwritten content.
50%UnverifiedHarbor covers Mac, Windows, iPhone, iPad, Android, and Web, and also provides a CLI command-line tool.
50%UnverifiedHarbor offers a one-step Evernote import feature.
50%UnverifiedHarbor is categorized under Productivity, Notes, and Privacy.
50%UnverifiedHarbor provides full data export functionality across all plans.
50%UnverifiedThe blogger used Opus 4.5 to refactor the entire Harbor system on Next.js and Convex.
50%UnverifiedThe blogger rebuilt the product Harbor on Next.js and Convex using Opus 4.5, and the product is now a SaaS generating $10,000 per month.
50%UnverifiedEach model was run using either Terminus-2 or one of three native harnesses
50%UnverifiedHarbor Adapters ported over 80 benchmarks into a framework capable of evaluating any Agent by developing a unified adapter layer
50%UnverifiedThe research related to Harbor was published as a paper on arXiv
50%UnverifiedThe research team selected 8 models spanning different capability tiers and conducted cross-evaluations across 54 benchmarks
50%UnverifiedGitLab、Harbor、Thanos 等开源项目都将 S3 兼容存储作为推荐甚至默认的持久化方案
50%UnverifiedThe research team released all adapters, evaluation results, in-depth analysis reports, and Harbor-Index as open-source resources
50%