Version 1.0
Last Updated: August 2025
Annotareum is a decentralized protocol for data annotation built on Ethereum. It enables data providers, annotators, and validators to collaborate on labeling datasets in a fully transparent and trustless way.
By combining smart contracts, programmable annotation logic, customizable interfaces, and economic incentives, Annotareum is building the infrastructure layer for high-quality AI datasets.
- Introduction
- Participants
- Workflow
- Architecture
- Smart Contracts
- Economic Incentives
- Dispute Resolution
- Reputation System
- Go-to-Market Strategy
- Roadmap
- Tokenomics and DAO
- Tech Stack
- Team
- Conclusion
Traditional annotation platforms are centralized, opaque, and often misaligned with the interests of annotators and data owners. Annotareum introduces a Web3-native protocol where annotation work is open, verifiable, and governed by smart contracts.
Annotareum allows:
- Project creators to define, price, and control annotation pipelines.
- Annotators to earn fair rewards with guaranteed payments.
- Validators to ensure quality and earn bonuses for catching errors.
- All participants to interact via Ethereum wallets — without intermediaries.
- Upload datasets
- Define interface and logic for annotation
- Set prices for annotation and validation
- Fund the smart contract with ETH or tokens
- Control access via
permissions.txt
- View and complete annotation tasks
- Use web interface (generated from
view.py) - Receive automatic payments upon successful validation
- Review completed annotations
- Accept or reject based on guidelines
- Earn fixed fees + bonuses for accurate rejections
- Vote on disputed annotations
- Can be community members or assigned validators
- Participate via DAO governance (future)
- Customer sets up project:
project/
├── data/
├── permissions.txt
├── dataset.py
└── view.py
- Annotators pick available tasks
- Annotators submit annotations via
save_item() - Validators review and approve/reject
- Payments automatically distributed
- If disputed, dispute contract is invoked
- DAO or arbiters resolve the case
# dataset.py
def get_item(idx):
return {"image": f"./data/{idx}.jpg"}
def save_item(idx, data):
# Save annotation data to disk or database
pass# view.py
<View>
<Image source="item.image" />
<Choice choices="cat,dog,other" />
</View>permissions.txtlists Ethereum addresses allowed to annotate or validate.- Data is served via web interface using the CLI:
annotareum serve project/
Contracts are deployed on Ethereum L2 (Optimism/Base).
- Escrow Contract: Holds funds for each annotation/validation
- Validator Contract: Registers decisions and distributes fees
- Dispute Contract: Manages arbitration
- DAO Registry: (planned) governs protocol updates
All interactions emit events:
AnnotationSubmittedAnnotationValidatedDisputeOpenedDisputeResolved
| Case | Annotator | Validator | Outcome |
|---|---|---|---|
| Valid annotation | 100% reward | Verification fee | ✅ All paid |
| Invalid annotation | -50% reward | +50% bonus | |
| Dispute won | 100% reward | 0% | 🏆 Annotator wins |
| Dispute lost | 0% | 100% | ❌ Validator wins |
- Annotation reward: Set by customer per item
- Validation reward: Also set by customer
- Penalty: 50% of annotation fee
- Dispute fee: Paid from escrow
Disputes can be resolved in three ways:
- Direct Validator Arbitration (3-of-N validators vote)
- DAO Voting (via token governance)
- Staking-Based Courts (validators stake tokens to vote)
Only one method is used per project depending on configuration.
Reputation scores will influence:
- Access to premium tasks
- Higher reward multipliers
- Role in governance (validators/arbiters)
- Acceptance ratio
- Dispute win rate
- Completion speed
- Task diversity
Reputation will be stored on-chain or off-chain (zk-based private option planned).
- AI startups and ML teams
- Academic researchers and open dataset creators
- Freelance annotators (web3-savvy)
- Web3 DAOs needing labeled data
- Data-driven DeFi protocols
- Twitter/X and Web3 Discord servers
- HackerNews and Reddit (r/MachineLearning, r/Ethereum)
- Kaggle forums and ML blogs
- Web3 and AI hackathons
- VC/accelerator community demos
- Annotator referral program
- Public leaderboard and rewards
- Integration with HuggingFace datasets
- SDK for annotation-as-code (CI/CD style)
| Quarter | Milestone |
|---|---|
| Q3 2025 | ✅ MVP on Optimism/Base, CLI tooling, simple web UI |
| Q4 2025 | 🌐 IPFS/Arweave for data hosting, hosted dashboard |
| Q1 2026 | ⚖️ Dispute resolution & reputation system |
| Q2 2026 | 🧠 AI-assisted annotation (LLM help) |
| Q3 2026 | 🛒 Job marketplace, template library |
| Q4 2026 | 🪙 Launch Annotareum DAO + Governance token |
Used for:
- DAO governance
- Validator staking
- Dispute resolution votes
- Reputation boosts
| Purpose | % |
|---|---|
| Community Airdrops | 20% |
| Ecosystem Incentives | 20% |
| Team & Advisors | 20% |
| DAO Treasury | 30% |
| Investors | 10% |
- Proposals submitted via DAO frontend
- Vote weights proportional to staked
$ANN - DAO can upgrade protocol parameters
| Layer | Tools |
|---|---|
| Blockchain | Solidity, Optimism/Base |
| Frontend | React + DSL rendering |
| CLI Tool | Python (pip install annotareum) |
| Hosting | IPFS, Arweave (future) |
| Wallet Auth | EIP-191 / MetaMask |
| Payments | ETH, USDC |
| Interop | REST API + Python SDK (Q4 2025) |
Web3 strategist and AI researcher. Leads vision, fundraising, partnerships.
Smart contract and infrastructure developer. Creator of core Annotareum engine and CLI.
- Frontend/Web3 Engineer
- Developer Advocate (AI + Crypto)
- Community Manager (DAO Growth)
Annotareum reimagines the annotation pipeline as an open, permissionless, and economically fair protocol. It puts power back in the hands of data providers and workers, while ensuring quality through incentive alignment and on-chain transparency.
Join us to build a better future for AI — one label at a time.
- GitHub: https://github.com/PieDataLabs/annotareum
- Website: https://annotareum.io
- Twitter/X: https://twitter.com/annotareum
- Email: help@annotareum.io