Please describe your proposed solution
Motivation:
With the recent advancements in AI, many projects have begun integrating AI tools into the Cardano ecosystem. In Fund11 alone, 59 projects featured keywords like AI and LLM in their titles. While this widespread adoption is promising, there's a lack of standardized practices and open-source tools to support these initiatives.
Approach:
We propose a research-driven approach to developing open standards and best practices, consisting of:
- Defining Principles: Establish a set of guiding principles that will form the foundation for the development of standards and best practices.
- Conducting extensive research: Undertake a comprehensive study of existing AI integration practices within the Cardano ecosystem and beyond, identifying gaps, challenges, and opportunities for improvement.
- Developing infrastructure and tooling based on our research: Create open-source tools, libraries, and frameworks that align with the established principles and address the identified challenges.
1. Principles:
We define 4 pillars for the development of standards and best practices for integrating AI with the Cardano blockchain. This includes:
Accessibility: Establishing standardized APIs that facilitate the integration of AI models with Cardano's blockchain infrastructure. This principle aims at lowering the barrier of integrating AI models into decentralized applications.
Certification: Creating comprehensive documentation for AI models that includes details about model performance, training data, and usage instructions. We aim at aggregating publicly available information to issue model cards for existing models, creating a catalog of bundled specifications.
Benchmarking: Developing methods to evaluate AI performance in a blockchain environment, ensuring that AI models are robust, efficient, and scalable. We propose a domain-specific scoring mechanism to establish comparative performance indicators for AI models. To give an example, scoring of Large Language Models (LLMs) can be achieved using an ELO-based scheme, but reweighting this measure by the training set diversity might yield additional insights into the real-world performance of the respective model.
Consensus: Exploring new consensus mechanisms suitable for LLMs that ensure model integrity and reliability in a decentralized setup. With the widespread adoption of LLMs, it is vital to drive the development of independent real-time accuracy measures, enabling to put trust in outputs of high certainty, and vice versa.
2. Research:
Based on the defined principles, we will conduct extensive research to:
- Analyze existing AI integration practices within the Cardano ecosystem, identifying common patterns, challenges, and best practices.
- Study AI integration standards and practices in other blockchain ecosystems and the broader AI community, learning from their successes and failures.
- Investigate the technical feasibility and performance implications of various AI integration approaches, considering factors such as scalability, security, and decentralization.
3. Development:
Informed by our research findings, we will develop open-source tools that facilitate the integration of AI models with the Cardano blockchain. This will include:
- Standardized API: Develop a well-documented and easy-to-use API that abstracts away the complexities of integrating AI models with Cardano's infrastructure, making it easier for developers to build AI-powered decentralized applications.
- Model certification tools: Create tools that automate the generation of comprehensive model documentation, including performance metrics, training data details, and usage instructions. These tools will help ensure transparency and trust in the AI models used within the Cardano ecosystem.
- Benchmarking frameworks: Develop a standardized benchmarking framework that allows for the objective evaluation of AI model performance in a blockchain environment.
- Consensus mechanisms: Explore and implement novel consensus mechanisms specifically designed for LLMs.