Cardano Node API: a Cardano Node companion written in Go
Current Project Status
in_progress
Total
amount
Received
₳66600
Total
amount
Requested
₳185000
Total
Percentage
Received
36%
₳66600 Received out of ₳185000
Solution
Develop a Cardano Node API application in Golang to provide data from a Cardano Node over multiple protocols to expose this data easily for consumption by dApp developers.
Problem
Increase interoperability with other ecosystem infrastructure through adopting a community driven communications protocol with a rigid contract for compatibility, shared with TxPipe Dolos.
Impact alignment
Feasibility
Value for money

This proposal was approved and funded by the Cardano Community via Project F11: Cardano Use Cases: Solution Catalyst funding round.

[SOLUTION] Please describe your proposed solution.

The gOuroboros library provides the building blocks for communicating with a Cardano Node as a client in Golang. Our previously funded proposal from Catalyst Fund 9 led to the development of the client side of the protocol. This led to several Proof of Concept implementations within gOuroboros and the creation of Cardano Node API.

The Cardano Node only exposes its client (Node to Client) data over a local UNIX socket as a measure of security. However, this can make the data difficult to access and consume, especially from remote clients. This data is necessary for tasks such as building transactions or monitoring traffic in the node’s mempool.

This proposal intends to leverage this prior work and build upon it to create a query layer solution for interfacing with a Cardano node and expose these Ouroboros Node to Client (NtC) queries over multiple HTTP-based protocols. This will allow for consumption in client applications using methods of the developer’s choosing and provide capabilities for varying security scenarios.

Node protocols (Ouroboros NtC):

  • LocalTxSubmission
  • LocalTxMonitor
  • LocalStateQuery

API protocols:

  • REST
  • WebSockets
  • gRPC

This includes the creation of a Go SDK implementation for the UTxO RPC project to provide the gRPC functionality.

[IMPACT] Please define the positive impact your project will have on the wider Cardano community.

Golang is an extremely popular programming language. GitHub Language Statistics from GitHut 2.0 (code: <https://github.com/madnight/githut> ) show that in Q3 2023, the number of pull requests on Golang repositories grew 10.817% and Haskell repositories grew only 0.162% (source: https://madnight.github.io/githut/#/pull_requests/2023/3/Go,Haskell ) while the number of repository stars on Golang repositories grew 12.215% and Haskell repositories grew only 0.203% (source: <https://madnight.github.io/githut/#/stars/2023/3/Go,Haskell> ). The Golang developer community is over 4x the size of the Haskell developer community, based on the number of Github repos with code for each. Since it’s hard to judge community size, we’re using these numbers as a proxy. We hope to bridge the gap between Golang developers and the Cardano blockchain and attract more developers to Cardano.

Implementing a multi-protocol HTTP-based API will leverage the breadth of existing web technologies for scaling, building, maintaining, and securing HTTP data flows. Creating an API service in Golang allows us to leverage not only our prior work but also the existing code and libraries in the Golang ecosystem. This reduces the time to completion for this project, allows for engaging a larger developer pool for the project, and lowers the barrier for entry into the Cardano ecosystem.

Utilizing UTxORPC for the gRPC interface will ensure interoperability with other Cardano ecosystem projects, such as TxPipe’s Dolos, increasing diversity in the ecosystem while preventing fragmentation due to various implementations.

[CAPABILITY & FEASIBILITY] What is your capability to deliver your project with high levels of trust and accountability? How do you intend to validate if your approach is feasible?

Blink Labs has decades of experience delivering open source software. We have a proven track record of delivery and have successfully completed two previous Catalyst Fund 9 proposals. Our work is open source and public for all to view. Our team is highly cohesive and have worked together for years, allowing us to provide accurate time and cost estimates to our work. The cardano-node-api project is in its infancy and could benefit from dedicated resources. Funding allows us to dedicate engineering time to an open source project, rapidly accelerating its development towards a complete solution.

Our goal is for cardano-node-api to become an integral part of a Cardano development stack for Golang developers upon which a Golang ecosystem on Cardano can thrive. To accomplish this goal, we will build the cardano-node-api application functionality to support a diverse capability set, allowing for creation of an entire ecosystem of downstream projects.

We have broken this into 4 deliverable milestones to reach this goal.

  • Framework and clients
  • REST / WebSockets API
  • UTxO RPC Go SDK / gRPC API
  • Ecosystem integration

Blink Labs will create GitHub issues for the individual items of work and will track those items using a project Kanban board on GitHub.

[Project Milestones] What are the key milestones you need to achieve in order to complete your project successfully?

Milestone 1 will cover the basics of creating the application and supporting the client side query set. This will include:

  • LocalTxSubmission client support
  • LocalStateQuery client support
  • ChainSync client support

>Milestone 2 will cover the creation of the REST API. This will include:

  • Endpoints for LocalTxMonitor via REST
  • Endpoints for LocalTxSubmission via REST
  • Endpoints for LocalStateQuery via REST
  • Endpoints for ChainSync via REST with upgrade to WebSockets

>Milestone 3 will cover the creation of the gRPC API. This will include:

  • Validating and testing the UTxORPC spec
  • Coordinating with other UTxORPC stakeholders on implementation
  • Creating a Go SDK for UTxORPC
  • Endpoints for LocalTxMonitor via gRPC
  • Endpoints for LocalTxSubmission via gRPC
  • Endpoints for LocalStateQuery via gRPC
  • Endpoints for ChainSync via gRPC

>Our 4th and final milestone will cover ecosystem integration. This will include:

  • Verifying and validating results against the spec

  • Testing against other supported ecosystem services, such as Dolos

  • Creation of client SDKs for the API

  • At least one sample application as a Demeter.run starter kit

  • Documentation on pkg.go.dev

  • Documentation on Cardano developer portal

  • Community outreach

    [RESOURCES] Who is in the project team and what are their roles?

The project development will be completed by the Blink Labs engineering team. Our team includes Principal / Staff Engineers, with more than 40 years combined experience. This project will be primarily assigned to Chris Gianelloni (<https://github.com/wolf31o2> ) for development completion, with Aurora Gaffney (<https://github.com/agaffney> ) providing code review, documentation, and support.

Blink Labs has previously completed two Catalyst Fund 9 proposals:

Ouroboros network (NtC) in Golang (dependency to this proposal)

Cardano Submit API in Golang

Additional Blink Labs staff may be used for administrative functions, such as project management and community reporting.

[BUDGET & COSTS] Please provide a cost breakdown of the proposed work and resources.

Funding will primarily pay for engineering time. There is also a small piece set aside for paying administrative staff for project management.

The project budget is 46250 ADA per month to pay for Engineering (40000) and Project Management (6250). Each milestone corresponds to approximately one month, and time is allocated to take approximately 75 percent of a full time software engineer or 120 hours and approximately 10 hours of project management.

No additional funding is necessary for third party products or services.

[VALUE FOR MONEY] How does the cost of the project represent value for money for the Cardano ecosystem?

Costs are estimated on a 333.33 ADA per hour rate for a senior golang blockchain software engineer working remotely within the United States (~ $192k USD annually) and 150 ADA per hour rate for a project manager working remotely (~ $86k USD annually)

Comments

Monthly Reports

close

Playlist

  • EP2: epoch_length

    Authored by: Darlington Kofa

    3m 24s
    Darlington Kofa
  • EP1: 'd' parameter

    Authored by: Darlington Kofa

    4m 3s
    Darlington Kofa
  • EP3: key_deposit

    Authored by: Darlington Kofa

    3m 48s
    Darlington Kofa
  • EP4: epoch_no

    Authored by: Darlington Kofa

    2m 16s
    Darlington Kofa
  • EP5: max_block_size

    Authored by: Darlington Kofa

    3m 14s
    Darlington Kofa
  • EP6: pool_deposit

    Authored by: Darlington Kofa

    3m 19s
    Darlington Kofa
  • EP7: max_tx_size

    Authored by: Darlington Kofa

    4m 59s
    Darlington Kofa
0:00
/
~0:00