This tutorial shows you how to transfer data from GitHub using Singer.io to TerminusDB and TerminusX. DevRel Associate, Cheuk, walks you through an example to show how easy it is to get data from GitHub into TerminusDB/X to start using within applications and business intelligence.
If you’re not familiar with Singer, it is a simple and composable open-source ETL tool. It has taps that extract data from any source and write it to a standard stream in a JSON-based format. And it has targets that consumes data from taps and does something with it, like load it into a file, API, or database.
The tutorial highlights how simple it is to use Singer.io to ETL data from GitHub into a schema-driven document graph database, like TerminusDB/X. With lots of pre-configured taps, Singer.io enables you to extract data from a variety of different sources, such as Google Analytics, Salesforce, and Pendo, to build pictures with data to use across application development and business intelligence.
This tutorial is in Python, and covers the following topics:
- Check your endpoint is running
- Install and set up the GitHub tap
- Install the TerminusDB target
- Start the project
- Import data from GitHub in TerminusDB/X
- Verify the data is in TerminusDB/X
For the full tutorial detailing how to transfer data from GitHub with Singer.io to TerminusX, please visit our GitHub repo. Check out the other tutorials in the blog too.
Other tutorials you might like
Transfer data to Google Sheets using Singer.io
Getting Started with TerminusDB using the Python Client
How to build a React backend with TerminusX
Open API for JSON Diff and Patch
And for even more TerminusDB and TerminusX tutorials we have a repository on GitHub focused on both Python and JavaScript. TerminusDB Tutorial Repository.