ET1’s Github CSV Node is designed to help end users extract data from Github CSV URLs which are in public repositories.
A public repository on Github is not a place to put your private or company information. However City/State for USA is a commonly used resource in Map Data related solutions.
Unlike the CSV Input Node, which reads data local on your computer, the Github CSV Node is online data.
Any CSV file online is accessible for extraction with this node, if it’s a functional CSV file.
Quick Start
Paste a link to a CSV. We use Github because it’s a familiar repository for engineers and organizations.
https://raw.githubusercontent.com/MassiveNoobie/ET1_PUB/refs/heads/main/City-ShortState-USA.csv
If you have a link to github csv public repository, you’re ready to get started.
If you need an example, use the following tutorial below.
Finding Github CSVs for your ETL process
Start with www.google.com, search idea:
- <Insert the data source you need> + “Github CSV” would be the best bet.
- However github isn’t a requirement
Example: I found state/city data by googling and then:
- Googling “City State Github CSV”
- Then you’re taken to a page like this screenshot below
- Click RAW..
Clicking RAW drives you to “githubusercontent”.”com”…. Here is where you’re going to grab the URL.
This URL will be pasted in your ET1 Github CSV Node. The screenshot below is what the CSV looks like on Github and what the URL looks like that you’d need to capture. A URL with “.csv” is ideal.
Using Github CSV Node
Extracting data from the Github CSV Node only requires a link, use the one above.
- Follow instructions above to find the URL
- Paste the URL, Github CSV Node will fetch data automatically
- Fetch button: created to “refresh”
- This node will work for any public facing CSV endpoint
- we hope, not all CSV files are created equally
In this example we are pulling data using the Github CSV Node, and writing the data to a file using the CSV Output Node.
A closer view.
Thanks for learning more about ET1’s GitHub CSV Node
We appreciate you using ET1’s GitHub CSV Node, and know if you have any questions… Please contact us.
We would love to hear about your solutions.
Return to ET1 Overview to learn more.