avatar
Airbyte - ETL ELT Data Pipelines
@airbyte
02.01.2023 21:47
How to create your own Airbyte connector and pull data from Discord API

In this tutorial, we are going to explain how to create an Airbyte source connector for 3 endpoints of the Discord API using Airbyte’s CDK framework.

Among the advantages provided by the cdk system we can mention:
▫️Abstract ourselves from the code handling the connection.
▫️A vast number of pre-designed connectors.
▫️A series of tools to create both a source and a destination with ease.

https://www.fortisoft.io/how-to-create-your-own-airbyte-connector-and-pull-data-from-discord-api/
Fortisoft
How to create your own Airbyte connector and pull data from Discord API - Fortisoft
If you have already completed the official tutorial and the PokeAPI tutorial, and are looking to level up your connector development skills, then you are in
1
2 2.2K
avatar
Airbyte - ETL ELT Data Pipelines
Переслано от канала
05.09.2022 12:03
https://movedata.airbyte.com/

Есть такие ребята Airbyte (https://airbyte.com), конкуренты Airflow, запускатор по расписанию, опенсорсный бесплатный и платный у них в облаке.
Так вот они решили организовать конференцию по Data Engineering.
Есть только даты (8-10 Ноября) и ссылка на Slack, программы пока нет.

Возможно, будет что-то интересное. А может и нет. Just FYI.

P.S. Аудитория подсказывает, что ближайшие конкуренты это Fivetran, Stitch или Hevo. Спасибо @nikbeesti


@ohmydataengineer
Airbyte
move(data) - The data engineering conference
move(data) is celebrating the hard work and dedication of data engineers and practitioners worldwide! We’re hosting talks with speakers who have spent countless hours working on data movement.
1 832
avatar
Airbyte - ETL ELT Data Pipelines
@airbyte
01.08.2022 11:38
The Open Source Data Platform - Airbyte

In Part 2: We are going to build on top of the best orchestration tool on the market, in my opinion, Prefect; while using Airbyte to perform lifts and shifts of data around our databases to ensure data parity and consistency in our Data Platform.

https://kjhealey.medium.com/the-open-source-data-platform-33ff5da0b2db
Medium
The Open Source Data Platform
Part 2 —  Extract and Load: Airbyte
3 683
avatar
Airbyte - ETL ELT Data Pipelines
@airbyte
29.07.2022 14:20
Getting Started w/ Airbyte! | Open Source Data Integration

Airbyte is a data integration tool like Fivetran or Stitch, but completely open source!

In today's video I want to show you how you can easily get started using it.

While there are some limitations compared to the other products, in general Airbyte is incredibly powerful and will be sufficient for most use cases.

They also have a cloud-hosted option that you can pay for if you don’t want to deal with the hassle of setting it up yourself.

But by the end of this video, you'll be able to add this great product to your data engineering toolbox.

https://youtu.be/oeshl0H1JcU
YouTube
Getting Started w/ Airbyte! | Open Source Data Integration
Want to build a reliable, modern data architecture without the mess? Here’s a free checklist to help you → https://bit.ly/kds-checklist Airbyte is a data integration tool like Fivetran or Stitch, but completely open source! In today's video I want to show you how you can easily get started using it. While there are some limitations compared to the other products, in general Airbyte is incredibly powerful and will be sufficient for most use cases. They also have a cloud-hosted option that you can pay for if you don’t want to deal with the hassle of setting it up yourself. But by the end of this video, you'll be able to add this great product to your data engineering toolbox. Timestamps: 00:00 - Intro 01:32 - Install Docker 02:50 - Setup Airbyte via Docker 03:52 - Configure Source | Google Sheet 06:58 - Configure Destination | Snowflake 09:44 - Setup a Connection 12:18 - Load to a Different Schema 13:14 - Add a New Source & Connection Title & Tags: Getting Started w/ Airbyte! | Open Source Data Integration #kahandatasolutions #dataengineering #airbyte
485
avatar
Airbyte - ETL ELT Data Pipelines
@airbyte
20.07.2022 15:14
1 432