A Single place to Discover, Collaborate, and Get your data right

GuinsooLab

Last update: Dec 28, 2022

Overview

A Single place to Discover, Collaborate, and Get your data right

Darkseal

Darkseal includes the following:

Metadata schemas - Defines core abstractions and vocabulary for metadata with schemas for Types, Entities, Relationships between entities. This is the foundation of the Open Metadata Standard.
Metadata store - Stores metadata graph that connects data assets, user, and tool generated metadata.
Metadata APIs - For producing and consuming metadata built on schemas for User Interfaces and Integration of tools, systems, and services.
Ingestion framework - A pluggable framework for integrating tools and ingesting metadata to the metadata store. Ingestion framework already supports well know data warehouses - Google BigQuery, Snowflake, Amazon Redshift, and Apache Hive, and databases - MySQL, Postgres, Oracle, MSSQL, and Guinsoo.
Metadata User Interface - One single place for users to discover, and collaborate on all data.

Snapshots & Gifs

Welcome

New Service

Explore Tables

Table Lineage

Table Schema

Architecture

Darkseal depends on following components to build a metadata platform:

JsonSchemas for defining Metadata Schemas
Dropwizard/Jetty for REST APIs
MySQL 8.x to store Metadata (Guinsoo is coming)
ElasticSearch/OpenElasticsearch 7.x to index Metadata and power

Service Integration

Database Service Support

Athena
AzureSQL
BigQuery
Clickhouse
Databricks
Datalake
Db2
DeltaLake
Druid
DynamoDB
Glue
Hive
MariaDB
Mssql
MySQL
Oracle
Pinot
Postgres
Presto
Redshift
SQLite
Salesforce
SingleStore
Snowflake
Trino
Vertica
GuinsooLab Stack

Message Service Support

Kafka
Pulsar

Dashboard Service Support

Looker
Metabase
Mode
PowerBI
Redash
Superset
Tableau
Spotrix 🚀

Pipeline Service Support

Airbyte
Airflow
Glue
Sheenflow

ML Model Service Support

Mlflow

Documentation & Supports

Contributors

We ❤️ all contributions, big and small! Check out our CONTRIBUTING guide to get started and let us know how we can help.

Don't want to miss anything? Give the project a ⭐ 🚀

License

Darkseal is released under Apache License, Version 2.0

Comments

feat: add ecosystem v2
Describe your changes :

I worked on the ..... because ...

Type of change :

[x] Bug fix

[x] Improvement

[x] New feature

[] Breaking change (fix or feature that would cause existing functionality to not work as expected)

[] Documentation

Frontend Preview (Screenshots) :

For frontend related change, please link screenshots of your changes preview! Optional for backend related changes.

Checklist:

[x] I have read the CONTRIBUTING document.

[ ] I have commented on my code, particularly in hard-to-understand areas.

[ ] I have added tests that prove my fix is effective or that my feature works.

[x] All new and existing tests passed.

Reviewers
opened by ciusji 0
0.11.4 1
Describe your changes :

I worked on the ..... because ...

Type of change :

[x] Bug fix

[x] Improvement

[x] New feature

[] Breaking change (fix or feature that would cause existing functionality to not work as expected)

[] Documentation

Frontend Preview (Screenshots) :

For frontend related change, please link screenshots of your changes preview! Optional for backend related changes.

Checklist:

[x] I have read the CONTRIBUTING document.

[ ] I have commented on my code, particularly in hard-to-understand areas.

[ ] I have added tests that prove my fix is effective or that my feature works.

[x] All new and existing tests passed.

Reviewers
opened by ciusji 0
0.11.4 1
Describe your changes :

I worked on the ..... because ...

Type of change :

[x] Bug fix

[x] Improvement

[x] New feature

[] Breaking change (fix or feature that would cause existing functionality to not work as expected)

[] Documentation

Frontend Preview (Screenshots) :

For frontend related change, please link screenshots of your changes preview! Optional for backend related changes.

Checklist:

[x] I have read the CONTRIBUTING document.

[ ] I have commented on my code, particularly in hard-to-understand areas.

[ ] I have added tests that prove my fix is effective or that my feature works.

[x] All new and existing tests passed.

Reviewers
opened by ciusji 0
0.11.4 1
Describe your changes :

I worked on the ..... because ...

Type of change :

[x] Bug fix

[x] Improvement

[x] New feature

[] Breaking change (fix or feature that would cause existing functionality to not work as expected)

[] Documentation

Frontend Preview (Screenshots) :

For frontend related change, please link screenshots of your changes preview! Optional for backend related changes.

Checklist:

[x] I have read the CONTRIBUTING document.

[ ] I have commented on my code, particularly in hard-to-understand areas.

[ ] I have added tests that prove my fix is effective or that my feature works.

[x] All new and existing tests passed.

Reviewers
opened by ciusji 0
add docs overview
Describe your changes :

I worked on the ..... because ...

Type of change :

[x] Bug fix

[x] Improvement

[x] New feature

[] Breaking change (fix or feature that would cause existing functionality to not work as expected)

[] Documentation

Frontend Preview (Screenshots) :

For frontend related change, please link screenshots of your changes preview! Optional for backend related changes.

Checklist:

[x] I have read the CONTRIBUTING document.

[ ] I have commented on my code, particularly in hard-to-understand areas.

[ ] I have added tests that prove my fix is effective or that my feature works.

[x] All new and existing tests passed.

Reviewers
opened by ciusji 0
0.11.4 1
Describe your changes :

I worked on the ..... because ...

Type of change :

[x] Bug fix

[x] Improvement

[x] New feature

[] Breaking change (fix or feature that would cause existing functionality to not work as expected)

[] Documentation

Frontend Preview (Screenshots) :

For frontend related change, please link screenshots of your changes preview! Optional for backend related changes.

Checklist:

[x] I have read the CONTRIBUTING document.

[ ] I have commented on my code, particularly in hard-to-understand areas.

[ ] I have added tests that prove my fix is effective or that my feature works.

[x] All new and existing tests passed.

Reviewers
opened by ciusji 0
0.11.4 1
Describe your changes :

I worked on the ..... because ...

Type of change :

[x] Bug fix

[x] Improvement

[x] New feature

[] Breaking change (fix or feature that would cause existing functionality to not work as expected)

[] Documentation

Frontend Preview (Screenshots) :

For frontend related change, please link screenshots of your changes preview! Optional for backend related changes.

Checklist:

[x] I have read the CONTRIBUTING document.

[ ] I have commented on my code, particularly in hard-to-understand areas.

[ ] I have added tests that prove my fix is effective or that my feature works.

[x] All new and existing tests passed.

Reviewers
opened by ciusji 0
update `CODE_OF_CONDUCT` link
Describe your changes :

I worked on the ..... because ...

Type of change :

[x] Bug fix

[x] Improvement

[x] New feature

[] Breaking change (fix or feature that would cause existing functionality to not work as expected)

[] Documentation

Frontend Preview (Screenshots) :

For frontend related change, please link screenshots of your changes preview! Optional for backend related changes.

Checklist:

[x] I have read the CONTRIBUTING document.

[ ] I have commented on my code, particularly in hard-to-understand areas.

[ ] I have added tests that prove my fix is effective or that my feature works.

[x] All new and existing tests passed.

Reviewers
opened by ciusji 0
unified guinsoolab-app-bar style
Describe your changes :

I worked on the ..... because ...

Type of change :

[x] Bug fix

[x] Improvement

[x] New feature

[] Breaking change (fix or feature that would cause existing functionality to not work as expected)

[] Documentation

Frontend Preview (Screenshots) :

For frontend related change, please link screenshots of your changes preview! Optional for backend related changes.

Checklist:

[x] I have read the CONTRIBUTING document.

[ ] I have commented on my code, particularly in hard-to-understand areas.

[ ] I have added tests that prove my fix is effective or that my feature works.

[x] All new and existing tests passed.

Reviewers
opened by ciusji 0
add service integration 🌈
Describe your changes :

I worked on the ..... because ...

Type of change :

[x] Bug fix

[x] Improvement

[x] New feature

[] Breaking change (fix or feature that would cause existing functionality to not work as expected)

[] Documentation

Frontend Preview (Screenshots) :

For frontend related change, please link screenshots of your changes preview! Optional for backend related changes.

Checklist:

[x] I have read the CONTRIBUTING document.

[ ] I have commented on my code, particularly in hard-to-understand areas.

[ ] I have added tests that prove my fix is effective or that my feature works.

[x] All new and existing tests passed.

Reviewers
opened by ciusji 0
0.11.4
Describe your changes :

I worked on the ..... because ...

Type of change :

[x] Bug fix

[x] Improvement

[x] New feature

[] Breaking change (fix or feature that would cause existing functionality to not work as expected)

[] Documentation

Frontend Preview (Screenshots) :

For frontend related change, please link screenshots of your changes preview! Optional for backend related changes.

Checklist:

[x] I have read the CONTRIBUTING document.

[ ] I have commented on my code, particularly in hard-to-understand areas.

[ ] I have added tests that prove my fix is effective or that my feature works.

[x] All new and existing tests passed.

Reviewers
opened by ciusji 0

Releases(0.11.4)

0.11.4(Jul 30, 2022)

Source code(tar.gz)
Source code(zip)
0.11.3(Jul 29, 2022)
What' Chanaged?

Fix softDelete should not sent hardDelete true

Redirect to home only if loggedIn flag updates

Remove retry in ES query

Overwrite default sum function to add super for BQ overflow

Airflow/Sheenflow REST - Get last logs 404

Source code(tar.gz)
Source code(zip)

Owner

GuinsooLab

One Platform, Limitless Possibilities

GitHub

Incredible drastically simplifies creation of developer video content. It offers a unified workflow to storyboard, record, collaborate and produce the video.

?? Introduction Incredible drastically simplifies creation of developer video content. It offers a unified workflow to storyboard, record, collaborate

113 Dec 6, 2022

OnePiece /r/place repo to store the template and script for outlining the place to put titles

onepiece-place OnePiece /r/place repo to store the template and script for outlining the place to put titles This script & repo are cloned from Antice

11 Apr 9, 2022

App that receives data from a microcontroller that is set up at your electricity meter, which at certain intervals will send an image to be processed, this then gets sent to a Python instance which will get the data read from the image. That data gets sent back and will be saved to the account this meter belongs to. This gives you the ability to track your currently analog meter in a digtal environment.

Usage App Server About this project App that receives data from a microcontroller that is set up at your electricity meter, which at certain intervals

7 Dec 20, 2022

An easy way to discover and manage your cloud like a local filesystem

cfs An easy way to discover and manage your cloud like a local filesystem. The swiss army knife for finding any resource in your AWS account. ⏬ instal

4 Jun 4, 2022

Make friends through music. Discover great sound tracks on Solana and play them with your buddies :dancer:.

Acoustic Licious COVID-19 has significantly impacted the mental health of children and adults alike. Globally, the population suffering from lonelines

4 Oct 28, 2022

Reddit Place Tracer is a browser based userscript for the 2022 Reddit /r/Place project

Reddit Place Tracer is a browser based userscript for the 2022 Reddit /r/Place project which adds a transparent image on top of the canvas to aid communities with drawing the same image. It shows how the canvas should look, where each pixel goes, and what color. The user must manually click on these spots. It is not an automated bot and does not break any rules.

3 Apr 3, 2022

The /r/place Atlas is a project aiming to catalog all the artworks created during Reddit's 2022 /r/place event.

The 2022 Place Atlas The /r/place Atlas is a project aiming to catalog all the artworks created during Reddit's 2022 /r/place event. This project was

397 Dec 28, 2022

simple jquery Plugin that utilizes Google API to get data from a Place on Google Maps

jQuery Plugin to display Google Reviews of a Place on Google Maps this will get the 5 reviews, google offers you. But I need more than 5 reviews! if y

32 Dec 14, 2022

Fastest way to get financial data from Plaid into your Postgres database. Go from zero to live in 5 minutes without a single line of code.

Venice Venice is a the fastest way to get financial data from Plaid into your Postgres database. Zero to production in 5 minutes without a single line

93 Dec 12, 2022

Big Chief is a website where you find and share everyday cooking inspiration. Discover recipes, cooks, videos, and how-tos based on the food you love.

Big Chief Big Chief is a website where you find and share everyday cooking inspiration. Discover recipes, cooks, videos, and how-tos based on the food

7 Jun 1, 2022

Discover a vast library of open-source Tailwind CSS components and Mobile UI design elements 🚀

SundarUI ?? Discover a vast library of open-source Tailwind CSS components and Mobile UI design elements ?? What is SundarUI? Sundar UI is a library o

4 Mar 19, 2023

A VS Code extension to practice and improve your typing speed right inside your code editor. Practice with simple words or code snippets.

Warm Up ?? ??‍?? A VS Code extension to practice and improve your typing speed right inside your code editor. Practice with simple words or code snipp

34 Dec 12, 2022

A great place for platforms to get started on Cloudflare Workers!

Workers for Platforms Example Project Blog post Docs For SaaS companies, it's challenging to keep up with the never ending requests for customizations

29 Dec 23, 2022

📸 A command-line tool to generate code images of your local code right away from the terminal

?? rayli ?? A command-line tool to generate code images of your local code right away from the terminal Usage Commands Usage $ npm install -g rayli $

45 Nov 4, 2022

Move all the disks from the left hand post to the right hand post, only moving the disks one at a time and a bigger disk can never be placed on a smaller disk.

Hanoi Tower Description The Tower of Hanoi was a famous problem posed by a mathematician in 1883, The "puzzle" is to move all the disks from the left

1 Feb 5, 2022

A Single place to Discover, Collaborate, and Get your data right

Related tags

Overview

Darkseal

Snapshots & Gifs

Welcome

New Service

Explore Tables

Table Lineage

Table Schema

Architecture

Service Integration

Database Service Support

Message Service Support

Dashboard Service Support

Pipeline Service Support

ML Model Service Support

Documentation & Supports

Contributors

License

Comments

Describe your changes :

Type of change :

Frontend Preview (Screenshots) :

Checklist:

Reviewers

Describe your changes :

Type of change :

Frontend Preview (Screenshots) :

Checklist:

Reviewers

Describe your changes :

Type of change :

Frontend Preview (Screenshots) :

Checklist:

Reviewers

Describe your changes :

Type of change :

Frontend Preview (Screenshots) :

Checklist:

Reviewers

Describe your changes :

Type of change :

Frontend Preview (Screenshots) :

Checklist:

Reviewers

Describe your changes :

Type of change :

Frontend Preview (Screenshots) :

Checklist:

Reviewers

Describe your changes :

Type of change :

Frontend Preview (Screenshots) :

Checklist:

Reviewers

Describe your changes :

Type of change :

Frontend Preview (Screenshots) :

Checklist:

Reviewers

Describe your changes :

Type of change :

Frontend Preview (Screenshots) :

Checklist:

Reviewers

Describe your changes :

Type of change :

Frontend Preview (Screenshots) :

Checklist:

Reviewers

Describe your changes :

Type of change :

Frontend Preview (Screenshots) :

Checklist:

Reviewers

Releases(0.11.4)

0.11.4(Jul 30, 2022)

0.11.3(Jul 29, 2022)

What' Chanaged?