Low latency multi-table SQL data is pulled and merged into a hierarchical Json document into Elasticsearch There is a strong need for SQL style database to off load text searches onto a search engine like Elasticsearch. With non-trivial data models there are several technical hurdles that need to be resolved. Elasticsearch requires all search parameters […]
Advantages of using declarative json ETL software JsonEDI is a powerful enterprise declarative ETL tool based on internal Json documents. JsonEDI can read or write to nearly any datasource including SQL, NoSQL , flat files or REST. When reading from non-Json sources, JsonEDI immediately converts the data into Json for processing. Being a declarative programming […]
Semistructured source data with automatic ETL schema generation at SQL destination Problem: A Software as a Service (SaaS) company stores OLTP data in a mixed format of relational and semi-structured data. This multi-tenant data consists of workflow, form data and documents. The company must export the data for their clients in a tabular form by pivoting […]
Data Warehouse ETL vs Data Lake ETL JsonEDI makes a fundamental change of the cost calculus between a Data Lake vs the IDW. A Data Lake is loosely integrated data typically placed in Hadoop. An IDW has tightly integrated data stored in either a relational database and/or Hadoop. Without JsonEDI, data warehouse ETL LOE is […]