datasqill /ˈdeɪtə skɪl/ is a lightweight data transformation and data engineering solution for massive data processing in context of data warehousing, data science, data integration and data migration.
datasqill executes transformations directly in the environment where data is stored which leads to higher performance and transparency. datasqill helps customers get the best out of their data storage solutions and brings it to the next level with rich integration capabilities, smart orchestration, reliable scheduling and customizability.
datasqill is an All-in-One solution that allows development, execution, scheduling and monitoring of data transformations, all within one tool, making it a perfect ETL / ELT choice for all data engineering needs.Download Flyer Request a Demo
datasqill@Big Data World in Frankfurt 6-7 November 2018
Meet datasqill at Big Data World 2018 in Frankfurt! Big Data World is an international conference that deals with practical aspects of using data to support business. It is a “How to” – Event focusing on big data, massive data and cloud.
Big Data World 2018
"noETL, yesSQL – why ELT and SQL are the optimal choice for a modern Data Warehouse" in the German Oracle User Group Magazine
The article of datasqill Co-Developer has recently been published in the German Oracle User Group Magazine. The article deals with using ELT (extract, load, transform) approach as opposed to ETL approach in context of data warehousing. Graphical data transformation is also compared to development with SQL. The author provides real world examples and blueprints for ELT-based data transformation architectures.
Download article in German
German Oracle User Group Magazine
datasqill@TDWI Conference 2018 24-25 June in Munich
European TDWI Conference offers practitioners in Business Intelligence and Analytic a professional education and training. The conference is an integral part of the calendar of BI experts. For example, BI project leaders, BICC leaders, Business & Data Analysts and Consultants, and BI professionals at the BI Community industry gathering.
datasqill's Co-Developer Alec Shalashou is giving a talk on "noETL, yesSQL - Why ELT and SQL are the optimal choice for a modern Data Warehouse"
TDWI Konferenz 2018
datasqill@Exasol Xperience 2018 11-13 June in Berlin
Meet datasqill at Exasol Xperience in Berlin. Exasol is the innovative in-memory analytics database that you need to take your business to the next level. Understand your business faster & easier. Meet Exasol users, partner and analysts in Berlin at Exasol Xperience 2018.
Exasol Xperience 2018
Transformations get executed directly in the environment where data is stored, which allows using datasqill for performant and transparent data processing for ELT and ETL Scenarios. Resources of respective databases are optimally used and new features like In-Memory or MPP are seamlessly supported.
SQL is a universal interface language for databases and Hadoop (SQL-on-Hadoop). SQL can be used in all project stages from prototyping to implementation thus making development process more streamlined, agile and debugging process more transparent as the code is directly executable.
datasqill identifies dependencies between transformations based on the metadata and executes them in a correct order without needing to create special job nets thus saving developers effort and minimizing mistakes. Historical execution statistics are used for optimization of the future runs.
datasqill provides a number of modules to streamline transformation routines, amongst them In-Database Transformation, Flat Files Handling, Web Services Communication, Integration with Reporting Tools and External Schedulers. Custom modules can be built using generic or database-native technologies (Java, PL/SQL, Shell-Scripting, Lua, PL/pgSQL) and seamlessly integrated.
Out-of-the-Box Solution for technical and business data historization (Bitemporal Data Historization) for databases allows efficient Data Management for scenarios like Slowly Changing Dimensions (SCD2), Data Staging and maintaining mapping tables in Data Warehousing without writing a single line of code.
datasqill allows flexible scheduled execution of transformation batches while considering inter-batch dependencies. Monitoring views provide visual insights into running batches and give operators control over executed processes.
datasqill attracted our attention by its concepts of In-Database Execution and Development with SQL.
Using SQL for analysis, implementation and testing allowed a smooth transition between project phases. Execution of the transformations directly in the database ensured performant operations. Further features like smart scheduling, intuitive UI, standardized modularity and customizability have convinced us even more.
datasqill supports short development cycles and stable operations as opposed to many other ETL Solutions. This all made datasqill one of the pillars of our Data Warehouse. The achievements during implementation of our Data Warehouse were noted by CIO Magazine and Business Application Research Center (BARC) in Germany.
Christof Grill, Head of BICC
M-net Telekommunikations GmbH
Development of datasqill was sponsored in part by the grant of Innovational Program “Bayern Innovativ“ of the state of Bavaria in Germany. We are glad that concepts and ideas of the solution are convincing and have received that degree of recognition. Implementation was carried out in cooperation with Hochschule Rosenheim and Goethe-University Frankfurt.
Graphical modeling of data transformation flows combined with Implementation of business logic in SQL make datasqill an easy-to-learn and powerful tool for ETL-Developers. datasqill allows developers to focus on the efficient implementation of business requirements instead of learning proprietary ETL Tools with their specifics and limitations.
Cezary Drozd, CEO
blue veery GmbH
datasqill is the ideal tool for implementation, execution and monitoring of ELTs and ETLs for Data Warehousing and Business Intelligence, staging source systems data, loading 3NF cores, Star-Schemas, Data Vaults and communication with reporting systems.
Data transformations get propagated directly into the environment where data is stored which is especially important technique to process large amounts of data. By doing so, datasqill allows achieving high performance and minimizing network traffic when working with mass data or big data.
Data integration from heterogeneous data sources (Databases, Flat Files, Web Services), parsing different formats (e.g. CSV, XML, JSON), transforming und exporting processed data can be easily automated with datasqill.
datasqill supports communication via web services, allows performing data transformations cross-environment and provides an overview of processes running In-the-Cloud and On-Premises, so that the customers have their transformation landscape under control disregarding of its distribution.
datasqill runs native transformations in database with SQL or database-native scripting (PL/SQL, Lua), thus eliminating unnecessary layer in form of ETL application server and utilizing natural power of In-Memory or MPP Databases for transformations.
Data Transformation and Data Preparation for migration from legacy into new systems is easily implementable with datasqill. Data can be extracted from the legacy system, cleansed, transformed, mapped and populated directly into the new system or exported as a flat file.
datasqill was with by SoftQuadrat GmbH in Germany
We would be glad to show you how datasqill can improve your data transformation processes and address your data engineering challenges.
We are also interested in getting in contact with consulting companies that find datasqill attractive for their customers.
Tel.: +49 8095 875927