Tools

/Tools

QVD Segmentation 2.0 – Speeding Up QVD Partitioning by up to 5x

By |2019-09-30T19:35:21-05:00September 30th, 2019|Development, Lean Data Processing, Optimization, Qlik Sense, QlikView, Tools|

One of the tools I’ve developed as part of the Lean Data Processing Framework is an optimized implementation of the QVD Segmentation technique. This technique is typically used in Qlik Deployments that deal with large datasets, and allows us to split a large table into multiple QVD files. For example, storing one QVD for each month of data, rather than storing the entire dataset in a single file. While this technique has always been around, and other implementations exist that perform the same operation, the modified version that I’m sharing today focuses on reducing the time it takes for the process to complete by avoiding over-processing, and reducing the motion of data required in the process.

Announcing RightQlik 2.0 – Now with support for Qlik Sense (QVF) files

By |2019-10-10T13:05:43-05:00July 9th, 2019|Qlik Sense, QlikView, Tools, Uncategorized|

Today, I’m pleased to announce the release of RightQlik 2.0, now with support for Qlik Sense(QVF) files. This version of RightQlik integrates with the excellent open source tool corectl, which is built by the Qlik Core team, to provide easy access to advanced operations on QVF files like viewing metadata, exporting scripts and reloading the app with a single click.

[VIDEO] Incremental Data Extracts with Qlik using Delta Tags and QVD Segmentation

By |2019-05-28T10:31:17-05:00May 27th, 2019|Data Strategy, Delta Tags, Development, Incremental Loads, Lean Data Processing, Tools|

The following 14-min video shows how the Delta Tags technique easily replaces another commonly used approach to incremental loads (based on variables) in QlikView and Qlik Sense, and demonstrates why the Delta tags approach makes the process more reliable while still being highly efficient and configurable. Another important aspect of this technique that is demonstrated in the video is how the Delta Tags approach works very well with segmented QVDs (a.k.a partitioned QVDs) in an incremental scenario, something that is not as straightforward to implement with other approaches.

Delta Tags – A new mechanism for efficiently keeping track of incremental reloads in QlikView and Qlik Sense

By |2019-05-30T22:53:48-05:00April 23rd, 2019|Development, Lean Data Processing, Optimization, Tools|

When working with large datasets in QlikView and Qlik Sense, it’s important to ensure the backend data processing jobs (Extracts and Transforms) perform efficiently, by following best practices to reduce execution time and keep resource usage at a minimum. One of the best practices recommended for efficient data processing is implementing an incremental load strategy, [...]

RightQlik: quick access to common operations on QlikView files

By |2019-07-10T07:01:36-05:00March 24th, 2014|Development, Tools|

RightQlik is a simple custom context menu that’s shown when right clicking on a QVW file. This allows quick access to some common functions that a developer would often perform on a QlikView file.