One of the tools I’ve developed as part of the Lean Data Processing Framework is an optimized implementation of the QVD Segmentation technique. This technique is typically used in Qlik Deployments that deal with large datasets, and allows us to split a large table into multiple QVD files. For example, storing one QVD for each month of data, rather than storing the entire dataset in a single file. While this technique has always been around, and other implementations exist that perform the same operation, the modified version that I’m sharing today focuses on reducing the time it takes for the process to complete by avoiding over-processing, and reducing the motion of data required in the process.
Today, I’m pleased to announce the release of RightQlik 2.0, now with support for Qlik Sense(QVF) files. This version of RightQlik integrates with the excellent open source tool corectl, which is built by the Qlik Core team, to provide easy access to advanced operations on QVF files like viewing metadata, exporting scripts and reloading the app with a single click.
The following 14-min video shows how the Delta Tags technique easily replaces another commonly used approach to incremental loads (based on variables) in QlikView and Qlik Sense, and demonstrates why the Delta tags approach makes the process more reliable while still being highly efficient and configurable. Another important aspect of this technique that is demonstrated in the video is how the Delta Tags approach works very well with segmented QVDs (a.k.a partitioned QVDs) in an incremental scenario, something that is not as straightforward to implement with other approaches.
One of the major themes in last week’s Qonnections event in Dallas, TX, was the importance of having a solid Data Strategy in conjunction with a good Analytics Strategy to build and support a robust Data Platform that not only enables but also nurtures a Data Literacy culture within a company. This focus on the [...]
Delta Tags – A new mechanism for efficiently keeping track of incremental reloads in QlikView and Qlik Sense
When working with large datasets in QlikView and Qlik Sense, it’s important to ensure the backend data processing jobs (Extracts and Transforms) perform efficiently, by following best practices to reduce execution time and keep resource usage at a minimum. One of the best practices recommended for efficient data processing is implementing an incremental load strategy, [...]
This time, I’m sharing with you a “QlikView Set Analysis Cheat Sheet”. A resource that I hope you can use as reference when struggling with set analysis expressions and as a quick guide to discovering the full power of set analysis.
We’re lunching an Online Training Center, a place where QlikView users, developers and enthusiasts can share and learn new skills with top-quality QlikView courses. Our first course will be about Set Analysis, and will be delivered in English and Spanish (in separate sessions) by my colleague Barry Harmsen and myself, respectively. Please join us next Friday [...]
RightQlik is a simple custom context menu that’s shown when right clicking on a QVW file. This allows quick access to some common functions that a developer would often perform on a QlikView file.
Me llena de orgullo y satisfacción anunciar la publicación de la versión en español de nuestro libro QlikView 11 para Desarrolladores, el cual es una traducción del libro publicado originalmente en inglés y escrito junto con Barry Harmsen. Este trabajo es fruto de un esfuerzo de varios meses y cuya motivación surge del gran recibimiento que la comunidad QlikView dio a la versión original. ¡Ingresa para más información!
In a recent project in which I participated, one of the main metrics the user wanted to visualize involved mode values. I write about some of the complexities we encountered while implementing it.
It is with great excitement that I post this announcement to let you know a bit more about the "QlikView 11 for Developers" book that my friend Barry and I have co-authored. As you may already know from our initial announcement, the book will officially be released around November 15th (though you can submit [...]
Answers. Only those that have them keep on playing the game. Moreover, those that ask the right questions will always stay in advantage. Everyone that has played any trivia game knows that having the right answers is not an easy feat, but if you've played Jeopardy! you'll know that it is even harder to turn [...]
This is not the common iQlik post, in which I try to share a particular technique, but it is something I would like to share with you and know what you think about it. I've been working with large Apps and I detected a possible feature that would be nice to have on QlikView desktop. Read on...
When dealing with Mega Apps (Qlikview applications in the order of 100+ Million rows), it is important to have a good user perception in calc times. Use this technique to improve performance using the server Cache.
As you know already, I'm a big fan of using Set Analysis in my QlikView applications, especially for Point In Time Reporting. However, there might be some specific situations in which Set Analysis just won't cut it and you need an alternative... Continue Reading to discover it! (Demo Script included...)