As summer comes to an end, we thought it would be nice to get some new Kraken goodness into your hands. There's a new ROC Curve card for additional insight on binary Analyses, we've added an all-new predictions Keep Up To Date option to give you control over which predictions Kraken should update over time, and we've added new prediction settings indicators and controls so that you can always see the status of your predictions, make changes when you want and quickly diagnose any problems if they arise. We've also doubled the capacity of Multiclass Analyses from 5 classes to 10!
Binary Classification ROC Curve
When creating a binary Analysis or refining an existing one, you will now see a new ROC Curve card in the new "Model Stats" card group (it's the only card but more cards are coming soon!) to provide insight on how well Kraken is predicting the positive class of your model. In addition to hover text explaining the ROC Curve in Kraken, there is a new "ROC Curve Explained" article that provides additional details about how to use the ROC Curve.
Prediction Keep Up To Date
This is a new control available to you in Kraken. When you create a new prediction, by default Kraken will NOT keep the prediction up to date in the future unless you manually run predictions, or if you enable Keep Up To Date. If you want Kraken to automatically run the predictions on your preset user schedule (i.e. keep the predictions up to date) you need to enable the Keep Up To Date option by clicking the clock icon in the Predictions section of your Project. Keep Up To Date is available for all predictions EXCEPT those powered by CSV file upload.
That will bring up the Prediction Settings screen, where you can enable Keep Up To Date.
If you want to sync your predictions to a database or BI data provider on a regular basis, you will need to enable Keep Up To Date and then also enable the Sync setting. Prediction Sync is available for all predictions EXCEPT those powered by CSV file upload.
IMPORTANT NOTE: All of your EXISTING non-file-upload predictions will use the existing Keep Up To Date setting, which is almost always going to be "Enabled". This is true regardless of whether you are actually syncing your existing predictions to a target data provider. The need to enable Keep Up To Date applies to all of the NEW predictions you create.
Prediction Settings and Status
Kraken now displays both Keep Up To Date and Prediction Sync status directly in the Project Overview screen, so that you always know the status of your predictions. Grey icons indicate a disabled status; green icons indicate an enabled status.
If Kraken encounters a problem with either Keep Up To Date or Prediction Sync settings (such as if your database login credentials become out-of-date or if an apply dataset for a synced prediction is no longer available) Kraken now provides a visual indication by turning the icons orange. Hovering over the "warning triangle" icon will give you more detail about the error Kraken encountered.
Additionally, the Prediction Settings screen has been overhauled to provide easy access to all your prediction settings, with a handy new RUN PREDICTIONS NOW button at the top right of the screen for quick access to manually running your predictions anytime you want, regardless of whether Keep Up To Date and/or Prediction Sync are enabled. Additionally, if everything is working as expected, Kraken will tell you that "Everything is great" so you know there are no problems. If there is a problem, Kraken will tell you that "Something is wrong" and display the details so you can take the appropriate action(s) to resolve it.
If you are using CSV file-upload datasources, the Prediction Settings screen is overhauled for those predictions, too. While you can't set Keep Up To Date and Prediction Sync settings since those aren't applicable to CSV file-upload datasources, you can click the handy new UPDATE PREDICTIONS button to select a new apply dataset AND run predictions from it in a single action.
Multiclass now supports 10 classes
Kraken now supports up to 10 classes for Multiclass Analyses, which is double the previous number of 5 classes. Additionally, Kraken will now warn you if one or more of your classes don't have the minimum number of representative values so that you can take appropriate action by either binning classes together or filtering out underrepresented class values. All of this is to ensure that your Multiclass models produce effective, reliable results.
We've also implemented several bug fixes, minor experience enhancements and performance improvements. Some noteworthy items in this release include:
- When choosing a name for your synced prediction dataset, Kraken now prompts you to confirm the name, to ensure you don't inadvertently create the wrong prediction dataset name.
- The currently-published version of an Analysis is now shown as white text on a grey background; all non-published versions are shown as grey text on a white background; this replaces the green color that previously indicated the published version.
- The Correlations card and Target Correlations card are now completely grouped together within the "Correlations" card group and can be accessed via tabs in both thumbnail and full card view.
- The prediction download icon has been relocated within the Project Overview screen to accommodate the new Keep Up To Date and Prediction Sync icons.
- Kraken now provides as much detail as possible when it encounters a problem with your prediction data providers. Things like invalid username/password, missing apply dataset and the inability to write predictions back due to insufficient write rights to the data provider are now clearly articulated so that you can take appropriate action.
Reminder: If Kraken is misbehaving, check KIKI first.
All Kraken users have access to KIKI, a.k.a. "Kraken Important Known Issues". If you're experiencing an issue with Kraken, KIKI is your first stop to determine if we're aware of the issue. Where possible, we provide suggested workarounds while we work to eliminate issues. KIKI will be updated as we eliminate issues through Kraken product updates, as well as when new issues are identified.
Reminder: SONAR© Guide content is just a click away!
As a Kraken user, you have access to SONAR© Guide, the proven training methodology from Big Squid and your key to learning everything you need to know to use Kraken effectively and become a citizen data scientist hero in the process. A link to the SONAR© Guide content library is accessible whenever you access Kraken help screens; just look for the SONAR© Guide logo on the right-hand side. It's also available in the SONAR© Guide on the Big Squid Support site.