Results

This page explains how to interpret the results of the submitted job

After the submitted job finishes successfully without errors, the /livetraining page will show View Results button through which you can navigate to the results page.

Training Results

The following results are available on the dashboard itself:

• Average training and validation accuracy across all sites

• Tensorboard metrics on validation accuracy and loss versus epochs for each site

• Detailed accuracy table for training data and validation data. The columns of each table represent the model whereas the row of each table represents the client site

After you click the Download Results button, a ZIP file with the following content will be downloaded:

1. cross_val_results.json - This file contains all the tracked metrics by site and model. Tracked metrics include:

   1. train_accuracy - Accuracy on training data

   2. val_accuracy - Accuracy on validation data

   3. val_sensitivity - Sensitivity on validation data

   4. val_specificity - Sensitivity on validation data

   5. val_npv - Negative Predictive Value on validation data

   6. auc - Area under the ROC curve on validation data

   7. fpr - False Positive Rate on validation data

   8. tpr - True Positive Rate on validation data

2. logs.txt - Contains the process logs of communication in the federated process

3. FL_global_model.pt - Model weights of the final global model at the end of the training process.

4. best_FL_global_model.pt - Model weights of the best global model in the training process. Best model is determined by the highest accuracy. If you would like to modify the definition of best, please contact us to know more.

5. tb_events - Contains the tensorboard metrics of validation accuracy and loss against local epochs at each site.

Validation Results

The following results are available on the dashboard itself:

• Average accuracy across all sites

• Accuracy of model at each site

After you click the Download Results button, a ZIP file with the following content will be downloaded:

1. cross_val_results.json - This file contains all the tracked metrics by site. Tracked metrics include:

   1. accuracy

   2. sensitivity

   3. specificity

   4. npv - Negative Predictive Value

   5. auc - Area under the ROC curve

   6. fpr - False Positive Rate

   7. tpr - True Positive Rate

2. logs.txt - Contains the process logs of communication in the federated process

Note - If you need any other custom metrics in the process, please contact us and we will implement it as soon as possible for you.