
############################## Experiment details ##############################

dataset: femnist
dataset_dir: ../data/femnist/
output_dir: output/fedavg_cnn-2022-08-03_22:56:48/
model: cnn
num_rounds: 100
eval_every: 10
ServerType: <class 'fedavg_cnn_exp.fedavg_cnn.<locals>.make_fedavg_server_client.<locals>.FedAvgServer'>
client_types: [(<class 'fedavg_cnn_exp.fedavg_cnn.<locals>.make_fedavg_server_client.<locals>.FedAvgClient'>, 100)]
clients_per_round: 10
client_lr: 0.06
batch_size: 64
seed: 0
use_val_set: False
num_epochs: 10
gpus_per_client_cluster: 1
num_client_clusters: 2
save_model: False

############################## Simulation ##############################

Spawning 2 ClientClusters using cuda device (this may take a while)
100 total clients: 100 FedAvgClients

>>> Training Accuracy: Round 0 <<<
+------------+------------+-------------------+-------------------+
|    average |     median |   10th percentile |   90th percentile |
|------------+------------+-------------------+-------------------|
| 0.00254635 | 0.00292398 |                 0 |        0.00377645 |
+------------+------------+-------------------+-------------------+
>>> Test Accuracy: Round 0 <<<
+------------+----------+-------------------+-------------------+
|    average |   median |   10th percentile |   90th percentile |
|------------+----------+-------------------+-------------------|
| 0.00330761 |        0 |                 0 |         0.0239286 |
+------------+----------+-------------------+-------------------+
--- Round 1 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 2 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 3 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 4 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 5 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 6 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 7 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 8 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 9 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 10 of 100: Training 10 clients: 10 FedAvgClients ---
>>> Training Accuracy: Round 10 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.564792 | 0.578047 |          0.419502 |          0.679077 |
+-----------+----------+-------------------+-------------------+
>>> Test Accuracy: Round 10 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.557883 | 0.567766 |             0.361 |          0.718376 |
+-----------+----------+-------------------+-------------------+
--- Round 11 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 12 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 13 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 14 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 15 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 16 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 17 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 18 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 19 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 20 of 100: Training 10 clients: 10 FedAvgClients ---
>>> Training Accuracy: Round 20 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.709965 |  0.72902 |          0.550555 |          0.809014 |
+-----------+----------+-------------------+-------------------+
>>> Test Accuracy: Round 20 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.713341 | 0.714286 |          0.498837 |             0.875 |
+-----------+----------+-------------------+-------------------+
--- Round 21 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 22 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 23 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 24 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 25 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 26 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 27 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 28 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 29 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 30 of 100: Training 10 clients: 10 FedAvgClients ---
>>> Training Accuracy: Round 30 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.752476 | 0.763762 |          0.644896 |          0.841549 |
+-----------+----------+-------------------+-------------------+
>>> Test Accuracy: Round 30 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.751378 | 0.767054 |          0.603561 |          0.878815 |
+-----------+----------+-------------------+-------------------+
--- Round 31 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 32 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 33 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 34 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 35 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 36 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 37 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 38 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 39 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 40 of 100: Training 10 clients: 10 FedAvgClients ---
>>> Training Accuracy: Round 40 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|   0.73077 | 0.753986 |          0.574759 |          0.838165 |
+-----------+----------+-------------------+-------------------+
>>> Test Accuracy: Round 40 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|  0.732084 |     0.75 |          0.511538 |          0.886364 |
+-----------+----------+-------------------+-------------------+
--- Round 41 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 42 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 43 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 44 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 45 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 46 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 47 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 48 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 49 of 100: Training 10 clients: 10 FedAvgClients ---
--- Round 50 of 100: Training 10 clients: 10 FedAvgClients ---
>>> Training Accuracy: Round 50 <<<
+-----------+----------+-------------------+-------------------+
|   average |   median |   10th percentile |   90th percentile |
|-----------+----------+-------------------+-------------------|
|   0.80508 | 0.817274 |          0.689551 |          0.888603 |
+-----------+----------+-------------------+-------------------+
>>> Test Accuracy: Round 50 <<<
