Compare commits

Home / Compare c62bed62 .. 02fabb12

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.046-70.707=2.339
σ0.047-0.047=-0.000
min73.020-70.674=2.347
max73.178-70.836=2.342
mean416.000-416.800=-0.800
σ0.000-0.422=-0.422
min416.000
max416.000-417.000=-1.000
mean0.162-0.161=0.002
σ0.004-0.004=-0.000
min0.157-0.157=-0.000
max0.169-0.167=0.002
cache=y
dps=1
iters=10
policies=100
mean23.740-21.410=2.330
σ0.004-0.002=0.002
min23.737-21.407=2.329
max23.748-21.414=2.333
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.064-0.063=0.001
σ0.003-0.003=0.000
min0.061-0.059=0.002
max0.072-0.069=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.785-1754.932=3.853
σ0.366-0.361=0.005
min1758.218-1754.361=3.857
max1759.363-1755.518=3.846
mean1681.700-1662.900=18.800
σ639.635-618.673=20.961
min674.000-627.000=47.000
max2852.000-2510.000=342.000
mean2.838-2.781=0.056
σ0.126-0.193=-0.067
min2.468-2.293=0.175
max3.013-2.997=0.016

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.012-272.792=51.220
σ0.053-0.008=0.045
min323.917-272.780=51.137
max324.044-272.801=51.243
mean2852.000-2510.000=342.000
σ0.000
min2852.000-2510.000=342.000
max2852.000-2510.000=342.000
mean0.427-0.383=0.044
σ0.001-0.007=-0.006
min0.426-0.377=0.048
max0.428-0.396=0.032
iters=5
new-facts=1
prior-facts=6402
mean1984.596-1933.228=51.369
σ0.005-0.011=-0.006
min1984.592-1933.212=51.380
max1984.604-1933.240=51.364
mean2852.000-2510.000=342.000
σ0.000
min2852.000-2510.000=342.000
max2852.000-2510.000=342.000
mean2.565-3.008=-0.443
σ0.095-0.158=-0.064
min2.466-2.752=-0.287
max2.698-3.174=-0.476
iters=5
new-facts=6402
prior-facts=1
mean4808.255-4756.903=51.352
σ7.745-7.605=0.140
min4804.688-4753.131=51.557
max4822.110-4770.502=51.608
mean2852.000-2510.000=342.000
σ0.000
min2852.000-2510.000=342.000
max2852.000-2510.000=342.000
mean8.806-8.343=0.463
σ0.310-0.371=-0.060
min8.508-7.852=0.656
max9.269-8.624=0.645
iters=5
new-facts=6402
prior-facts=6402
mean4995.805-4944.455=51.349
σ0.012-0.020=-0.007
min4995.791-4944.435=51.356
max4995.819-4944.480=51.339
mean3047.200-2992.000=55.200
σ201.770-276.878=-75.108
min2852.000-2618.000=234.000
max3338.000-3328.000=10.000
mean8.713-8.560=0.153
σ0.134-0.172=-0.038
min8.549-8.359=0.189
max8.920-8.787=0.133

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.023-1.606=-0.583
σ0.237-0.189=0.048
min0.916-1.329=-0.413
max1.447-1.842=-0.394

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.351-468.307=0.044
σ574.228-574.228=-0.000
min181.227-181.184=0.043
max1329.693-1329.649=0.044
mean88.250
σ8.500
min84.000
max101.000
mean2852.000-2510.000=342.000
σ0.000
min2852.000-2510.000=342.000
max2852.000-2510.000=342.000
mean0.442-0.568=-0.126
σ0.299-0.566=-0.267
min0.290-0.283=0.008
max0.890-1.416=-0.526
policies=20
mean1812.599-1812.152=0.447
σ0.409-0.370=0.040
min1812.305-1811.919=0.386
max1813.197-1812.702=0.495
mean840.000
σ0.000
min840.000
max840.000
mean2852.000-2510.000=342.000
σ0.000
min2852.000-2510.000=342.000
max2852.000-2510.000=342.000
mean2.899-2.822=0.078
σ0.019-0.004=0.015
min2.884-2.819=0.065
max2.927-2.827=0.100
policies=200
mean18132.081-18129.032=3.050
σ0.579-0.615=-0.036
min18131.456-18128.608=2.848
max18132.803-18129.922=2.881
mean8400.000
σ0.000
min8400.000
max8400.000
mean2852.000-2510.000=342.000
σ0.000
min2852.000-2510.000=342.000
max2852.000-2510.000=342.000
mean28.683-28.394=0.289
σ0.448-0.073=0.375
min28.293-28.319=-0.027
max29.202-28.476=0.726