Compare commits

Home / Compare 28422f36 .. 8d1499ad

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.703-70.784=-0.081
σ0.049-0.047=0.001
min70.665-70.748=-0.083
max70.836-70.914=-0.078
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.160-0.158=0.002
σ0.003-0.005=-0.002
min0.156-0.150=0.006
max0.167-0.165=0.002
cache=y
dps=1
iters=10
policies=100
mean21.408-21.493=-0.085
σ0.003-0.002=0.001
min21.405-21.490=-0.085
max21.413-21.496=-0.082
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.065-0.065=-0.001
σ0.003-0.002=0.000
min0.061-0.064=-0.003
max0.072-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.932-1754.895=0.036
σ0.359-0.360=-0.001
min1754.364-1754.322=0.043
max1755.521-1755.486=0.035
mean1646.800-1665.700=-18.900
σ633.021-642.651=-9.630
min622.000-678.000=-56.000
max2785.000-2704.000=81.000
mean2.863-2.798=0.064
σ0.125-0.254=-0.129
min2.637-2.150=0.486
max3.170-3.503=-0.333

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.756-272.759=-0.003
σ0.008-0.006=0.001
min272.747-272.754=-0.007
max272.765-272.767=-0.002
mean2785.000-2704.000=81.000
σ0.000
min2785.000-2704.000=81.000
max2785.000-2704.000=81.000
mean0.379-0.383=-0.005
σ0.001-0.004=-0.003
min0.377-0.379=-0.002
max0.380-0.390=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1933.167-1933.130=0.037
σ0.020-0.011=0.010
min1933.142-1933.121=0.021
max1933.190-1933.146=0.044
mean2785.000-2704.000=81.000
σ0.000
min2785.000-2704.000=81.000
max2785.000-2704.000=81.000
mean2.972-3.103=-0.130
σ0.209-0.094=0.115
min2.611-2.990=-0.379
max3.153-3.189=-0.036
iters=5
new-facts=6402
prior-facts=1
mean4756.797-4753.838=2.959
σ7.662-0.938=6.724
min4752.956-4753.128=-0.172
max4770.495-4755.479=15.016
mean2785.000-2704.000=81.000
σ0.000
min2785.000-2704.000=81.000
max2785.000-2704.000=81.000
mean8.835-8.480=0.355
σ0.342-0.498=-0.156
min8.526-7.962=0.564
max9.300-9.063=0.237
iters=5
new-facts=6402
prior-facts=6402
mean4944.324-4944.357=-0.033
σ0.149-0.018=0.130
min4944.060-4944.332=-0.272
max4944.415-4944.375=0.040
mean3009.600-2996.000=13.600
σ289.774-328.917=-39.143
min2785.000-2704.000=81.000
max3459.000-3465.000=-6.000
mean8.512-8.433=0.079
σ0.167-0.095=0.072
min8.407-8.327=0.080
max8.803-8.564=0.238

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.983-1.104=-0.121
σ0.138-0.142=-0.004
min0.919-0.930=-0.011
max1.230-1.257=-0.027

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.340-468.644=-0.304
σ574.256-574.894=-0.638
min181.203-181.186=0.016
max1329.724-1330.985=-1.261
mean88.250
σ8.500
min84.000
max101.000
mean2785.000-2704.000=81.000
σ0.000
min2785.000-2704.000=81.000
max2785.000-2704.000=81.000
mean0.446-0.583=-0.137
σ0.303-0.594=-0.292
min0.293-0.284=0.009
max0.900-1.475=-0.574
policies=20
mean1812.383-1812.172=0.211
σ0.387-0.379=0.008
min1812.109-1811.926=0.183
max1812.950-1812.733=0.216
mean840.000
σ0.000
min840.000
max840.000
mean2785.000-2704.000=81.000
σ0.000
min2785.000-2704.000=81.000
max2785.000-2704.000=81.000
mean2.911-2.833=0.078
σ0.037-0.022=0.015
min2.873-2.804=0.069
max2.960-2.856=0.104
policies=200
mean18129.148-18129.190=-0.042
σ0.487-0.528=-0.041
min18128.814-18128.806=0.008
max18129.846-18129.970=-0.124
mean8400.000
σ0.000
min8400.000
max8400.000
mean2785.000-2704.000=81.000
σ0.000
min2785.000-2704.000=81.000
max2785.000-2704.000=81.000
mean28.489-28.500=-0.012
σ0.224-0.071=0.152
min28.324-28.413=-0.089
max28.819-28.563=0.256