Compare commits

Home / Compare ae293974 .. fe4a92df

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.707-70.708=-0.000
σ0.045-0.046=-0.001
min70.675-70.672=0.003
max70.831-70.834=-0.004
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.160-0.162=-0.001
σ0.003-0.004=-0.001
min0.156-0.155=0.002
max0.165-0.168=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.413-21.411=0.002
σ0.003-0.001=0.001
min21.407-21.409=-0.002
max21.416-21.413=0.003
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.065-0.065=-0.000
σ0.003-0.003=0.000
min0.063-0.063=-0.000
max0.073-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.931-1754.933=-0.002
σ0.360-0.360=-0.000
min1754.358-1754.367=-0.009
max1755.526-1755.512=0.014
mean1644.800-1638.900=5.900
σ632.089-629.467=2.622
min621.000-624.000=-3.000
max2770.000-2786.000=-16.000
mean2.824-2.803=0.021
σ0.134-0.214=-0.080
min2.503-2.262=0.241
max3.042-3.122=-0.080

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.792-272.790=0.002
σ0.009-0.006=0.003
min272.781-272.784=-0.003
max272.803-272.799=0.004
mean2770.000-2786.000=-16.000
σ0.000
min2770.000-2786.000=-16.000
max2770.000-2786.000=-16.000
mean0.383-0.380=0.004
σ0.010-0.010=-0.000
min0.378-0.373=0.005
max0.401-0.398=0.003
iters=5
new-facts=1
prior-facts=6402
mean1933.228-1933.221=0.007
σ0.014-0.021=-0.007
min1933.208-1933.200=0.008
max1933.242-1933.251=-0.010
mean2770.000-2786.000=-16.000
σ0.000
min2770.000-2786.000=-16.000
max2770.000-2786.000=-16.000
mean3.019-3.069=-0.050
σ0.175-0.134=0.041
min2.793-2.857=-0.063
max3.283-3.207=0.076
iters=5
new-facts=6402
prior-facts=1
mean4756.964-4756.955=0.009
σ7.679-7.544=0.135
min4753.426-4753.479=-0.052
max4770.699-4770.449=0.251
mean2770.000-2786.000=-16.000
σ0.000
min2770.000-2786.000=-16.000
max2770.000-2786.000=-16.000
mean8.618-8.523=0.095
σ0.569-0.235=0.334
min7.895-8.264=-0.369
max9.401-8.835=0.567
iters=5
new-facts=6402
prior-facts=6402
mean4944.378-4944.446=-0.068
σ0.171-0.023=0.148
min4944.074-4944.423=-0.349
max4944.470-4944.472=-0.002
mean3013.800-3038.800=-25.000
σ302.193-301.161=1.033
min2770.000-2786.000=-16.000
max3461.000-3486.000=-25.000
mean8.435-8.423=0.011
σ0.073-0.088=-0.015
min8.337-8.344=-0.007
max8.502-8.556=-0.054

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.984-1.012=-0.028
σ0.140-0.153=-0.012
min0.917-0.913=0.004
max1.235-1.266=-0.031

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.338-468.339=-0.001
σ574.256-574.258=-0.003
min181.202-181.205=-0.004
max1329.722-1329.727=-0.005
mean88.250
σ8.500
min84.000
max101.000
mean2770.000-2786.000=-16.000
σ0.000
min2770.000-2786.000=-16.000
max2770.000-2786.000=-16.000
mean0.442-0.443=-0.000
σ0.303-0.303=0.001
min0.288-0.288=-0.000
max0.897-0.897=0.001
policies=20
mean1812.359-1812.238=0.120
σ0.388-0.333=0.055
min1812.084-1812.008=0.075
max1812.926-1812.724=0.202
mean840.000
σ0.000
min840.000
max840.000
mean2770.000-2786.000=-16.000
σ0.000
min2770.000-2786.000=-16.000
max2770.000-2786.000=-16.000
mean2.893-2.871=0.022
σ0.022-0.104=-0.082
min2.875-2.813=0.062
max2.920-3.026=-0.106
policies=200
mean18129.106-18129.188=-0.081
σ0.427-0.515=-0.088
min18128.635-18128.887=-0.252
max18129.632-18129.959=-0.327
mean8400.000
σ0.000
min8400.000
max8400.000
mean2770.000-2786.000=-16.000
σ0.000
min2770.000-2786.000=-16.000
max2770.000-2786.000=-16.000
mean28.430-28.434=-0.004
σ0.199-0.194=0.006
min28.220-28.205=0.015
max28.698-28.626=0.071