Compare commits

Home / Compare 4407df86 .. d482e8e2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.772-35.798=-5.027
σ0.047-0.106=-0.059
min30.750-35.749=-4.999
max30.904-36.099=-5.195
mean413.200-415.900=-2.700
σ0.422-0.316=0.105
min413.000-415.000=-2.000
max414.000-416.000=-2.000
mean0.076-0.076=0.000
σ0.004-0.004=0.001
min0.070-0.073=-0.004
max0.085-0.083=0.002
cache=y
dps=1
iters=10
policies=100
mean21.059-26.064=-5.005
σ0.003-0.003=0.000
min21.056-26.059=-5.003
max21.064-26.067=-5.003
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.064-0.061=0.002
σ0.004-0.003=0.001
min0.058-0.060=-0.001
max0.070-0.070=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.236-1755.923=-4.687
σ0.363-0.367=-0.004
min1750.665-1755.351=-4.687
max1751.802-1756.517=-4.714
mean1658.550-1665.350=-6.800
σ620.724-633.333=-12.609
min689.000-668.000=21.000
max2768.000-2624.000=144.000
mean2.743-2.787=-0.044
σ0.222-0.155=0.067
min2.346-2.269=0.078
max3.169-2.973=0.196

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.565-277.194=-1.629
σ0.005-0.006=-0.001
min275.560-277.185=-1.626
max275.573-277.200=-1.627
mean2768.000-2624.000=144.000
σ0.000
min2768.000-2624.000=144.000
max2768.000-2624.000=144.000
mean0.393-0.393=0.000
σ0.008-0.002=0.007
min0.387-0.392=-0.005
max0.403-0.396=0.007
iters=5
new-facts=1
prior-facts=6402
mean2168.094-2174.435=-6.341
σ0.011-0.006=0.005
min2168.084-2174.429=-6.345
max2168.108-2174.442=-6.334
mean2768.000-2624.000=144.000
σ0.000
min2768.000-2624.000=144.000
max2768.000-2624.000=144.000
mean2.995-2.957=0.038
σ0.170-0.173=-0.003
min2.745-2.721=0.024
max3.189-3.187=0.001
iters=5
new-facts=6402
prior-facts=1
mean5047.919-5052.508=-4.589
σ0.901-1.065=-0.164
min5047.341-5051.575=-4.234
max5049.509-5054.336=-4.827
mean2768.000-2624.000=144.000
σ0.000
min2768.000-2624.000=144.000
max2768.000-2624.000=144.000
mean8.814-9.265=-0.452
σ0.529-0.687=-0.157
min8.152-8.262=-0.109
max9.485-10.055=-0.570
iters=5
new-facts=6402
prior-facts=6402
mean5179.058-5188.358=-9.300
σ0.101-0.210=-0.109
min5178.962-5188.008=-9.047
max5179.175-5188.526=-9.351
mean3304.000-3229.200=74.800
σ401.557-386.322=15.235
min2768.000-2670.000=98.000
max3684.000-3692.000=-8.000
mean10.212-9.015=1.197
σ0.384-0.448=-0.064
min9.914-8.628=1.286
max10.873-9.713=1.160

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.106-1.282=-0.176
σ0.279-0.348=-0.069
min0.943-0.946=-0.003
max1.593-1.705=-0.112

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.199-464.857=-1.658
σ572.655-572.656=-0.001
min176.870-178.523=-1.652
max1322.182-1323.841=-1.659
mean77.500-79.500=-2.000
σ7.000
min74.000-76.000=-2.000
max88.000-90.000=-2.000
mean2768.000-2624.000=144.000
σ0.000
min2768.000-2624.000=144.000
max2768.000-2624.000=144.000
mean0.463-0.548=-0.085
σ0.383-0.535=-0.151
min0.268-0.277=-0.009
max1.038-1.350=-0.312
policies=20
mean1768.972-1785.482=-16.510
σ0.334-0.348=-0.014
min1768.743-1785.254=-16.511
max1769.469-1785.999=-16.531
mean740.000-760.000=-20.000
σ0.000
min740.000-760.000=-20.000
max740.000-760.000=-20.000
mean2768.000-2624.000=144.000
σ0.000
min2768.000-2624.000=144.000
max2768.000-2624.000=144.000
mean2.741-2.780=-0.039
σ0.017-0.005=0.012
min2.726-2.776=-0.050
max2.764-2.788=-0.024
policies=200
mean17696.245-17861.487=-165.242
σ0.482-0.357=0.125
min17695.982-17861.282=-165.300
max17696.967-17862.022=-165.054
mean7400.000-7600.000=-200.000
σ0.000
min7400.000-7600.000=-200.000
max7400.000-7600.000=-200.000
mean2768.000-2624.000=144.000
σ0.000
min2768.000-2624.000=144.000
max2768.000-2624.000=144.000
mean27.805-28.106=-0.301
σ0.157-0.128=0.029
min27.593-27.979=-0.386
max27.966-28.230=-0.265