Compare commits

Home / Compare f70aba72 .. 744c391b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.041-31.041=-0.001
σ0.049-0.049=-0.000
min31.004-31.006=-0.001
max31.176-31.178=-0.001
mean415.900-415.000=0.900
σ0.316-0.000=0.316
min415.000
max416.000-415.000=1.000
mean0.079-0.079=0.000
σ0.003-0.004=-0.001
min0.076-0.077=-0.000
max0.086-0.087=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.144-21.143=0.000
σ0.002-0.003=-0.001
min21.141-21.141=-0.001
max21.147-21.150=-0.003
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.065-0.065=-0.001
σ0.003-0.003=-0.001
min0.063-0.063=0.000
max0.072-0.072=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.411-1751.411=-0.001
σ0.362-0.360=0.001
min1750.847-1750.838=0.009
max1751.990-1751.998=-0.009
mean1652.700-1655.600=-2.900
σ636.529-645.273=-8.744
min636.000-633.000=3.000
max2848.000-2852.000=-4.000
mean2.780-2.841=-0.061
σ0.222-0.129=0.093
min2.176-2.498=-0.322
max2.991-3.024=-0.034

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.783-266.781=0.002
σ0.005-0.010=-0.004
min266.776-266.773=0.003
max266.789-266.797=-0.008
mean2848.000-2852.000=-4.000
σ0.000
min2848.000-2852.000=-4.000
max2848.000-2852.000=-4.000
mean0.366-0.367=-0.002
σ0.004-0.006=-0.002
min0.362-0.363=-0.001
max0.373-0.379=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1927.203-1927.207=-0.005
σ0.019-0.003=0.016
min1927.176-1927.204=-0.028
max1927.227-1927.211=0.016
mean2848.000-2852.000=-4.000
σ0.000
min2848.000-2852.000=-4.000
max2848.000-2852.000=-4.000
mean2.976-3.068=-0.092
σ0.099-0.123=-0.024
min2.875-2.972=-0.097
max3.109-3.260=-0.150
iters=5
new-facts=6402
prior-facts=1
mean4747.690-4747.699=-0.009
σ0.838-0.848=-0.010
min4747.170-4747.190=-0.021
max4749.173-4749.207=-0.034
mean2848.000-2852.000=-4.000
σ0.000
min2848.000-2852.000=-4.000
max2848.000-2852.000=-4.000
mean8.588-8.484=0.105
σ0.520-0.609=-0.089
min7.734-7.677=0.058
max9.057-9.198=-0.141
iters=5
new-facts=6402
prior-facts=6402
mean4938.162-4938.166=-0.005
σ0.095-0.087=0.008
min4938.079-4938.090=-0.011
max4938.270-4938.269=0.000
mean3013.000-3058.200=-45.200
σ184.502-187.182=-2.680
min2848.000-2852.000=-4.000
max3297.000-3322.000=-25.000
mean8.436-8.593=-0.158
σ0.071-0.281=-0.210
min8.355-8.369=-0.014
max8.538-8.925=-0.387

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.058-1.081=-0.023
σ0.197-0.111=0.086
min0.939-0.946=-0.008
max1.394-1.256=0.138

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.122-465.121=0.001
σ575.754-575.766=-0.012
min177.239-177.229=0.010
max1328.753-1328.770=-0.017
mean79.750
σ7.500
min76.000
max91.000
mean2848.000-2852.000=-4.000
σ0.000
min2848.000-2852.000=-4.000
max2848.000-2852.000=-4.000
mean0.437-0.439=-0.001
σ0.303-0.305=-0.002
min0.285-0.283=0.002
max0.892-0.896=-0.004
policies=20
mean1772.625-1772.617=0.008
σ0.330-0.337=-0.007
min1772.389-1772.367=0.022
max1773.109-1773.111=-0.002
mean760.000
σ0.000
min760.000
max760.000
mean2848.000-2852.000=-4.000
σ0.000
min2848.000-2852.000=-4.000
max2848.000-2852.000=-4.000
mean2.820-2.826=-0.006
σ0.003-0.006=-0.003
min2.817-2.819=-0.002
max2.824-2.833=-0.010
policies=200
mean17732.751-17732.544=0.207
σ0.498-0.383=0.115
min17732.398-17732.278=0.120
max17733.488-17733.111=0.377
mean7600.000
σ0.000
min7600.000
max7600.000
mean2848.000-2852.000=-4.000
σ0.000
min2848.000-2852.000=-4.000
max2848.000-2852.000=-4.000
mean28.123-28.108=0.015
σ0.502-0.473=0.029
min27.546-27.575=-0.029
max28.651-28.563=0.089