Compare commits

Home / Compare 5334d425 .. 5b5d0a6b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.041-31.040=0.000
σ0.051-0.049=0.002
min31.003-31.002=0.001
max31.182-31.178=0.004
mean412.000-411.000=1.000
σ0.000
min412.000-411.000=1.000
max412.000-411.000=1.000
mean0.079-0.079=0.001
σ0.003-0.002=0.001
min0.077-0.076=0.001
max0.086-0.084=0.002
cache=y
dps=1
iters=10
policies=100
mean21.142-21.142=0.000
σ0.003-0.002=0.001
min21.138-21.138=-0.000
max21.147-21.146=0.001
mean412.000-411.000=1.000
σ0.000
min412.000-411.000=1.000
max412.000-411.000=1.000
mean0.065-0.065=0.001
σ0.003-0.002=0.001
min0.063-0.063=0.001
max0.072-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.412-1751.413=-0.001
σ0.360-0.363=-0.004
min1750.842-1750.846=-0.004
max1751.987-1752.002=-0.014
mean1634.900-1637.900=-3.000
σ615.674-616.745=-1.071
min629.000-625.000=4.000
max2470.000-2474.000=-4.000
mean2.849-2.861=-0.012
σ0.192-0.153=0.038
min2.214-2.384=-0.170
max3.048-3.053=-0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.784-266.785=-0.000
σ0.010-0.004=0.005
min266.774-266.781=-0.007
max266.799-266.792=0.007
mean2470.000-2474.000=-4.000
σ0.000
min2470.000-2474.000=-4.000
max2470.000-2474.000=-4.000
mean0.378-0.373=0.005
σ0.009-0.002=0.007
min0.372-0.371=0.001
max0.392-0.375=0.017
iters=5
new-facts=1
prior-facts=6402
mean1927.207-1927.204=0.003
σ0.011-0.012=-0.002
min1927.197-1927.185=0.011
max1927.223-1927.219=0.003
mean2470.000-2474.000=-4.000
σ0.000
min2470.000-2474.000=-4.000
max2470.000-2474.000=-4.000
mean2.999-3.056=-0.057
σ0.072-0.095=-0.023
min2.890-2.960=-0.070
max3.088-3.186=-0.098
iters=5
new-facts=6402
prior-facts=1
mean4747.738-4747.767=-0.029
σ0.822-0.785=0.038
min4747.220-4747.357=-0.137
max4749.191-4749.163=0.028
mean2470.000-2474.000=-4.000
σ0.000
min2470.000-2474.000=-4.000
max2470.000-2474.000=-4.000
mean8.317-8.165=0.152
σ0.531-0.425=0.105
min7.810-7.861=-0.051
max9.071-8.911=0.159
iters=5
new-facts=6402
prior-facts=6402
mean4938.166-4938.171=-0.004
σ0.082-0.083=-0.002
min4938.103-4938.106=-0.004
max4938.257-4938.264=-0.006
mean2943.600-2939.800=3.800
σ416.301-389.762=26.540
min2470.000-2474.000=-4.000
max3514.000-3466.000=48.000
mean8.440-8.473=-0.033
σ0.100-0.162=-0.062
min8.340-8.329=0.011
max8.577-8.717=-0.141

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.836-1.839=-0.003
σ0.102-0.148=-0.046
min1.718-1.610=0.108
max1.947-1.979=-0.032

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.112-465.109=0.003
σ575.754-575.755=-0.001
min177.234-177.232=0.002
max1328.743-1328.741=0.002
mean79.750
σ7.500
min76.000
max91.000
mean2470.000-2474.000=-4.000
σ0.000
min2470.000-2474.000=-4.000
max2470.000-2474.000=-4.000
mean0.524-0.575=-0.051
σ0.492-0.590=-0.099
min0.276-0.276=-0.000
max1.261-1.460=-0.199
policies=20
mean1772.593-1772.584=0.009
σ0.347-0.340=0.007
min1772.364-1772.350=0.014
max1773.108-1773.088=0.020
mean760.000
σ0.000
min760.000
max760.000
mean2470.000-2474.000=-4.000
σ0.000
min2470.000-2474.000=-4.000
max2470.000-2474.000=-4.000
mean2.782-2.762=0.020
σ0.025-0.006=0.019
min2.754-2.753=0.001
max2.815-2.766=0.050
policies=200
mean17732.440-17732.357=0.082
σ0.345-0.454=-0.110
min17732.232-17732.052=0.180
max17732.955-17733.021=-0.067
mean7600.000
σ0.000
min7600.000
max7600.000
mean2470.000-2474.000=-4.000
σ0.000
min2470.000-2474.000=-4.000
max2470.000-2474.000=-4.000
mean27.700-27.658=0.042
σ0.065-0.078=-0.013
min27.634-27.544=0.091
max27.785-27.713=0.072