Compare commits

Home / Compare b7cc16c6 .. dc683429

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.968-35.969=-0.001
σ0.107-0.106=0.001
min35.917-35.922=-0.005
max36.272-36.271=0.001
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.077-0.077=0.000
σ0.005-0.004=0.001
min0.071-0.074=-0.003
max0.086-0.085=0.001
cache=y
dps=1
iters=10
policies=100
mean26.205-26.206=-0.001
σ0.005-0.003=0.002
min26.200-26.199=0.001
max26.213-26.211=0.002
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.061-0.061=-0.000
σ0.003-0.003=0.000
min0.058-0.059=-0.001
max0.068-0.068=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.360-1758.372=-0.011
σ0.372-0.371=0.001
min1757.786-1757.795=-0.009
max1758.961-1758.968=-0.007
mean1639.750-1650.400=-10.650
σ628.277-642.707=-14.430
min673.000-679.000=-6.000
max2701.000-2738.000=-37.000
mean2.369-2.402=-0.033
σ0.100-0.109=-0.009
min2.268-2.280=-0.012
max2.614-2.728=-0.113

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.503-279.530=-0.028
σ0.019-0.007=0.012
min279.470-279.524=-0.054
max279.515-279.539=-0.024
mean2701.000-2738.000=-37.000
σ0.000
min2701.000-2738.000=-37.000
max2701.000-2738.000=-37.000
mean0.411-0.413=-0.003
σ0.008-0.008=0.001
min0.403-0.407=-0.004
max0.421-0.426=-0.005
iters=5
new-facts=1
prior-facts=6402
mean2178.450-2178.453=-0.004
σ0.012-0.014=-0.002
min2178.439-2178.437=0.001
max2178.466-2178.474=-0.008
mean2701.000-2738.000=-37.000
σ0.000
min2701.000-2738.000=-37.000
max2701.000-2738.000=-37.000
mean3.502-3.275=0.228
σ0.149-0.335=-0.186
min3.320-2.785=0.535
max3.727-3.726=0.000
iters=5
new-facts=6402
prior-facts=1
mean5056.433-5056.158=0.275
σ1.047-1.259=-0.212
min5055.925-5055.226=0.699
max5058.304-5058.295=0.009
mean2701.000-2738.000=-37.000
σ0.000
min2701.000-2738.000=-37.000
max2701.000-2738.000=-37.000
mean9.129-8.982=0.147
σ0.831-0.257=0.574
min8.149-8.746=-0.597
max10.231-9.404=0.827
iters=5
new-facts=6402
prior-facts=6402
mean5193.790-5193.800=-0.010
σ0.092-0.083=0.009
min5193.684-5193.704=-0.020
max5193.859-5193.870=-0.011
mean3278.400-3199.400=79.000
σ412.593-450.588=-37.996
min2701.000-2738.000=-37.000
max3657.000-3825.000=-168.000
mean9.245-8.742=0.503
σ0.328-0.119=0.209
min8.854-8.660=0.193
max9.631-8.942=0.689

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.995-0.985=0.011
σ0.067-0.055=0.012
min0.935-0.951=-0.016
max1.071-1.082=-0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.470-465.522=-0.052
σ572.660-572.660=0.000
min179.138-179.184=-0.047
max1324.460-1324.512=-0.051
mean79.500
σ7.000
min76.000
max90.000
mean2701.000-2738.000=-37.000
σ0.000
min2701.000-2738.000=-37.000
max2701.000-2738.000=-37.000
mean0.550-0.577=-0.027
σ0.536-0.582=-0.047
min0.280-0.284=-0.004
max1.353-1.450=-0.097
policies=20
mean1791.643-1792.085=-0.441
σ0.347-0.331=0.016
min1791.411-1791.888=-0.477
max1792.159-1792.579=-0.420
mean760.000
σ0.000
min760.000
max760.000
mean2701.000-2738.000=-37.000
σ0.000
min2701.000-2738.000=-37.000
max2701.000-2738.000=-37.000
mean2.784-2.807=-0.023
σ0.024-0.009=0.015
min2.750-2.799=-0.049
max2.802-2.817=-0.016
policies=200
mean17923.071-17927.669=-4.598
σ0.439-0.557=-0.118
min17922.720-17927.298=-4.578
max17923.707-17928.483=-4.776
mean7600.000
σ0.000
min7600.000
max7600.000
mean2701.000-2738.000=-37.000
σ0.000
min2701.000-2738.000=-37.000
max2701.000-2738.000=-37.000
mean28.212-28.374=-0.162
σ0.212-0.033=0.180
min28.038-28.344=-0.306
max28.512-28.421=0.091