Compare commits

Home / Compare 3e5ebe3d .. bf770435

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.999-35.997=0.003
σ0.104-0.102=0.002
min35.958-35.957=0.001
max36.295-36.286=0.009
mean4153.000-3828.000=325.000
σ0.000
min4153.000-3828.000=325.000
max4153.000-3828.000=325.000
mean0.076-0.076=-0.000
σ0.000-0.003=-0.003
min0.075-0.070=0.005
max0.077-0.083=-0.006
cache=y
dps=1
iters=10
policies=100
mean26.219-26.215=0.004
σ0.003-0.006=-0.003
min26.214-26.206=0.009
max26.223-26.223=-0.000
mean4153.000-3828.000=325.000
σ0.000
min4153.000-3828.000=325.000
max4153.000-3828.000=325.000
mean0.060-0.061=-0.001
σ0.001-0.002=-0.001
min0.059-0.059=-0.000
max0.061-0.066=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.370-1756.372=-0.002
σ0.372-0.373=-0.001
min1755.797-1755.791=0.006
max1756.961-1756.968=-0.007
mean1660.750-1660.450=0.300
σ625.325-626.577=-1.253
min619.000-615.000=4.000
max2667.000-2637.000=30.000
mean2.260-2.296=-0.036
σ0.121-0.142=-0.020
min2.050-2.162=-0.112
max2.615-2.742=-0.127

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.701-278.701=0.001
σ0.009-0.013=-0.004
min278.691-278.686=0.006
max278.713-278.721=-0.008
mean2667.000-2637.000=30.000
σ0.000
min2667.000-2637.000=30.000
max2667.000-2637.000=30.000
mean0.419-0.419=-0.000
σ0.001-0.001=-0.000
min0.417-0.418=-0.001
max0.420-0.421=-0.001
iters=5
new-facts=1
prior-facts=6402
mean2268.874-2268.862=0.012
σ0.016-0.018=-0.002
min2268.852-2268.841=0.012
max2268.897-2268.877=0.019
mean2667.000-2637.000=30.000
σ0.000
min2667.000-2637.000=30.000
max2667.000-2637.000=30.000
mean3.081-3.147=-0.066
σ0.208-0.169=0.039
min2.863-2.894=-0.032
max3.390-3.332=0.058
iters=5
new-facts=6402
prior-facts=1
mean4952.238-4952.339=-0.101
σ0.895-0.825=0.070
min4951.362-4951.853=-0.491
max4953.753-4953.809=-0.056
mean2667.000-2637.000=30.000
σ0.000
min2667.000-2637.000=30.000
max2667.000-2637.000=30.000
mean7.819-8.181=-0.361
σ0.194-0.342=-0.149
min7.631-7.821=-0.189
max8.063-8.679=-0.617
iters=5
new-facts=6402
prior-facts=6402
mean5167.085-5167.084=0.001
σ0.010-0.009=0.000
min5167.075-5167.076=-0.001
max5167.099-5167.095=0.005
mean3434.200-3365.800=68.400
σ481.083-452.575=28.508
min2887.000-2924.000=-37.000
max4153.000-3828.000=325.000
mean9.302-9.430=-0.128
σ0.264-0.411=-0.147
min9.050-9.051=-0.001
max9.742-10.025=-0.284

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.174-1.568=-0.394
σ0.228-0.449=-0.220
min0.953-0.947=0.006
max1.532-1.994=-0.461

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.264-460.263=0.001
σ572.606-572.608=-0.001
min173.960-173.959=0.002
max1319.174-1319.175=-0.001
mean79.500
σ7.000
min76.000
max90.000
mean435.000-438.000=-3.000
σ0.000
min435.000-438.000=-3.000
max435.000-438.000=-3.000
mean0.543-0.537=0.005
σ0.534-0.522=0.013
min0.269-0.273=-0.004
max1.344-1.320=0.024
policies=20
mean1740.100-1740.097=0.003
σ0.328-0.332=-0.003
min1739.864-1739.854=0.010
max1740.582-1740.583=-0.002
mean760.000
σ0.000
min760.000
max760.000
mean445.500-447.750=-2.250
σ9.950-9.605=0.345
min435.000-438.000=-3.000
max454.000-456.000=-2.000
mean2.663-2.663=-0.000
σ0.017-0.018=-0.001
min2.640-2.643=-0.003
max2.680-2.686=-0.006
policies=200
mean17410.200-17410.202=-0.002
σ0.106-0.037=0.069
min17410.114-17410.148=-0.034
max17410.352-17410.229=0.122
mean7600.000
σ0.000
min7600.000
max7600.000
mean492.500-494.250=-1.750
σ2.887-4.500=-1.613
min489.000-488.000=1.000
max496.000-498.000=-2.000
mean26.904-26.919=-0.015
σ0.071-0.089=-0.018
min26.830-26.803=0.027
max27.001-27.019=-0.019