Compare commits

Home / Compare 7adcafb5 .. a1a7f04e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.648-53.647=0.001
σ0.367-0.367=0.000
min53.520-53.511=0.009
max54.693-54.691=0.002
mean413.300-414.800=-1.500
σ0.483-0.422=0.061
min413.000-414.000=-1.000
max414.000-415.000=-1.000
mean0.138-0.138=0.001
σ0.004-0.004=-0.000
min0.134-0.131=0.003
max0.145-0.143=0.002
cache=y
dps=1
iters=10
policies=100
mean42.941-42.943=-0.002
σ0.003-0.006=-0.003
min42.935-42.934=0.000
max42.947-42.955=-0.008
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.121-0.122=-0.001
σ0.005-0.003=0.002
min0.116-0.119=-0.003
max0.130-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.869-991.867=0.002
σ1.201-1.194=0.007
min991.335-991.324=0.011
max996.906-996.875=0.031
mean1058.400-1060.250=-1.850
σ315.485-319.514=-4.028
min590.000-588.000=2.000
max1543.000-1552.000=-9.000
mean1.526-1.520=0.006
σ0.065-0.061=0.004
min1.397-1.457=-0.060
max1.677-1.633=0.044

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.434-285.409=0.025
σ0.017-0.009=0.008
min285.409-285.395=0.015
max285.450-285.417=0.033
mean1543.000-1552.000=-9.000
σ0.000
min1543.000-1552.000=-9.000
max1543.000-1552.000=-9.000
mean0.389-0.377=0.012
σ0.008-0.007=0.001
min0.375-0.372=0.003
max0.395-0.388=0.007
iters=5
new-facts=1
prior-facts=6402
mean1285.504-1285.522=-0.018
σ0.087-0.068=0.019
min1285.354-1285.405=-0.051
max1285.568-1285.567=0.001
mean1543.000-1552.000=-9.000
σ0.000
min1543.000-1552.000=-9.000
max1543.000-1552.000=-9.000
mean1.936-1.876=0.060
σ0.084-0.099=-0.015
min1.821-1.817=0.004
max2.033-2.049=-0.016
iters=5
new-facts=6402
prior-facts=1
mean1705.838-1705.834=0.004
σ6.872-6.853=0.019
min1702.653-1702.657=-0.004
max1718.128-1718.091=0.037
mean1543.000-1552.000=-9.000
σ0.000
min1543.000-1552.000=-9.000
max1543.000-1552.000=-9.000
mean3.008-2.913=0.095
σ0.210-0.200=0.010
min2.801-2.776=0.025
max3.294-3.267=0.028
iters=5
new-facts=6402
prior-facts=6402
mean1968.390-1968.437=-0.047
σ0.046-0.004=0.042
min1968.346-1968.433=-0.086
max1968.442-1968.444=-0.002
mean1782.200-1842.000=-59.800
σ183.482-183.138=0.344
min1543.000-1613.000=-70.000
max2008.000-2056.000=-48.000
mean3.269-3.190=0.078
σ0.394-0.109=0.286
min3.083-3.019=0.063
max3.974-3.304=0.670

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.482-1.510=-0.028
σ0.132-0.278=-0.146
min1.335-1.188=0.147
max1.684-1.750=-0.067

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.766-436.769=-0.003
σ572.354-572.357=-0.002
min150.587-150.587=0.000
max1295.298-1295.304=-0.006
mean90.250
σ8.500
min86.000
max103.000
mean1543.000-1552.000=-9.000
σ0.000
min1543.000-1552.000=-9.000
max1543.000-1552.000=-9.000
mean0.511-0.516=-0.004
σ0.522-0.525=-0.003
min0.248-0.251=-0.003
max1.295-1.304=-0.009
policies=20
mean1506.166-1506.179=-0.013
σ0.245-0.240=0.005
min1506.006-1506.011=-0.005
max1506.532-1506.535=-0.003
mean860.000
σ0.000
min860.000
max860.000
mean1543.000-1552.000=-9.000
σ0.000
min1543.000-1552.000=-9.000
max1543.000-1552.000=-9.000
mean2.522-2.515=0.007
σ0.014-0.015=-0.001
min2.501-2.503=-0.002
max2.531-2.535=-0.003
policies=200
mean15069.494-15069.539=-0.045
σ0.067-0.032=0.035
min15069.425-15069.508=-0.083
max15069.566-15069.583=-0.017
mean8600.000
σ0.000
min8600.000
max8600.000
mean1543.000-1552.000=-9.000
σ0.000
min1543.000-1552.000=-9.000
max1543.000-1552.000=-9.000
mean25.660-25.549=0.111
σ0.249-0.124=0.124
min25.382-25.405=-0.023
max25.922-25.662=0.260