Compare commits

Home / Compare 0e14e2bb .. 815f1682

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.368-70.375=-0.007
σ0.055-0.059=-0.004
min70.330-70.331=-0.001
max70.520-70.538=-0.017
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.159-0.161=-0.002
σ0.003-0.004=-0.000
min0.155-0.157=-0.002
max0.164-0.168=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.144-21.143=0.001
σ0.001-0.002=-0.001
min21.142-21.140=0.002
max21.145-21.147=-0.002
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.064-0.065=-0.001
σ0.003-0.003=-0.001
min0.062-0.062=0.000
max0.072-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.198-1752.202=-0.004
σ0.363-0.363=-0.000
min1751.632-1751.634=-0.002
max1752.785-1752.794=-0.009
mean1653.150-1678.400=-25.250
σ615.122-635.735=-20.613
min631.000-680.000=-49.000
max2488.000-2656.000=-168.000
mean2.815-2.732=0.083
σ0.102-0.197=-0.095
min2.582-2.368=0.214
max2.973-3.013=-0.039

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.934-269.930=0.004
σ0.006-0.005=0.001
min269.927-269.924=0.003
max269.944-269.936=0.007
mean2488.000-2656.000=-168.000
σ0.000
min2488.000-2656.000=-168.000
max2488.000-2656.000=-168.000
mean0.383-0.371=0.012
σ0.005-0.007=-0.002
min0.379-0.367=0.012
max0.391-0.383=0.008
iters=5
new-facts=1
prior-facts=6402
mean1930.386-1930.387=-0.002
σ0.020-0.016=0.004
min1930.356-1930.363=-0.007
max1930.406-1930.399=0.006
mean2488.000-2656.000=-168.000
σ0.000
min2488.000-2656.000=-168.000
max2488.000-2656.000=-168.000
mean2.564-2.508=0.056
σ0.161-0.189=-0.028
min2.456-2.352=0.104
max2.832-2.824=0.009
iters=5
new-facts=6402
prior-facts=1
mean4750.837-4750.870=-0.033
σ0.829-0.798=0.031
min4750.264-4750.353=-0.088
max4752.287-4752.280=0.007
mean2488.000-2656.000=-168.000
σ0.000
min2488.000-2656.000=-168.000
max2488.000-2656.000=-168.000
mean8.731-8.494=0.237
σ0.357-0.178=0.178
min8.448-8.343=0.105
max9.276-8.761=0.515
iters=5
new-facts=6402
prior-facts=6402
mean4941.268-4941.257=0.011
σ0.123-0.120=0.003
min4941.082-4941.071=0.011
max4941.427-4941.407=0.020
mean2986.000-3018.800=-32.800
σ266.309-268.584=-2.275
min2627.000-2656.000=-29.000
max3306.000-3323.000=-17.000
mean8.484-8.518=-0.034
σ0.161-0.169=-0.008
min8.288-8.339=-0.051
max8.688-8.782=-0.094

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.703-1.217=0.486
σ0.148-0.368=-0.220
min1.486-0.936=0.550
max1.848-1.818=0.030

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.623-465.914=-0.290
σ575.195-575.769=-0.573
min178.021-178.026=-0.005
max1328.417-1329.567=-1.150
mean81.750
σ7.500
min78.000
max93.000
mean2488.000-2656.000=-168.000
σ0.000
min2488.000-2656.000=-168.000
max2488.000-2656.000=-168.000
mean0.565-0.565=-0.000
σ0.566-0.568=-0.002
min0.279-0.277=0.003
max1.414-1.417=-0.003
policies=20
mean1780.450-1780.476=-0.026
σ0.355-0.344=0.011
min1780.210-1780.242=-0.032
max1780.976-1780.985=-0.009
mean780.000
σ0.000
min780.000
max780.000
mean2488.000-2656.000=-168.000
σ0.000
min2488.000-2656.000=-168.000
max2488.000-2656.000=-168.000
mean2.756-2.756=0.000
σ0.010-0.011=-0.001
min2.747-2.745=0.002
max2.769-2.771=-0.003
policies=200
mean17811.490-17811.565=-0.075
σ0.512-0.531=-0.019
min17811.142-17811.271=-0.129
max17812.251-17812.359=-0.108
mean7800.000
σ0.000
min7800.000
max7800.000
mean2488.000-2656.000=-168.000
σ0.000
min2488.000-2656.000=-168.000
max2488.000-2656.000=-168.000
mean27.752-27.760=-0.008
σ0.064-0.115=-0.052
min27.666-27.620=0.046
max27.818-27.902=-0.084