Compare commits

Home / Compare ea71d0fc .. bc22af0a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.375-70.375=0.000
σ0.056-0.056=-0.000
min70.339-70.338=0.001
max70.532-70.531=0.001
mean414.000
σ0.000
min414.000
max414.000
mean0.160-0.159=0.001
σ0.002-0.005=-0.002
min0.157-0.152=0.005
max0.164-0.165=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.144-21.142=0.001
σ0.003-0.002=0.001
min21.139-21.138=0.001
max21.148-21.145=0.003
mean414.000
σ0.000
min414.000
max414.000
mean0.064-0.064=0.000
σ0.002-0.003=-0.001
min0.062-0.060=0.002
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.199-1752.200=-0.001
σ0.361-0.361=-0.001
min1751.631-1751.627=0.004
max1752.789-1752.782=0.007
mean1651.100-1632.750=18.350
σ635.367-623.024=12.343
min646.000-617.000=29.000
max2849.000-2769.000=80.000
mean2.811-2.846=-0.034
σ0.180-0.128=0.051
min2.337-2.560=-0.223
max3.091-3.001=0.090

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.934-269.908=0.026
σ0.012-0.008=0.004
min269.917-269.895=0.022
max269.945-269.915=0.030
mean2849.000-2769.000=80.000
σ0.000
min2849.000-2769.000=80.000
max2849.000-2769.000=80.000
mean0.379-0.379=-0.000
σ0.009-0.005=0.004
min0.368-0.373=-0.005
max0.393-0.387=0.006
iters=5
new-facts=1
prior-facts=6402
mean1930.393-1930.395=-0.001
σ0.011-0.011=-0.000
min1930.379-1930.385=-0.006
max1930.408-1930.409=-0.001
mean2849.000-2769.000=80.000
σ0.000
min2849.000-2769.000=80.000
max2849.000-2769.000=80.000
mean2.648-2.515=0.133
σ0.148-0.122=0.026
min2.492-2.363=0.129
max2.812-2.652=0.160
iters=5
new-facts=6402
prior-facts=1
mean4750.950-4750.780=0.170
σ0.764-0.910=-0.146
min4750.554-4750.112=0.443
max4752.310-4752.380=-0.069
mean2849.000-2769.000=80.000
σ0.000
min2849.000-2769.000=80.000
max2849.000-2769.000=80.000
mean8.119-8.437=-0.318
σ0.291-0.594=-0.303
min7.780-7.638=0.142
max8.563-9.197=-0.634
iters=5
new-facts=6402
prior-facts=6402
mean4941.252-4941.331=-0.080
σ0.127-0.084=0.043
min4941.060-4941.261=-0.201
max4941.412-4941.433=-0.021
mean3059.000-3014.000=45.000
σ269.864-233.310=36.554
min2849.000-2769.000=80.000
max3472.000-3320.000=152.000
mean8.491-8.570=-0.079
σ0.081-0.218=-0.137
min8.383-8.393=-0.010
max8.574-8.899=-0.325

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.993-1.116=-0.123
σ0.144-0.256=-0.112
min0.920-0.934=-0.014
max1.250-1.555=-0.306

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.915-465.923=-0.007
σ575.769-575.792=-0.023
min178.021-178.021=-0.000
max1329.569-1329.611=-0.042
mean81.750
σ7.500
min78.000
max93.000
mean2849.000-2769.000=80.000
σ0.000
min2849.000-2769.000=80.000
max2849.000-2769.000=80.000
mean0.438-0.575=-0.137
σ0.303-0.572=-0.269
min0.283-0.284=-0.000
max0.892-1.433=-0.541
policies=20
mean1780.491-1780.456=0.035
σ0.338-0.355=-0.017
min1780.256-1780.219=0.037
max1780.989-1780.984=0.005
mean780.000
σ0.000
min780.000
max780.000
mean2849.000-2769.000=80.000
σ0.000
min2849.000-2769.000=80.000
max2849.000-2769.000=80.000
mean2.843-2.769=0.075
σ0.007-0.022=-0.015
min2.833-2.747=0.087
max2.848-2.797=0.051
policies=200
mean17811.253-17811.312=-0.059
σ0.426-0.484=-0.058
min17810.775-17811.022=-0.247
max17811.811-17812.033=-0.223
mean7800.000
σ0.000
min7800.000
max7800.000
mean2849.000-2769.000=80.000
σ0.000
min2849.000-2769.000=80.000
max2849.000-2769.000=80.000
mean28.236-27.799=0.437
σ0.470-0.104=0.366
min27.722-27.702=0.019
max28.669-27.938=0.731