Compare commits

Home / Compare 99261a85 .. 97c7c7a1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.375-70.374=0.001
σ0.059-0.058=0.001
min70.336-70.336=0.000
max70.541-70.535=0.006
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.157-0.160=-0.003
σ0.006-0.003=0.002
min0.151-0.156=-0.005
max0.168-0.165=0.004
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=0.000
σ0.003-0.002=0.000
min21.139-21.137=0.002
max21.147-21.146=0.002
mean412.900-416.000=-3.100
σ0.316-0.000=0.316
min412.000-416.000=-4.000
max413.000-416.000=-3.000
mean0.065-0.062=0.003
σ0.003-0.003=-0.001
min0.058-0.058=0.000
max0.068-0.067=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.201-1752.198=0.003
σ0.361-0.362=-0.001
min1751.633-1751.633=0.000
max1752.804-1752.787=0.017
mean1651.800-1676.950=-25.150
σ647.512-626.465=21.047
min643.000-669.000=-26.000
max2848.000-2622.000=226.000
mean2.849-2.790=0.059
σ0.142-0.154=-0.012
min2.514-2.269=0.245
max3.066-2.966=0.100

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.933-269.932=0.001
σ0.006-0.007=-0.000
min269.926-269.925=0.001
max269.941-269.941=0.000
mean2848.000-2622.000=226.000
σ0.000
min2848.000-2622.000=226.000
max2848.000-2622.000=226.000
mean0.373-0.373=0.000
σ0.007-0.005=0.002
min0.368-0.369=-0.001
max0.386-0.382=0.005
iters=5
new-facts=1
prior-facts=6402
mean1930.396-1930.390=0.006
σ0.012-0.020=-0.008
min1930.376-1930.360=0.016
max1930.409-1930.409=0.000
mean2848.000-2622.000=226.000
σ0.000
min2848.000-2622.000=226.000
max2848.000-2622.000=226.000
mean2.494-2.510=-0.016
σ0.050-0.068=-0.018
min2.441-2.457=-0.016
max2.569-2.611=-0.042
iters=5
new-facts=6402
prior-facts=1
mean4750.522-4750.845=-0.322
σ1.207-0.830=0.377
min4749.316-4750.334=-1.018
max4752.463-4752.312=0.152
mean2848.000-2622.000=226.000
σ0.000
min2848.000-2622.000=226.000
max2848.000-2622.000=226.000
mean8.726-8.653=0.073
σ0.553-0.200=0.353
min7.787-8.469=-0.682
max9.231-8.868=0.363
iters=5
new-facts=6402
prior-facts=6402
mean4941.261-4941.264=-0.003
σ0.201-0.202=-0.001
min4940.935-4940.926=0.009
max4941.427-4941.423=0.004
mean3043.600-2968.400=75.200
σ199.691-263.754=-64.064
min2848.000-2622.000=226.000
max3320.000-3316.000=4.000
mean8.520-8.456=0.064
σ0.177-0.157=0.019
min8.348-8.291=0.057
max8.775-8.694=0.082

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.072-1.287=-0.215
σ0.092-0.372=-0.280
min0.944-0.939=0.006
max1.204-1.823=-0.618

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.910-465.907=0.003
σ575.758-575.765=-0.007
min178.024-178.021=0.003
max1329.547-1329.555=-0.007
mean81.750
σ7.500
min78.000
max93.000
mean2848.000-2622.000=226.000
σ0.000
min2848.000-2622.000=226.000
max2848.000-2622.000=226.000
mean0.441-0.568=-0.127
σ0.302-0.562=-0.260
min0.287-0.280=0.007
max0.894-1.411=-0.517
policies=20
mean1780.500-1780.429=0.071
σ0.362-0.353=0.009
min1780.235-1780.191=0.044
max1781.027-1780.951=0.076
mean780.000
σ0.000
min780.000
max780.000
mean2848.000-2622.000=226.000
σ0.000
min2848.000-2622.000=226.000
max2848.000-2622.000=226.000
mean2.859-2.787=0.073
σ0.009-0.020=-0.011
min2.849-2.758=0.091
max2.871-2.800=0.071
policies=200
mean17811.329-17811.251=0.078
σ0.443-0.530=-0.087
min17810.887-17810.887=0.000
max17811.941-17812.036=-0.095
mean7800.000
σ0.000
min7800.000
max7800.000
mean2848.000-2622.000=226.000
σ0.000
min2848.000-2622.000=226.000
max2848.000-2622.000=226.000
mean28.360-27.916=0.443
σ0.479-0.118=0.361
min27.810-27.807=0.003
max28.784-28.044=0.740