Compare commits

Home / Compare 2a5ceaf9 .. 5a25781d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.375-70.374=0.001
σ0.060-0.058=0.002
min70.336-70.332=0.004
max70.541-70.536=0.006
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.160-0.156=0.003
σ0.003-0.004=-0.001
min0.157-0.151=0.006
max0.164-0.163=0.001
cache=y
dps=1
iters=10
policies=100
mean21.143-21.141=0.002
σ0.002-0.003=-0.001
min21.140-21.137=0.002
max21.146-21.146=0.001
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.063-0.060=0.003
σ0.004-0.003=0.001
min0.058-0.058=0.000
max0.072-0.068=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.199-1752.199=-0.000
σ0.360-0.362=-0.002
min1751.628-1751.629=-0.001
max1752.766-1752.782=-0.016
mean1637.500-1653.200=-15.700
σ616.259-615.867=0.392
min646.000-645.000=1.000
max2470.000-2488.000=-18.000
mean2.818-2.781=0.037
σ0.115-0.168=-0.053
min2.454-2.327=0.127
max3.000-3.025=-0.025

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.934-269.912=0.022
σ0.006-0.006=0.001
min269.929-269.902=0.026
max269.944-269.918=0.026
mean2470.000-2488.000=-18.000
σ0.000
min2470.000-2488.000=-18.000
max2470.000-2488.000=-18.000
mean0.384-0.381=0.003
σ0.009-0.010=-0.000
min0.378-0.371=0.008
max0.401-0.391=0.010
iters=5
new-facts=1
prior-facts=6402
mean1930.388-1930.398=-0.010
σ0.030-0.008=0.022
min1930.358-1930.391=-0.033
max1930.428-1930.410=0.018
mean2470.000-2488.000=-18.000
σ0.000
min2470.000-2488.000=-18.000
max2470.000-2488.000=-18.000
mean2.536-2.524=0.011
σ0.160-0.104=0.056
min2.378-2.440=-0.062
max2.784-2.699=0.084
iters=5
new-facts=6402
prior-facts=1
mean4750.831-4750.846=-0.014
σ0.845-0.842=0.002
min4750.286-4750.323=-0.036
max4752.320-4752.343=-0.022
mean2470.000-2488.000=-18.000
σ0.000
min2470.000-2488.000=-18.000
max2470.000-2488.000=-18.000
mean8.782-8.642=0.140
σ0.235-0.568=-0.333
min8.495-7.697=0.799
max9.069-9.046=0.023
iters=5
new-facts=6402
prior-facts=6402
mean4941.260-4941.335=-0.075
σ0.205-0.088=0.117
min4940.922-4941.259=-0.337
max4941.426-4941.434=-0.008
mean2929.400-2987.200=-57.800
σ314.039-281.327=32.712
min2470.000-2600.000=-130.000
max3305.000-3320.000=-15.000
mean8.431-8.542=-0.111
σ0.050-0.090=-0.040
min8.377-8.461=-0.083
max8.488-8.681=-0.193

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.808-1.718=0.090
σ0.112-0.135=-0.023
min1.686-1.524=0.162
max1.986-1.836=0.149

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.901-465.903=-0.002
σ575.753-575.756=-0.004
min178.020-178.022=-0.001
max1329.530-1329.537=-0.007
mean81.750
σ7.500
min78.000
max93.000
mean2470.000-2488.000=-18.000
σ0.000
min2470.000-2488.000=-18.000
max2470.000-2488.000=-18.000
mean0.569-0.555=0.013
σ0.566-0.552=0.014
min0.284-0.277=0.007
max1.417-1.382=0.034
policies=20
mean1780.440-1780.453=-0.013
σ0.349-0.353=-0.005
min1780.219-1780.215=0.004
max1780.959-1780.978=-0.019
mean780.000
σ0.000
min780.000
max780.000
mean2470.000-2488.000=-18.000
σ0.000
min2470.000-2488.000=-18.000
max2470.000-2488.000=-18.000
mean2.778-2.769=0.009
σ0.007-0.039=-0.032
min2.769-2.740=0.029
max2.786-2.827=-0.040
policies=200
mean17811.316-17811.185=0.130
σ0.480-0.572=-0.092
min17811.047-17810.846=0.201
max17812.034-17812.041=-0.007
mean7800.000
σ0.000
min7800.000
max7800.000
mean2470.000-2488.000=-18.000
σ0.000
min2470.000-2488.000=-18.000
max2470.000-2488.000=-18.000
mean27.845-27.796=0.049
σ0.074-0.081=-0.007
min27.759-27.695=0.064
max27.913-27.892=0.021