Compare commits

Home / Compare cd760d68 .. b8a1cdf2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.374-31.039=39.334
σ0.059-0.050=0.010
min70.334-31.003=39.331
max70.540-31.177=39.362
mean414.000-414.900=-0.900
σ0.000-0.316=-0.316
min414.000
max414.000-415.000=-1.000
mean0.158-0.077=0.081
σ0.006-0.005=0.001
min0.149-0.070=0.079
max0.168-0.085=0.083
cache=y
dps=1
iters=10
policies=100
mean21.143-21.142=0.001
σ0.002-0.002=0.000
min21.140-21.140=0.001
max21.146-21.147=-0.000
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.064-0.064=-0.001
σ0.003-0.002=0.000
min0.057-0.062=-0.005
max0.069-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.197-1751.409=0.788
σ0.362-0.361=0.001
min1751.632-1750.841=0.790
max1752.761-1751.975=0.786
mean1640.800-1653.700=-12.900
σ613.662-642.489=-28.827
min629.000-633.000=-4.000
max2470.000-2850.000=-380.000
mean2.841-2.782=0.059
σ0.122-0.136=-0.014
min2.603-2.510=0.093
max3.032-2.994=0.038

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.934-266.783=3.151
σ0.006-0.009=-0.002
min269.927-266.773=3.154
max269.943-266.795=3.149
mean2470.000-2850.000=-380.000
σ0.000
min2470.000-2850.000=-380.000
max2470.000-2850.000=-380.000
mean0.382-0.367=0.015
σ0.011-0.003=0.008
min0.372-0.365=0.007
max0.400-0.371=0.029
iters=5
new-facts=1
prior-facts=6402
mean1930.386-1927.209=3.177
σ0.025-0.007=0.019
min1930.357-1927.202=3.154
max1930.411-1927.218=3.193
mean2470.000-2850.000=-380.000
σ0.000
min2470.000-2850.000=-380.000
max2470.000-2850.000=-380.000
mean2.566-3.000=-0.434
σ0.161-0.092=0.069
min2.406-2.935=-0.529
max2.830-3.159=-0.329
iters=5
new-facts=6402
prior-facts=1
mean4750.851-4747.738=3.113
σ0.810-0.777=0.033
min4750.338-4747.370=2.968
max4752.278-4749.127=3.151
mean2470.000-2850.000=-380.000
σ0.000
min2470.000-2850.000=-380.000
max2470.000-2850.000=-380.000
mean8.637-8.345=0.292
σ0.224-0.519=-0.295
min8.411-7.694=0.717
max8.925-8.907=0.018
iters=5
new-facts=6402
prior-facts=6402
mean4941.332-4938.096=3.236
σ0.084-0.211=-0.128
min4941.259-4937.750=3.508
max4941.426-4938.273=3.153
mean2961.600-3074.400=-112.800
σ272.859-236.192=36.666
min2595.000-2850.000=-255.000
max3316.000-3416.000=-100.000
mean8.450-8.516=-0.066
σ0.032-0.224=-0.192
min8.411-8.319=0.092
max8.495-8.876=-0.381

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.850-1.092=0.758
σ0.033-0.124=-0.090
min1.813-0.954=0.859
max1.885-1.294=0.591

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.903-465.125=0.778
σ575.758-575.767=-0.009
min178.022-177.230=0.792
max1329.540-1328.776=0.765
mean81.750-79.750=2.000
σ7.500
min78.000-76.000=2.000
max93.000-91.000=2.000
mean2470.000-2850.000=-380.000
σ0.000
min2470.000-2850.000=-380.000
max2470.000-2850.000=-380.000
mean0.550-0.439=0.110
σ0.531-0.308=0.223
min0.269-0.282=-0.013
max1.346-0.902=0.444
policies=20
mean1780.452-1772.597=7.855
σ0.356-0.329=0.027
min1780.213-1772.346=7.867
max1780.981-1773.077=7.903
mean780.000-760.000=20.000
σ0.000
min780.000-760.000=20.000
max780.000-760.000=20.000
mean2470.000-2850.000=-380.000
σ0.000
min2470.000-2850.000=-380.000
max2470.000-2850.000=-380.000
mean2.767-2.841=-0.074
σ0.015-0.008=0.007
min2.751-2.833=-0.082
max2.784-2.850=-0.067
policies=200
mean17811.215-17732.507=78.708
σ0.409-0.491=-0.082
min17810.906-17732.171=78.735
max17811.818-17733.237=78.581
mean7800.000-7600.000=200.000
σ0.000
min7800.000-7600.000=200.000
max7800.000-7600.000=200.000
mean2470.000-2850.000=-380.000
σ0.000
min2470.000-2850.000=-380.000
max2470.000-2850.000=-380.000
mean27.927-28.191=-0.265
σ0.109-0.470=-0.362
min27.833-27.629=0.204
max28.051-28.590=-0.538