Compare commits

Home / Compare 7ad3c29a .. 627752bd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.390-70.375=0.015
σ0.048-0.059=-0.011
min70.363-70.332=0.031
max70.523-70.538=-0.015
mean412.400-413.000=-0.600
σ0.516-0.000=0.516
min412.000-413.000=-1.000
max413.000
mean0.159-0.159=0.001
σ0.005-0.005=-0.000
min0.150-0.151=-0.000
max0.167-0.167=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.145-21.143=0.002
σ0.003-0.002=0.000
min21.141-21.140=0.002
max21.149-21.146=0.003
mean413.000
σ0.000
min413.000
max413.000
mean0.065-0.065=0.000
σ0.003-0.002=0.001
min0.063-0.063=-0.000
max0.074-0.071=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.395-1752.203=0.192
σ0.361-0.362=-0.002
min1751.824-1751.633=0.192
max1752.967-1752.789=0.178
mean1625.000-1655.850=-30.850
σ590.380-636.016=-45.637
min623.000-614.000=9.000
max2411.000-2789.000=-378.000
mean2.800-2.854=-0.055
σ0.173-0.159=0.014
min2.301-2.286=0.015
max3.060-3.070=-0.010

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.122-269.928=0.195
σ0.006-0.005=0.001
min270.117-269.920=0.197
max270.132-269.934=0.199
mean2411.000-2789.000=-378.000
σ0.000
min2411.000-2789.000=-378.000
max2411.000-2789.000=-378.000
mean0.385-0.374=0.012
σ0.008-0.003=0.005
min0.379-0.372=0.008
max0.399-0.378=0.021
iters=5
new-facts=1
prior-facts=6402
mean1930.607-1930.391=0.217
σ0.006-0.015=-0.009
min1930.598-1930.367=0.231
max1930.614-1930.406=0.209
mean2411.000-2789.000=-378.000
σ0.000
min2411.000-2789.000=-378.000
max2411.000-2789.000=-378.000
mean2.554-2.604=-0.050
σ0.117-0.131=-0.013
min2.432-2.447=-0.015
max2.686-2.770=-0.084
iters=5
new-facts=6402
prior-facts=1
mean4751.308-4750.876=0.431
σ0.852-0.879=-0.027
min4750.892-4750.353=0.539
max4752.830-4752.436=0.394
mean2411.000-2789.000=-378.000
σ0.000
min2411.000-2789.000=-378.000
max2411.000-2789.000=-378.000
mean8.397-8.436=-0.039
σ0.325-0.544=-0.219
min7.845-7.709=0.136
max8.620-9.155=-0.535
iters=5
new-facts=6402
prior-facts=6402
mean4941.702-4941.189=0.513
σ0.150-0.198=-0.048
min4941.437-4940.914=0.523
max4941.794-4941.406=0.388
mean3009.200-3057.200=-48.000
σ293.266-337.248=-43.982
min2601.000-2789.000=-188.000
max3387.000-3565.000=-178.000
mean8.739-8.509=0.231
σ0.334-0.135=0.199
min8.458-8.348=0.110
max9.319-8.654=0.666

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.837-1.058=0.779
σ0.175-0.127=0.048
min1.597-0.942=0.655
max2.045-1.252=0.793

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.364-465.913=0.451
σ575.914-575.772=0.142
min178.403-178.025=0.378
max1330.235-1329.572=0.663
mean84.000-81.750=2.250
σ8.000-7.500=0.500
min80.000-78.000=2.000
max96.000-93.000=3.000
mean2411.000-2789.000=-378.000
σ0.000
min2411.000-2789.000=-378.000
max2411.000-2789.000=-378.000
mean0.566-0.444=0.123
σ0.570-0.308=0.263
min0.277-0.288=-0.012
max1.422-0.905=0.516
policies=20
mean1784.322-1780.511=3.811
σ0.358-0.338=0.019
min1784.092-1780.270=3.822
max1784.853-1781.007=3.847
mean800.000-780.000=20.000
σ0.000
min800.000-780.000=20.000
max800.000-780.000=20.000
mean2411.000-2789.000=-378.000
σ0.000
min2411.000-2789.000=-378.000
max2411.000-2789.000=-378.000
mean2.797-2.847=-0.050
σ0.017-0.106=-0.089
min2.777-2.767=0.010
max2.812-2.993=-0.181
policies=200
mean17849.792-17811.401=38.391
σ0.398-0.640=-0.242
min17849.447-17810.979=38.468
max17850.366-17812.352=38.014
mean8000.000-7800.000=200.000
σ0.000
min8000.000-7800.000=200.000
max8000.000-7800.000=200.000
mean2411.000-2789.000=-378.000
σ0.000
min2411.000-2789.000=-378.000
max2411.000-2789.000=-378.000
mean28.020-27.935=0.085
σ0.069-0.207=-0.138
min27.942-27.801=0.141
max28.110-28.244=-0.134