Compare commits

Home / Compare cd8e3b24 .. 8ff3ba7f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-33.980=19.934
σ0.367-0.048=0.320
min53.785-33.955=19.830
max54.959-34.111=20.848
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.137-0.082=0.055
σ0.004-0.005=-0.001
min0.132-0.077=0.056
max0.146-0.092=0.054
cache=y
dps=1
iters=10
policies=100
mean43.142-23.318=19.824
σ0.006-0.002=0.004
min43.130-23.314=19.817
max43.152-23.321=19.831
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.121-0.065=0.056
σ0.004-0.003=0.002
min0.114-0.064=0.051
max0.128-0.073=0.055

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.811-1757.428=-765.617
σ1.272-0.364=0.908
min991.226-1756.854=-765.628
max997.168-1758.016=-760.848
mean1063.950-1648.300=-584.350
σ322.950-612.222=-289.272
min566.000-677.000=-111.000
max1636.000-2630.000=-994.000
mean1.542-2.367=-0.825
σ0.092-0.093=-0.001
min1.417-2.255=-0.838
max1.786-2.595=-0.810

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.389-326.575=-41.186
σ0.009-0.043=-0.034
min285.377-326.503=-41.126
max285.400-326.616=-41.215
mean1636.000-2630.000=-994.000
σ0.000
min1636.000-2630.000=-994.000
max1636.000-2630.000=-994.000
mean0.382-0.424=-0.043
σ0.012-0.007=0.005
min0.374-0.420=-0.046
max0.402-0.436=-0.034
iters=5
new-facts=1
prior-facts=6402
mean1285.373-1988.727=-703.354
σ0.133-0.018=0.115
min1285.303-1988.707=-703.403
max1285.610-1988.749=-703.140
mean1636.000-2630.000=-994.000
σ0.000
min1636.000-2630.000=-994.000
max1636.000-2630.000=-994.000
mean1.858-2.803=-0.945
σ0.023-0.283=-0.260
min1.842-2.632=-0.790
max1.899-3.305=-1.405
iters=5
new-facts=6402
prior-facts=1
mean1807.743-4813.458=-3005.715
σ6.958-7.778=-0.821
min1804.355-4809.613=-3005.257
max1820.178-4827.367=-3007.190
mean1636.000-2630.000=-994.000
σ0.000
min1636.000-2630.000=-994.000
max1636.000-2630.000=-994.000
mean4.290-8.985=-4.694
σ0.299-0.192=0.107
min4.085-8.674=-4.590
max4.766-9.173=-4.407
iters=5
new-facts=6402
prior-facts=6402
mean2070.194-5001.146=-2930.951
σ0.015-0.034=-0.019
min2070.176-5001.112=-2930.936
max2070.216-5001.200=-2930.983
mean1850.600-2989.800=-1139.200
σ208.260-275.427=-67.167
min1636.000-2630.000=-994.000
max2088.000-3317.000=-1229.000
mean4.560-9.752=-5.192
σ0.281-0.388=-0.108
min4.408-9.113=-4.705
max5.062-10.125=-5.064

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.192-1.118=0.074
σ0.233-0.304=-0.072
min0.908-0.913=-0.006
max1.523-1.652=-0.129

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.785-464.571=-27.786
σ572.363-574.780=-2.417
min150.599-177.172=-26.573
max1295.329-1326.741=-31.412
mean90.250-88.250=2.000
σ8.500
min86.000-84.000=2.000
max103.000-101.000=2.000
mean1636.000-2630.000=-994.000
σ0.000
min1636.000-2630.000=-994.000
max1636.000-2630.000=-994.000
mean0.521-0.556=-0.035
σ0.538-0.568=-0.031
min0.248-0.270=-0.021
max1.328-1.409=-0.081
policies=20
mean1506.269-1772.012=-265.743
σ0.235-0.353=-0.118
min1506.115-1771.785=-265.669
max1506.619-1772.538=-265.919
mean860.000-840.000=20.000
σ0.000
min860.000-840.000=20.000
max860.000-840.000=20.000
mean1636.000-2630.000=-994.000
σ0.000
min1636.000-2630.000=-994.000
max1636.000-2630.000=-994.000
mean2.516-2.728=-0.212
σ0.003-0.018=-0.015
min2.513-2.704=-0.191
max2.520-2.747=-0.227
policies=200
mean15070.360-17727.390=-2657.029
σ0.047-0.544=-0.497
min15070.304-17727.085=-2656.782
max15070.419-17728.205=-2657.787
mean8600.000-8400.000=200.000
σ0.000
min8600.000-8400.000=200.000
max8600.000-8400.000=200.000
mean1636.000-2630.000=-994.000
σ0.000
min1636.000-2630.000=-994.000
max1636.000-2630.000=-994.000
mean25.520-27.481=-1.961
σ0.087-0.093=-0.006
min25.449-27.390=-1.941
max25.639-27.577=-1.938