Compare commits

Home / Compare e1e0f49b .. 7cf5129a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.373-31.040=39.333
σ0.059-0.050=0.009
min70.336-31.003=39.334
max70.537-31.180=39.357
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.157-0.079=0.079
σ0.004-0.005=-0.001
min0.150-0.071=0.079
max0.165-0.086=0.079
cache=y
dps=1
iters=10
policies=100
mean21.142-21.142=-0.000
σ0.003-0.002=0.000
min21.139-21.139=0.000
max21.146-21.147=-0.001
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.060-0.061=-0.001
σ0.003-0.003=-0.001
min0.058-0.057=0.000
max0.066-0.066=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.201-1751.413=0.789
σ0.363-0.362=0.001
min1751.628-1750.844=0.784
max1752.803-1752.000=0.803
mean1660.750-1649.950=10.800
σ636.260-644.657=-8.396
min623.000-625.000=-2.000
max2791.000-2846.000=-55.000
mean2.813-2.771=0.041
σ0.197-0.218=-0.021
min2.274-2.275=-0.001
max3.165-3.078=0.087

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.932-266.782=3.151
σ0.006-0.007=-0.002
min269.926-266.775=3.152
max269.940-266.793=3.148
mean2791.000-2846.000=-55.000
σ0.000
min2791.000-2846.000=-55.000
max2791.000-2846.000=-55.000
mean0.372-0.371=0.001
σ0.004-0.008=-0.004
min0.369-0.365=0.004
max0.379-0.380=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1930.389-1927.219=3.170
σ0.012-0.010=0.002
min1930.377-1927.210=3.167
max1930.403-1927.234=3.168
mean2791.000-2846.000=-55.000
σ0.000
min2791.000-2846.000=-55.000
max2791.000-2846.000=-55.000
mean2.836-2.915=-0.080
σ0.225-0.313=-0.088
min2.673-2.378=0.294
max3.223-3.171=0.051
iters=5
new-facts=6402
prior-facts=1
mean4750.625-4747.635=2.990
σ0.353-0.479=-0.126
min4750.348-4747.358=2.989
max4751.240-4748.487=2.753
mean2791.000-2846.000=-55.000
σ0.000
min2791.000-2846.000=-55.000
max2791.000-2846.000=-55.000
mean8.729-8.233=0.496
σ0.510-0.339=0.171
min7.837-7.735=0.102
max9.029-8.666=0.364
iters=5
new-facts=6402
prior-facts=6402
mean4941.325-4938.169=3.156
σ0.088-0.094=-0.006
min4941.248-4938.071=3.177
max4941.434-4938.275=3.159
mean3039.000-3068.800=-29.800
σ294.150-235.131=59.019
min2791.000-2846.000=-55.000
max3474.000-3410.000=64.000
mean8.514-8.744=-0.230
σ0.132-0.285=-0.153
min8.302-8.396=-0.094
max8.627-9.149=-0.522

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.051-1.076=-0.025
σ0.187-0.111=0.076
min0.934-0.940=-0.006
max1.368-1.249=0.119

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.911-465.119=0.792
σ575.765-575.755=0.010
min178.018-177.233=0.785
max1329.558-1328.751=0.807
mean81.750-79.750=2.000
σ7.500
min78.000-76.000=2.000
max93.000-91.000=2.000
mean2791.000-2846.000=-55.000
σ0.000
min2791.000-2846.000=-55.000
max2791.000-2846.000=-55.000
mean0.441-0.438=0.003
σ0.308-0.303=0.005
min0.282-0.286=-0.003
max0.903-0.893=0.011
policies=20
mean1780.517-1772.622=7.895
σ0.360-0.332=0.028
min1780.264-1772.385=7.879
max1781.047-1773.111=7.936
mean780.000-760.000=20.000
σ0.000
min780.000-760.000=20.000
max780.000-760.000=20.000
mean2791.000-2846.000=-55.000
σ0.000
min2791.000-2846.000=-55.000
max2791.000-2846.000=-55.000
mean2.840-2.826=0.014
σ0.094-0.010=0.084
min2.761-2.816=-0.055
max2.964-2.839=0.125
policies=200
mean17811.514-17732.508=79.006
σ0.512-0.365=0.147
min17811.218-17732.210=79.008
max17812.281-17733.036=79.245
mean7800.000-7600.000=200.000
σ0.000
min7800.000-7600.000=200.000
max7800.000-7600.000=200.000
mean2791.000-2846.000=-55.000
σ0.000
min2791.000-2846.000=-55.000
max2791.000-2846.000=-55.000
mean27.861-28.177=-0.316
σ0.103-0.567=-0.465
min27.785-27.620=0.166
max28.012-28.785=-0.772