Compare commits

Home / Compare 09e4df06 .. 8b53d18a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.373-70.374=-0.000
σ0.059-0.059=-0.001
min70.336-70.334=0.002
max70.537-70.540=-0.002
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.157-0.158=-0.000
σ0.004-0.006=-0.002
min0.150-0.149=0.001
max0.165-0.168=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.142-21.143=-0.001
σ0.003-0.002=0.000
min21.139-21.140=-0.001
max21.146-21.146=-0.000
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.060-0.064=-0.004
σ0.003-0.003=-0.000
min0.058-0.057=0.000
max0.066-0.069=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.201-1752.197=0.004
σ0.363-0.362=0.001
min1751.628-1751.632=-0.004
max1752.803-1752.761=0.042
mean1660.750-1640.800=19.950
σ636.260-613.662=22.599
min623.000-629.000=-6.000
max2791.000-2470.000=321.000
mean2.813-2.841=-0.029
σ0.197-0.122=0.075
min2.274-2.603=-0.329
max3.165-3.032=0.133

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.932-269.934=-0.001
σ0.006-0.006=-0.001
min269.926-269.927=-0.000
max269.940-269.943=-0.003
mean2791.000-2470.000=321.000
σ0.000
min2791.000-2470.000=321.000
max2791.000-2470.000=321.000
mean0.372-0.382=-0.010
σ0.004-0.011=-0.007
min0.369-0.372=-0.003
max0.379-0.400=-0.021
iters=5
new-facts=1
prior-facts=6402
mean1930.389-1930.386=0.003
σ0.012-0.025=-0.014
min1930.377-1930.357=0.020
max1930.403-1930.411=-0.008
mean2791.000-2470.000=321.000
σ0.000
min2791.000-2470.000=321.000
max2791.000-2470.000=321.000
mean2.836-2.566=0.270
σ0.225-0.161=0.064
min2.673-2.406=0.267
max3.223-2.830=0.392
iters=5
new-facts=6402
prior-facts=1
mean4750.625-4750.851=-0.226
σ0.353-0.810=-0.456
min4750.348-4750.338=0.010
max4751.240-4752.278=-1.038
mean2791.000-2470.000=321.000
σ0.000
min2791.000-2470.000=321.000
max2791.000-2470.000=321.000
mean8.729-8.637=0.092
σ0.510-0.224=0.285
min7.837-8.411=-0.574
max9.029-8.925=0.105
iters=5
new-facts=6402
prior-facts=6402
mean4941.325-4941.332=-0.007
σ0.088-0.084=0.004
min4941.248-4941.259=-0.011
max4941.434-4941.426=0.008
mean3039.000-2961.600=77.400
σ294.150-272.859=21.292
min2791.000-2595.000=196.000
max3474.000-3316.000=158.000
mean8.514-8.450=0.064
σ0.132-0.032=0.100
min8.302-8.411=-0.110
max8.627-8.495=0.132

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.051-1.850=-0.799
σ0.187-0.033=0.153
min0.934-1.813=-0.878
max1.368-1.885=-0.517

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.911-465.903=0.008
σ575.765-575.758=0.007
min178.018-178.022=-0.003
max1329.558-1329.540=0.018
mean81.750
σ7.500
min78.000
max93.000
mean2791.000-2470.000=321.000
σ0.000
min2791.000-2470.000=321.000
max2791.000-2470.000=321.000
mean0.441-0.550=-0.109
σ0.308-0.531=-0.223
min0.282-0.269=0.014
max0.903-1.346=-0.442
policies=20
mean1780.517-1780.452=0.064
σ0.360-0.356=0.004
min1780.264-1780.213=0.051
max1781.047-1780.981=0.066
mean780.000
σ0.000
min780.000
max780.000
mean2791.000-2470.000=321.000
σ0.000
min2791.000-2470.000=321.000
max2791.000-2470.000=321.000
mean2.840-2.767=0.072
σ0.094-0.015=0.080
min2.761-2.751=0.010
max2.964-2.784=0.180
policies=200
mean17811.514-17811.215=0.299
σ0.512-0.409=0.103
min17811.218-17810.906=0.312
max17812.281-17811.818=0.463
mean7800.000
σ0.000
min7800.000
max7800.000
mean2791.000-2470.000=321.000
σ0.000
min2791.000-2470.000=321.000
max2791.000-2470.000=321.000
mean27.861-27.927=-0.065
σ0.103-0.109=-0.006
min27.785-27.833=-0.048
max28.012-28.051=-0.039