Compare commits

Home / Compare 06bfe25a .. 4b54f79b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.373-70.373=0.000
σ0.059-0.058=0.000
min70.336-70.336=0.001
max70.537-70.537=0.001
mean416.000
σ0.000
min416.000
max416.000
mean0.157-0.157=0.000
σ0.004-0.005=-0.000
min0.150-0.149=0.001
max0.165-0.164=0.001
cache=y
dps=1
iters=10
policies=100
mean21.142-21.143=-0.001
σ0.003-0.003=-0.000
min21.139-21.139=-0.000
max21.146-21.146=-0.000
mean416.000
σ0.000
min416.000
max416.000
mean0.060-0.064=-0.004
σ0.003-0.003=-0.001
min0.058-0.057=0.000
max0.066-0.071=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.201-1752.198=0.003
σ0.363-0.364=-0.001
min1751.628-1751.638=-0.010
max1752.803-1752.787=0.016
mean1660.750-1676.000=-15.250
σ636.260-626.271=9.989
min623.000-668.000=-45.000
max2791.000-2626.000=165.000
mean2.813-2.826=-0.013
σ0.197-0.119=0.078
min2.274-2.517=-0.243
max3.165-3.033=0.132

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.932-269.928=0.004
σ0.006-0.009=-0.004
min269.926-269.921=0.005
max269.940-269.943=-0.002
mean2791.000-2626.000=165.000
σ0.000
min2791.000-2626.000=165.000
max2791.000-2626.000=165.000
mean0.372-0.378=-0.006
σ0.004-0.014=-0.010
min0.369-0.368=0.001
max0.379-0.401=-0.022
iters=5
new-facts=1
prior-facts=6402
mean1930.389-1930.401=-0.011
σ0.012-0.015=-0.004
min1930.377-1930.374=0.003
max1930.403-1930.412=-0.010
mean2791.000-2626.000=165.000
σ0.000
min2791.000-2626.000=165.000
max2791.000-2626.000=165.000
mean2.836-2.518=0.317
σ0.225-0.189=0.036
min2.673-2.275=0.398
max3.223-2.806=0.416
iters=5
new-facts=6402
prior-facts=1
mean4750.625-4750.844=-0.219
σ0.353-0.946=-0.592
min4750.348-4750.292=0.056
max4751.240-4752.525=-1.285
mean2791.000-2626.000=165.000
σ0.000
min2791.000-2626.000=165.000
max2791.000-2626.000=165.000
mean8.729-8.884=-0.155
σ0.510-0.429=0.080
min7.837-8.409=-0.572
max9.029-9.524=-0.494
iters=5
new-facts=6402
prior-facts=6402
mean4941.325-4941.260=0.065
σ0.088-0.199=-0.111
min4941.248-4940.933=0.315
max4941.434-4941.428=0.006
mean3039.000-3010.200=28.800
σ294.150-275.037=19.114
min2791.000-2630.000=161.000
max3474.000-3320.000=154.000
mean8.514-8.496=0.018
σ0.132-0.149=-0.017
min8.302-8.364=-0.062
max8.627-8.724=-0.097

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.051-1.210=-0.159
σ0.187-0.253=-0.067
min0.934-0.940=-0.006
max1.368-1.610=-0.242

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.911-465.912=-0.001
σ575.765-575.773=-0.008
min178.018-178.019=-0.001
max1329.558-1329.572=-0.014
mean81.750
σ7.500
min78.000
max93.000
mean2791.000-2626.000=165.000
σ0.000
min2791.000-2626.000=165.000
max2791.000-2626.000=165.000
mean0.441-0.563=-0.122
σ0.308-0.565=-0.256
min0.282-0.279=0.004
max0.903-1.410=-0.506
policies=20
mean1780.517-1780.455=0.061
σ0.360-0.361=-0.000
min1780.264-1780.215=0.048
max1781.047-1780.990=0.056
mean780.000
σ0.000
min780.000
max780.000
mean2791.000-2626.000=165.000
σ0.000
min2791.000-2626.000=165.000
max2791.000-2626.000=165.000
mean2.840-2.758=0.081
σ0.094-0.013=0.081
min2.761-2.746=0.015
max2.964-2.771=0.193
policies=200
mean17811.514-17811.584=-0.070
σ0.512-0.508=0.004
min17811.218-17811.287=-0.070
max17812.281-17812.345=-0.064
mean7800.000
σ0.000
min7800.000
max7800.000
mean2791.000-2626.000=165.000
σ0.000
min2791.000-2626.000=165.000
max2791.000-2626.000=165.000
mean27.861-27.793=0.069
σ0.103-0.139=-0.037
min27.785-27.673=0.112
max28.012-27.994=0.018