Compare commits

Home / Compare 454c073c .. ddf12d26

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.381-70.381=-0.000
σ0.045-0.048=-0.003
min70.350-70.354=-0.004
max70.507-70.516=-0.009
mean418.000-413.600=4.400
σ0.000-0.516=-0.516
min418.000-413.000=5.000
max418.000-414.000=4.000
mean0.161-0.158=0.003
σ0.003-0.004=-0.001
min0.158-0.152=0.006
max0.168-0.163=0.004
cache=y
dps=1
iters=10
policies=100
mean21.143-21.145=-0.002
σ0.002-0.003=-0.001
min21.141-21.141=-0.001
max21.145-21.149=-0.003
mean418.000-414.000=4.000
σ0.000
min418.000-414.000=4.000
max418.000-414.000=4.000
mean0.063-0.064=-0.002
σ0.003-0.003=-0.000
min0.059-0.059=0.000
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.385-1752.386=-0.001
σ0.360-0.358=0.002
min1751.818-1751.819=-0.001
max1752.963-1752.951=0.012
mean1654.700-1632.400=22.300
σ644.901-590.511=54.390
min634.000-626.000=8.000
max2850.000-2415.000=435.000
mean2.837-2.812=0.025
σ0.143-0.198=-0.055
min2.431-2.190=0.241
max3.026-3.065=-0.039

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.132-270.127=0.005
σ0.003-0.005=-0.001
min270.127-270.123=0.005
max270.136-270.133=0.003
mean2850.000-2415.000=435.000
σ0.000
min2850.000-2415.000=435.000
max2850.000-2415.000=435.000
mean0.384-0.382=0.002
σ0.004-0.005=-0.001
min0.381-0.379=0.002
max0.390-0.390=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1930.593-1930.595=-0.001
σ0.010-0.008=0.002
min1930.584-1930.586=-0.001
max1930.608-1930.605=0.002
mean2850.000-2415.000=435.000
σ0.000
min2850.000-2415.000=435.000
max2850.000-2415.000=435.000
mean2.517-2.539=-0.022
σ0.083-0.083=0.001
min2.456-2.471=-0.015
max2.655-2.671=-0.015
iters=5
new-facts=6402
prior-facts=1
mean4751.060-4751.060=-0.000
σ0.872-0.877=-0.005
min4750.520-4750.610=-0.090
max4752.611-4752.625=-0.014
mean2850.000-2415.000=435.000
σ0.000
min2850.000-2415.000=435.000
max2850.000-2415.000=435.000
mean8.598-8.667=-0.068
σ0.561-0.710=-0.149
min7.611-7.646=-0.036
max8.925-9.408=-0.483
iters=5
new-facts=6402
prior-facts=6402
mean4941.455-4941.464=-0.009
σ0.215-0.126=0.090
min4941.098-4941.280=-0.182
max4941.626-4941.634=-0.008
mean3060.600-3010.400=50.200
σ225.995-281.084=-55.089
min2850.000-2618.000=232.000
max3395.000-3319.000=76.000
mean8.598-8.648=-0.050
σ0.200-0.235=-0.035
min8.391-8.367=0.025
max8.887-8.938=-0.051

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.050-1.834=-0.785
σ0.134-0.159=-0.025
min0.933-1.619=-0.686
max1.260-2.035=-0.775

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.363-466.350=0.013
σ575.915-575.914=0.001
min178.399-178.390=0.009
max1330.236-1330.221=0.014
mean84.000
σ8.000
min80.000
max96.000
mean2850.000-2415.000=435.000
σ0.000
min2850.000-2415.000=435.000
max2850.000-2415.000=435.000
mean0.443-0.563=-0.119
σ0.307-0.563=-0.256
min0.284-0.279=0.005
max0.903-1.407=-0.504
policies=20
mean1784.271-1784.194=0.077
σ0.368-0.359=0.010
min1784.006-1783.966=0.041
max1784.811-1784.728=0.083
mean800.000
σ0.000
min800.000
max800.000
mean2850.000-2415.000=435.000
σ0.000
min2850.000-2415.000=435.000
max2850.000-2415.000=435.000
mean2.870-2.775=0.095
σ0.005-0.014=-0.009
min2.864-2.760=0.104
max2.875-2.793=0.081
policies=200
mean17848.808-17848.773=0.035
σ0.547-0.412=0.134
min17848.408-17848.467=-0.059
max17849.602-17849.377=0.225
mean8000.000
σ0.000
min8000.000
max8000.000
mean2850.000-2415.000=435.000
σ0.000
min2850.000-2415.000=435.000
max2850.000-2415.000=435.000
mean28.469-27.876=0.592
σ0.500-0.060=0.440
min27.955-27.791=0.165
max28.900-27.928=0.972