Compare commits

Home / Compare 70f68a40 .. 85691986

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.385-70.384=0.001
σ0.047-0.049=-0.002
min70.358-70.355=0.003
max70.516-70.521=-0.005
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.159-0.159=-0.001
σ0.004-0.005=-0.001
min0.154-0.153=0.001
max0.164-0.167=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.142-21.141=0.000
σ0.003-0.003=-0.000
min21.137-21.137=-0.000
max21.146-21.148=-0.001
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.065-0.062=0.003
σ0.002-0.004=-0.001
min0.063-0.059=0.004
max0.071-0.071=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.394-1752.395=-0.001
σ0.359-0.360=-0.001
min1751.823-1751.823=-0.000
max1752.958-1752.981=-0.024
mean1652.600-1644.850=7.750
σ644.553-632.951=11.602
min631.000-619.000=12.000
max2855.000-2768.000=87.000
mean2.807-2.848=-0.041
σ0.167-0.176=-0.009
min2.444-2.381=0.062
max3.005-3.124=-0.119

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.144-270.140=0.004
σ0.006-0.011=-0.005
min270.133-270.128=0.005
max270.149-270.153=-0.004
mean2855.000-2768.000=87.000
σ0.000
min2855.000-2768.000=87.000
max2855.000-2768.000=87.000
mean0.376-0.389=-0.013
σ0.001-0.010=-0.009
min0.375-0.379=-0.004
max0.377-0.399=-0.022
iters=5
new-facts=1
prior-facts=6402
mean1930.607-1930.594=0.013
σ0.011-0.020=-0.009
min1930.593-1930.570=0.023
max1930.622-1930.616=0.006
mean2855.000-2768.000=87.000
σ0.000
min2855.000-2768.000=87.000
max2855.000-2768.000=87.000
mean2.554-2.565=-0.011
σ0.119-0.142=-0.023
min2.453-2.458=-0.005
max2.727-2.813=-0.085
iters=5
new-facts=6402
prior-facts=1
mean4751.274-4751.311=-0.036
σ0.867-0.920=-0.053
min4750.743-4750.767=-0.024
max4752.814-4752.947=-0.134
mean2855.000-2768.000=87.000
σ0.000
min2855.000-2768.000=87.000
max2855.000-2768.000=87.000
mean8.732-8.565=0.167
σ0.323-0.555=-0.232
min8.455-7.676=0.779
max9.272-9.080=0.191
iters=5
new-facts=6402
prior-facts=6402
mean4941.696-4941.765=-0.069
σ0.148-0.024=0.125
min4941.433-4941.735=-0.302
max4941.782-4941.788=-0.006
mean3074.600-2987.800=86.800
σ225.324-257.200=-31.876
min2855.000-2768.000=87.000
max3305.000-3366.000=-61.000
mean8.773-8.503=0.270
σ0.298-0.151=0.147
min8.428-8.323=0.105
max9.228-8.675=0.554

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.988-1.062=-0.075
σ0.147-0.132=0.016
min0.912-0.944=-0.032
max1.251-1.265=-0.014

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.381-466.373=0.008
σ575.936-575.936=-0.001
min178.403-178.401=0.002
max1330.284-1330.277=0.007
mean84.250
σ8.500
min80.000
max97.000
mean2855.000-2768.000=87.000
σ0.000
min2855.000-2768.000=87.000
max2855.000-2768.000=87.000
mean0.445-0.447=-0.002
σ0.304-0.305=-0.001
min0.290-0.289=0.001
max0.901-0.904=-0.003
policies=20
mean1784.361-1784.331=0.031
σ0.361-0.334=0.027
min1784.111-1784.101=0.009
max1784.893-1784.816=0.077
mean800.000
σ0.000
min800.000
max800.000
mean2855.000-2768.000=87.000
σ0.000
min2855.000-2768.000=87.000
max2855.000-2768.000=87.000
mean2.863-2.856=0.006
σ0.006-0.127=-0.121
min2.856-2.781=0.075
max2.870-3.046=-0.176
policies=200
mean17849.741-17849.784=-0.043
σ0.539-0.582=-0.043
min17849.460-17849.351=0.108
max17850.549-17850.642=-0.093
mean8000.000
σ0.000
min8000.000
max8000.000
mean2855.000-2768.000=87.000
σ0.000
min2855.000-2768.000=87.000
max2855.000-2768.000=87.000
mean28.474-28.095=0.379
σ0.531-0.372=0.159
min27.938-27.866=0.072
max28.982-28.650=0.332