Compare commits

Home / Compare caa14e4c .. 507c594a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.380-70.379=0.001
σ0.047-0.045=0.002
min70.344-70.351=-0.007
max70.510-70.503=0.008
mean412.000-414.200=-2.200
σ0.000-0.422=-0.422
min412.000-414.000=-2.000
max412.000-415.000=-3.000
mean0.161-0.162=-0.001
σ0.003-0.003=0.001
min0.157-0.159=-0.001
max0.166-0.167=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=0.000
σ0.003-0.003=-0.000
min21.138-21.138=0.001
max21.149-21.147=0.002
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.065-0.063=0.001
σ0.002-0.003=-0.001
min0.063-0.060=0.003
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.389-1752.386=0.003
σ0.362-0.360=0.002
min1751.818-1751.818=-0.000
max1752.968-1752.951=0.017
mean1636.650-1642.150=-5.500
σ614.392-613.929=0.464
min622.000-671.000=-49.000
max2470.000-2545.000=-75.000
mean2.828-2.785=0.043
σ0.118-0.169=-0.050
min2.444-2.440=0.003
max3.012-3.136=-0.125

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.129-270.126=0.003
σ0.007-0.006=0.001
min270.121-270.120=0.001
max270.136-270.133=0.003
mean2470.000-2545.000=-75.000
σ0.000
min2470.000-2545.000=-75.000
max2470.000-2545.000=-75.000
mean0.380-0.374=0.006
σ0.001-0.004=-0.003
min0.379-0.371=0.008
max0.381-0.381=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1930.593-1930.594=-0.000
σ0.014-0.009=0.006
min1930.568-1930.583=-0.015
max1930.603-1930.604=-0.001
mean2470.000-2545.000=-75.000
σ0.000
min2470.000-2545.000=-75.000
max2470.000-2545.000=-75.000
mean2.547-2.503=0.044
σ0.062-0.041=0.021
min2.506-2.471=0.035
max2.653-2.569=0.084
iters=5
new-facts=6402
prior-facts=1
mean4751.097-4751.012=0.085
σ0.859-0.538=0.321
min4750.660-4750.751=-0.091
max4752.632-4751.973=0.659
mean2470.000-2545.000=-75.000
σ0.000
min2470.000-2545.000=-75.000
max2470.000-2545.000=-75.000
mean8.292-8.181=0.111
σ0.636-0.430=0.206
min7.712-7.666=0.046
max9.003-8.604=0.399
iters=5
new-facts=6402
prior-facts=6402
mean4941.527-4941.320=0.207
σ0.087-0.287=-0.200
min4941.450-4940.924=0.526
max4941.628-4941.636=-0.008
mean2942.800-2984.400=-41.600
σ395.415-284.461=110.953
min2470.000-2600.000=-130.000
max3460.000-3322.000=138.000
mean8.536-8.580=-0.043
σ0.168-0.219=-0.051
min8.330-8.429=-0.098
max8.753-8.923=-0.170

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.700-1.444=0.257
σ0.157-0.271=-0.115
min1.485-1.196=0.288
max1.837-1.802=0.035

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.353-466.357=-0.004
σ575.920-575.931=-0.011
min178.390-178.390=-0.001
max1330.234-1330.254=-0.020
mean84.000
σ8.000
min80.000
max96.000
mean2470.000-2545.000=-75.000
σ0.000
min2470.000-2545.000=-75.000
max2470.000-2545.000=-75.000
mean0.557-0.567=-0.009
σ0.542-0.569=-0.027
min0.285-0.278=0.007
max1.370-1.420=-0.050
policies=20
mean1784.223-1784.206=0.017
σ0.352-0.359=-0.006
min1783.991-1783.980=0.011
max1784.746-1784.740=0.006
mean800.000
σ0.000
min800.000
max800.000
mean2470.000-2545.000=-75.000
σ0.000
min2470.000-2545.000=-75.000
max2470.000-2545.000=-75.000
mean2.784-2.792=-0.008
σ0.012-0.006=0.006
min2.776-2.784=-0.008
max2.802-2.798=0.004
policies=200
mean17848.848-17848.874=-0.025
σ0.384-0.516=-0.132
min17848.579-17848.533=0.046
max17849.418-17849.643=-0.224
mean8000.000
σ0.000
min8000.000
max8000.000
mean2470.000-2545.000=-75.000
σ0.000
min2470.000-2545.000=-75.000
max2470.000-2545.000=-75.000
mean28.047-28.020=0.028
σ0.034-0.089=-0.055
min28.020-27.942=0.078
max28.093-28.132=-0.039