Compare commits

Home / Compare 68e85579 .. d71e9dee

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.380-70.380=-0.000
σ0.047-0.046=0.001
min70.351-70.355=-0.004
max70.511-70.507=0.003
mean411.400-414.000=-2.600
σ0.516-0.000=0.516
min411.000-414.000=-3.000
max412.000-414.000=-2.000
mean0.158-0.158=0.001
σ0.005-0.004=0.001
min0.151-0.151=0.000
max0.165-0.165=0.000
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=0.000
σ0.002-0.003=-0.000
min21.141-21.140=0.001
max21.149-21.147=0.001
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.062-0.062=0.000
σ0.004-0.004=0.001
min0.058-0.059=-0.000
max0.073-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.388-1752.386=0.001
σ0.361-0.365=-0.004
min1751.817-1751.824=-0.007
max1752.967-1752.974=-0.007
mean1654.100-1662.500=-8.400
σ644.477-628.969=15.508
min623.000-685.000=-62.000
max2848.000-2791.000=57.000
mean2.853-2.800=0.053
σ0.083-0.193=-0.110
min2.679-2.271=0.408
max3.023-3.114=-0.092

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.127-270.126=0.001
σ0.003-0.004=-0.001
min270.124-270.121=0.003
max270.131-270.133=-0.001
mean2848.000-2791.000=57.000
σ0.000
min2848.000-2791.000=57.000
max2848.000-2791.000=57.000
mean0.381-0.380=0.001
σ0.004-0.004=0.001
min0.378-0.377=0.000
max0.389-0.387=0.002
iters=5
new-facts=1
prior-facts=6402
mean1930.595-1930.585=0.009
σ0.026-0.015=0.011
min1930.560-1930.559=0.001
max1930.629-1930.600=0.029
mean2848.000-2791.000=57.000
σ0.000
min2848.000-2791.000=57.000
max2848.000-2791.000=57.000
mean2.492-2.559=-0.067
σ0.098-0.132=-0.034
min2.427-2.390=0.037
max2.664-2.724=-0.059
iters=5
new-facts=6402
prior-facts=1
mean4750.932-4751.019=-0.087
σ0.944-0.851=0.093
min4750.181-4750.273=-0.092
max4752.582-4752.480=0.102
mean2848.000-2791.000=57.000
σ0.000
min2848.000-2791.000=57.000
max2848.000-2791.000=57.000
mean8.658-8.060=0.598
σ0.171-0.308=-0.137
min8.482-7.670=0.812
max8.929-8.425=0.504
iters=5
new-facts=6402
prior-facts=6402
mean4941.531-4941.451=0.080
σ0.082-0.207=-0.125
min4941.466-4941.104=0.362
max4941.628-4941.610=0.018
mean3066.200-3057.600=8.600
σ233.615-330.268=-96.652
min2848.000-2791.000=57.000
max3411.000-3558.000=-147.000
mean8.566-8.377=0.189
σ0.214-0.086=0.128
min8.308-8.316=-0.009
max8.832-8.529=0.303

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.997-1.068=-0.071
σ0.137-0.106=0.031
min0.931-0.938=-0.007
max1.242-1.234=0.008

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.358-466.361=-0.003
σ575.921-575.932=-0.012
min178.392-178.387=0.005
max1330.239-1330.260=-0.020
mean84.000
σ8.000
min80.000
max96.000
mean2848.000-2791.000=57.000
σ0.000
min2848.000-2791.000=57.000
max2848.000-2791.000=57.000
mean0.442-0.440=0.002
σ0.302-0.303=-0.001
min0.289-0.283=0.005
max0.896-0.895=0.001
policies=20
mean1784.247-1784.279=-0.032
σ0.356-0.339=0.017
min1784.016-1784.076=-0.060
max1784.775-1784.783=-0.009
mean800.000
σ0.000
min800.000
max800.000
mean2848.000-2791.000=57.000
σ0.000
min2848.000-2791.000=57.000
max2848.000-2791.000=57.000
mean2.858-2.861=-0.003
σ0.033-0.115=-0.081
min2.837-2.777=0.060
max2.908-3.025=-0.117
policies=200
mean17848.792-17848.817=-0.024
σ0.443-0.344=0.099
min17848.479-17848.582=-0.103
max17849.445-17849.328=0.117
mean8000.000
σ0.000
min8000.000
max8000.000
mean2848.000-2791.000=57.000
σ0.000
min2848.000-2791.000=57.000
max2848.000-2791.000=57.000
mean28.297-27.999=0.299
σ0.534-0.119=0.415
min27.832-27.912=-0.080
max28.771-28.174=0.597