Compare commits

Home / Compare 556cb7f9 .. 19712fb6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.390-70.390=0.000
σ0.049-0.049=0.000
min70.359-70.362=-0.003
max70.526-70.526=0.000
mean415.000-411.000=4.000
σ0.000
min415.000-411.000=4.000
max415.000-411.000=4.000
mean0.160-0.160=0.000
σ0.004-0.004=-0.000
min0.156-0.153=0.003
max0.168-0.167=0.001
cache=y
dps=1
iters=10
policies=100
mean21.145-21.144=0.000
σ0.003-0.002=0.001
min21.141-21.141=0.000
max21.149-21.148=0.001
mean415.000-411.000=4.000
σ0.000
min415.000-411.000=4.000
max415.000-411.000=4.000
mean0.064-0.063=0.001
σ0.002-0.003=-0.001
min0.062-0.060=0.003
max0.070-0.070=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.393-1752.395=-0.003
σ0.361-0.361=0.000
min1751.827-1751.827=0.000
max1752.989-1752.981=0.007
mean1654.800-1652.000=2.800
σ629.221-618.821=10.400
min617.000-639.000=-22.000
max2771.000-2491.000=280.000
mean2.842-2.839=0.003
σ0.153-0.115=0.038
min2.511-2.514=-0.003
max3.117-3.153=-0.036

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.140-270.146=-0.005
σ0.009-0.005=0.004
min270.128-270.141=-0.012
max270.151-270.151=-0.001
mean2771.000-2491.000=280.000
σ0.000
min2771.000-2491.000=280.000
max2771.000-2491.000=280.000
mean0.378-0.379=-0.001
σ0.005-0.002=0.003
min0.372-0.375=-0.004
max0.384-0.380=0.004
iters=5
new-facts=1
prior-facts=6402
mean1930.609-1930.596=0.013
σ0.008-0.013=-0.005
min1930.598-1930.579=0.018
max1930.619-1930.614=0.005
mean2771.000-2491.000=280.000
σ0.000
min2771.000-2491.000=280.000
max2771.000-2491.000=280.000
mean2.517-2.549=-0.032
σ0.102-0.088=0.013
min2.450-2.486=-0.036
max2.691-2.694=-0.003
iters=5
new-facts=6402
prior-facts=1
mean4751.318-4751.209=0.109
σ0.908-1.032=-0.124
min4750.802-4750.235=0.568
max4752.933-4752.966=-0.033
mean2771.000-2491.000=280.000
σ0.000
min2771.000-2491.000=280.000
max2771.000-2491.000=280.000
mean8.477-8.570=-0.092
σ0.526-0.622=-0.096
min7.614-7.610=0.004
max9.000-9.182=-0.182
iters=5
new-facts=6402
prior-facts=6402
mean4941.695-4941.772=-0.077
σ0.154-0.016=0.138
min4941.423-4941.757=-0.334
max4941.785-4941.789=-0.004
mean3014.000-2935.200=78.800
σ236.541-306.318=-69.777
min2771.000-2491.000=280.000
max3328.000-3306.000=22.000
mean8.626-8.489=0.137
σ0.245-0.063=0.182
min8.394-8.440=-0.046
max9.009-8.590=0.419

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.088-1.735=-0.647
σ0.142-0.173=-0.031
min0.934-1.476=-0.542
max1.322-1.885=-0.564

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.375-466.366=0.009
σ575.936-575.919=0.017
min178.401-178.403=-0.002
max1330.280-1330.245=0.035
mean84.250-84.000=0.250
σ8.500-8.000=0.500
min80.000
max97.000-96.000=1.000
mean2771.000-2491.000=280.000
σ0.000
min2771.000-2491.000=280.000
max2771.000-2491.000=280.000
mean0.440-0.564=-0.123
σ0.304-0.564=-0.260
min0.284-0.279=0.005
max0.897-1.410=-0.514
policies=20
mean1784.323-1784.317=0.006
σ0.316-0.354=-0.038
min1784.104-1784.092=0.012
max1784.782-1784.844=-0.062
mean800.000
σ0.000
min800.000
max800.000
mean2771.000-2491.000=280.000
σ0.000
min2771.000-2491.000=280.000
max2771.000-2491.000=280.000
mean2.824-2.782=0.041
σ0.089-0.015=0.074
min2.756-2.766=-0.009
max2.954-2.800=0.155
policies=200
mean17849.642-17849.869=-0.227
σ0.512-0.452=0.060
min17849.353-17849.614=-0.261
max17850.409-17850.545=-0.136
mean8000.000
σ0.000
min8000.000
max8000.000
mean2771.000-2491.000=280.000
σ0.000
min2771.000-2491.000=280.000
max2771.000-2491.000=280.000
mean27.990-28.001=-0.011
σ0.198-0.105=0.094
min27.843-27.860=-0.017
max28.283-28.083=0.200