Compare commits

Home / Compare eb043457 .. 5e3bdff6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.390-70.389=0.001
σ0.047-0.045=0.002
min70.360-70.361=-0.001
max70.520-70.515=0.005
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.158-0.158=-0.000
σ0.005-0.005=0.000
min0.151-0.151=0.000
max0.166-0.165=0.001
cache=y
dps=1
iters=10
policies=100
mean21.145-21.145=0.001
σ0.002-0.002=-0.000
min21.143-21.141=0.002
max21.149-21.148=0.001
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.066-0.064=0.002
σ0.002-0.002=-0.000
min0.063-0.060=0.004
max0.072-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.394-1752.397=-0.003
σ0.362-0.362=-0.001
min1751.825-1751.821=0.004
max1752.996-1752.979=0.017
mean1658.600-1634.100=24.500
σ628.891-600.575=28.316
min619.000-626.000=-7.000
max2773.000-2423.000=350.000
mean2.779-2.799=-0.020
σ0.157-0.171=-0.014
min2.373-2.272=0.102
max2.983-3.011=-0.028

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.231-270.237=-0.006
σ0.008-0.004=0.004
min270.220-270.231=-0.011
max270.241-270.241=-0.000
mean2773.000-2423.000=350.000
σ0.000
min2773.000-2423.000=350.000
max2773.000-2423.000=350.000
mean0.377-0.375=0.002
σ0.006-0.004=0.002
min0.370-0.369=0.001
max0.383-0.379=0.004
iters=5
new-facts=1
prior-facts=6402
mean1930.700-1930.703=-0.004
σ0.017-0.013=0.004
min1930.673-1930.687=-0.014
max1930.717-1930.719=-0.002
mean2773.000-2423.000=350.000
σ0.000
min2773.000-2423.000=350.000
max2773.000-2423.000=350.000
mean2.534-2.511=0.024
σ0.097-0.058=0.040
min2.417-2.457=-0.040
max2.678-2.587=0.091
iters=5
new-facts=6402
prior-facts=1
mean4751.442-4751.492=-0.050
σ0.885-0.885=-0.000
min4750.861-4750.882=-0.020
max4753.001-4753.043=-0.042
mean2773.000-2423.000=350.000
σ0.000
min2773.000-2423.000=350.000
max2773.000-2423.000=350.000
mean8.258-8.565=-0.307
σ0.669-0.832=-0.162
min7.608-7.658=-0.049
max9.146-9.687=-0.541
iters=5
new-facts=6402
prior-facts=6402
mean4941.718-4941.801=-0.082
σ0.202-0.143=0.058
min4941.465-4941.545=-0.080
max4941.884-4941.877=0.007
mean3052.000-3012.400=39.600
σ342.809-259.586=83.223
min2773.000-2624.000=149.000
max3563.000-3317.000=246.000
mean8.417-8.488=-0.071
σ0.126-0.117=0.008
min8.338-8.344=-0.006
max8.628-8.581=0.047

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.045-1.786=-0.741
σ0.133-0.119=0.014
min0.926-1.584=-0.657
max1.252-1.892=-0.640

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.378-466.369=0.009
σ575.929-575.930=-0.001
min178.408-178.402=0.007
max1330.271-1330.264=0.007
mean84.250
σ8.500
min80.000
max97.000
mean2773.000-2423.000=350.000
σ0.000
min2773.000-2423.000=350.000
max2773.000-2423.000=350.000
mean0.442-0.566=-0.124
σ0.303-0.573=-0.270
min0.285-0.275=0.010
max0.897-1.426=-0.529
policies=20
mean1784.367-1784.319=0.048
σ0.359-0.359=-0.000
min1784.132-1784.092=0.040
max1784.897-1784.854=0.043
mean800.000
σ0.000
min800.000
max800.000
mean2773.000-2423.000=350.000
σ0.000
min2773.000-2423.000=350.000
max2773.000-2423.000=350.000
mean2.830-2.778=0.052
σ0.120-0.013=0.107
min2.767-2.763=0.004
max3.010-2.793=0.217
policies=200
mean17849.755-17849.741=0.013
σ0.485-0.597=-0.112
min17849.441-17849.313=0.128
max17850.470-17850.611=-0.141
mean8000.000
σ0.000
min8000.000
max8000.000
mean2773.000-2423.000=350.000
σ0.000
min2773.000-2423.000=350.000
max2773.000-2423.000=350.000
mean27.931-27.882=0.049
σ0.098-0.060=0.037
min27.817-27.796=0.021
max28.023-27.934=0.089