Compare commits

Home / Compare 5d12b954 .. 3e3be302

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.695-70.696=-0.002
σ0.048-0.047=0.001
min70.667-70.668=-0.001
max70.830-70.829=0.001
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.159-0.160=-0.001
σ0.004-0.003=0.001
min0.152-0.157=-0.005
max0.164-0.165=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.420-21.420=0.000
σ0.003-0.003=-0.000
min21.417-21.415=0.002
max21.426-21.424=0.002
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.065-0.065=0.000
σ0.002-0.003=-0.000
min0.064-0.063=0.000
max0.072-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.457-1754.458=-0.002
σ0.363-0.361=0.003
min1753.884-1753.889=-0.005
max1755.038-1755.043=-0.005
mean1670.850-1657.250=13.600
σ650.547-638.178=12.369
min622.000-623.000=-1.000
max2868.000-2847.000=21.000
mean2.788-2.837=-0.048
σ0.129-0.147=-0.018
min2.560-2.356=0.204
max2.992-3.056=-0.063

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.903-273.529=-1.626
σ0.003-0.008=-0.004
min271.901-273.520=-1.619
max271.907-273.537=-1.630
mean2868.000-2847.000=21.000
σ0.000
min2868.000-2847.000=21.000
max2868.000-2847.000=21.000
mean0.374-0.385=-0.011
σ0.009-0.005=0.004
min0.369-0.381=-0.012
max0.391-0.394=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1932.292-1933.919=-1.628
σ0.009-0.009=0.000
min1932.277-1933.908=-1.631
max1932.299-1933.931=-1.632
mean2868.000-2847.000=21.000
σ0.000
min2868.000-2847.000=21.000
max2868.000-2847.000=21.000
mean2.990-2.949=0.040
σ0.130-0.109=0.020
min2.795-2.755=0.040
max3.156-3.012=0.145
iters=5
new-facts=6402
prior-facts=1
mean4752.997-4754.757=-1.760
σ0.908-0.789=0.119
min4752.147-4754.344=-2.197
max4754.549-4756.168=-1.619
mean2868.000-2847.000=21.000
σ0.000
min2868.000-2847.000=21.000
max2868.000-2847.000=21.000
mean8.136-8.012=0.124
σ0.352-0.293=0.059
min7.703-7.776=-0.073
max8.514-8.485=0.029
iters=5
new-facts=6402
prior-facts=6402
mean4943.518-4945.140=-1.621
σ0.011-0.014=-0.003
min4943.505-4945.120=-1.615
max4943.533-4945.156=-1.623
mean3063.400-3042.200=21.200
σ197.732-269.553=-71.821
min2868.000-2847.000=21.000
max3333.000-3456.000=-123.000
mean8.613-8.449=0.165
σ0.217-0.063=0.155
min8.414-8.396=0.019
max8.872-8.534=0.338

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.031-0.997=0.035
σ0.138-0.144=-0.006
min0.939-0.928=0.011
max1.261-1.254=0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.077-473.075=0.002
σ575.909-575.911=-0.002
min185.113-185.118=-0.004
max1336.940-1336.941=-0.001
mean88.250
σ8.500
min84.000
max101.000
mean2868.000-2847.000=21.000
σ0.000
min2868.000-2847.000=21.000
max2868.000-2847.000=21.000
mean0.459-0.477=-0.018
σ0.299-0.356=-0.057
min0.306-0.292=0.014
max0.908-1.011=-0.104
policies=20
mean1851.445-1851.428=0.018
σ0.382-0.368=0.014
min1851.167-1851.159=0.007
max1852.000-1851.964=0.035
mean840.000
σ0.000
min840.000
max840.000
mean2868.000-2847.000=21.000
σ0.000
min2868.000-2847.000=21.000
max2868.000-2847.000=21.000
mean2.955-2.960=-0.005
σ0.018-0.008=0.009
min2.934-2.953=-0.019
max2.972-2.972=0.000
policies=200
mean18519.761-18519.872=-0.112
σ0.893-0.674=0.218
min18519.033-18519.124=-0.091
max18520.891-18520.707=0.184
mean8400.000
σ0.000
min8400.000
max8400.000
mean2868.000-2847.000=21.000
σ0.000
min2868.000-2847.000=21.000
max2868.000-2847.000=21.000
mean29.109-29.313=-0.204
σ0.390-0.455=-0.065
min28.834-28.888=-0.054
max29.687-29.833=-0.146