Compare commits

Home / Compare adf8e50a .. 629da0da

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.731-70.694=0.036
σ0.048-0.042=0.006
min70.703-70.673=0.031
max70.867-70.812=0.055
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.160-0.156=0.004
σ0.003-0.006=-0.003
min0.156-0.151=0.005
max0.166-0.168=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.448-21.424=0.024
σ0.011-0.009=0.002
min21.442-21.417=0.025
max21.480-21.450=0.030
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.065-0.065=0.000
σ0.003-0.003=-0.000
min0.063-0.060=0.003
max0.072-0.073=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.528-1754.458=0.070
σ0.363-0.362=0.001
min1753.955-1753.888=0.067
max1755.112-1755.057=0.055
mean1656.350-1671.900=-15.550
σ638.585-628.543=10.042
min638.000-680.000=-42.000
max2835.000-2666.000=169.000
mean2.850-2.780=0.070
σ0.132-0.224=-0.091
min2.611-2.258=0.352
max3.149-3.082=0.067

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.612-273.499=0.112
σ0.005-0.006=-0.001
min273.605-273.491=0.114
max273.618-273.506=0.113
mean2835.000-2666.000=169.000
σ0.000
min2835.000-2666.000=169.000
max2835.000-2666.000=169.000
mean0.388-0.375=0.013
σ0.007-0.004=0.003
min0.384-0.372=0.012
max0.400-0.382=0.018
iters=5
new-facts=1
prior-facts=6402
mean1934.003-1933.902=0.101
σ0.007-0.016=-0.009
min1933.995-1933.886=0.108
max1934.013-1933.927=0.086
mean2835.000-2666.000=169.000
σ0.000
min2835.000-2666.000=169.000
max2835.000-2666.000=169.000
mean3.039-2.980=0.059
σ0.132-0.148=-0.016
min2.915-2.813=0.102
max3.186-3.136=0.050
iters=5
new-facts=6402
prior-facts=1
mean4754.678-4754.671=0.006
σ0.926-0.822=0.104
min4753.851-4754.136=-0.285
max4756.271-4756.129=0.142
mean2835.000-2666.000=169.000
σ0.000
min2835.000-2666.000=169.000
max2835.000-2666.000=169.000
mean8.323-8.446=-0.123
σ0.424-0.536=-0.111
min7.725-7.618=0.107
max8.857-9.111=-0.254
iters=5
new-facts=6402
prior-facts=6402
mean4945.225-4945.052=0.173
σ0.022-0.150=-0.129
min4945.203-4944.784=0.418
max4945.260-4945.142=0.118
mean3074.800-3050.600=24.200
σ229.769-304.327=-74.558
min2835.000-2666.000=169.000
max3378.000-3340.000=38.000
mean8.731-8.701=0.031
σ0.334-0.235=0.098
min8.375-8.402=-0.027
max9.214-9.032=0.183

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.007-1.092=-0.085
σ0.147-0.232=-0.085
min0.935-0.925=0.011
max1.270-1.425=-0.155

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.844-473.060=-0.217
σ574.925-575.917=-0.992
min185.371-185.090=0.281
max1335.231-1336.936=-1.704
mean88.250
σ8.500
min84.000
max101.000
mean2835.000-2666.000=169.000
σ0.000
min2835.000-2666.000=169.000
max2835.000-2666.000=169.000
mean0.436-0.564=-0.128
σ0.280-0.530=-0.250
min0.295-0.295=-0.000
max0.856-1.359=-0.503
policies=20
mean1854.019-1851.243=2.776
σ0.357-0.372=-0.015
min1853.754-1850.985=2.769
max1854.536-1851.790=2.746
mean840.000
σ0.000
min840.000
max840.000
mean2835.000-2666.000=169.000
σ0.000
min2835.000-2666.000=169.000
max2835.000-2666.000=169.000
mean2.956-2.879=0.077
σ0.004-0.027=-0.023
min2.951-2.854=0.097
max2.960-2.904=0.056
policies=200
mean18546.522-18519.344=27.179
σ0.296-0.434=-0.138
min18546.276-18519.055=27.221
max18546.938-18519.984=26.955
mean8400.000
σ0.000
min8400.000
max8400.000
mean2835.000-2666.000=169.000
σ0.000
min2835.000-2666.000=169.000
max2835.000-2666.000=169.000
mean29.261-28.886=0.375
σ0.432-0.112=0.320
min28.810-28.752=0.058
max29.777-29.019=0.758