Compare commits

Home / Compare b567eaa3 .. 6e77321c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.390-70.388=0.002
σ0.049-0.046=0.003
min70.361-70.360=0.002
max70.527-70.517=0.011
mean417.000-412.800=4.200
σ0.000-0.422=-0.422
min417.000-412.000=5.000
max417.000-413.000=4.000
mean0.159-0.156=0.003
σ0.003-0.004=-0.002
min0.156-0.150=0.005
max0.164-0.162=0.001
cache=y
dps=1
iters=10
policies=100
mean21.146-21.145=0.001
σ0.003-0.003=-0.000
min21.141-21.140=0.001
max21.150-21.150=-0.001
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.066-0.065=0.002
σ0.003-0.002=0.000
min0.065-0.063=0.002
max0.073-0.070=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.394-1752.395=-0.000
σ0.360-0.363=-0.004
min1751.827-1751.829=-0.002
max1752.977-1752.979=-0.002
mean1664.800-1653.800=11.000
σ624.670-643.314=-18.645
min638.000-624.000=14.000
max2517.000-2776.000=-259.000
mean2.766-2.771=-0.005
σ0.184-0.206=-0.021
min2.324-2.326=-0.002
max2.949-3.121=-0.172

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.138-270.142=-0.004
σ0.007-0.004=0.002
min270.130-270.138=-0.009
max270.146-270.149=-0.004
mean2517.000-2776.000=-259.000
σ0.000
min2517.000-2776.000=-259.000
max2517.000-2776.000=-259.000
mean0.379-0.379=0.000
σ0.006-0.007=-0.000
min0.375-0.372=0.003
max0.390-0.390=0.000
iters=5
new-facts=1
prior-facts=6402
mean1930.605-1930.607=-0.002
σ0.006-0.005=0.001
min1930.600-1930.598=0.002
max1930.614-1930.612=0.002
mean2517.000-2776.000=-259.000
σ0.000
min2517.000-2776.000=-259.000
max2517.000-2776.000=-259.000
mean2.513-2.534=-0.021
σ0.092-0.118=-0.026
min2.444-2.433=0.010
max2.673-2.727=-0.055
iters=5
new-facts=6402
prior-facts=1
mean4750.954-4751.265=-0.311
σ1.121-0.614=0.507
min4750.217-4750.797=-0.580
max4752.907-4752.344=0.562
mean2517.000-2776.000=-259.000
σ0.000
min2517.000-2776.000=-259.000
max2517.000-2776.000=-259.000
mean8.677-8.052=0.625
σ0.650-0.548=0.102
min7.603-7.678=-0.074
max9.163-9.007=0.156
iters=5
new-facts=6402
prior-facts=6402
mean4941.773-4941.697=0.076
σ0.013-0.164=-0.151
min4941.760-4941.407=0.353
max4941.794-4941.794=-0.000
mean2980.600-3059.400=-78.800
σ290.380-343.024=-52.645
min2593.000-2776.000=-183.000
max3330.000-3570.000=-240.000
mean8.513-8.403=0.111
σ0.158-0.226=-0.068
min8.359-8.217=0.143
max8.729-8.796=-0.067

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.685-1.017=0.668
σ0.161-0.139=0.022
min1.398-0.923=0.475
max1.786-1.247=0.539

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.370-466.374=-0.004
σ575.927-575.927=0.000
min178.403-178.403=0.001
max1330.260-1330.264=-0.004
mean84.000
σ8.000
min80.000
max96.000
mean2517.000-2776.000=-259.000
σ0.000
min2517.000-2776.000=-259.000
max2517.000-2776.000=-259.000
mean0.553-0.440=0.114
σ0.546-0.303=0.243
min0.278-0.287=-0.009
max1.372-0.894=0.479
policies=20
mean1784.318-1784.349=-0.031
σ0.350-0.341=0.008
min1784.095-1784.101=-0.006
max1784.839-1784.846=-0.007
mean800.000
σ0.000
min800.000
max800.000
mean2517.000-2776.000=-259.000
σ0.000
min2517.000-2776.000=-259.000
max2517.000-2776.000=-259.000
mean2.759-2.852=-0.093
σ0.011-0.088=-0.077
min2.751-2.753=-0.002
max2.775-2.967=-0.192
policies=200
mean17849.851-17849.764=0.088
σ0.366-0.487=-0.121
min17849.605-17849.388=0.217
max17850.393-17850.469=-0.076
mean8000.000
σ0.000
min8000.000
max8000.000
mean2517.000-2776.000=-259.000
σ0.000
min2517.000-2776.000=-259.000
max2517.000-2776.000=-259.000
mean27.818-27.893=-0.075
σ0.137-0.153=-0.016
min27.705-27.733=-0.028
max28.016-28.056=-0.040