Compare commits

Home / Compare 0ace5a80 .. efc50168

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.390-70.391=-0.001
σ0.048-0.049=-0.001
min70.363-70.363=0.000
max70.522-70.527=-0.005
mean413.000
σ0.000
min413.000
max413.000
mean0.152-0.161=-0.009
σ0.004-0.003=0.002
min0.148-0.158=-0.010
max0.160-0.166=-0.006
cache=y
dps=1
iters=10
policies=100
mean21.145-21.145=0.000
σ0.003-0.003=0.000
min21.140-21.140=0.000
max21.150-21.148=0.002
mean413.000
σ0.000
min413.000
max413.000
mean0.063-0.062=0.001
σ0.003-0.004=-0.001
min0.058-0.057=0.000
max0.067-0.069=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.393-1752.396=-0.003
σ0.358-0.363=-0.005
min1751.827-1751.824=0.003
max1752.977-1752.998=-0.020
mean1654.850-1655.300=-0.450
σ616.332-618.262=-1.930
min636.000-635.000=1.000
max2491.000
mean2.793-2.818=-0.026
σ0.156-0.177=-0.021
min2.426-2.200=0.226
max2.969-3.005=-0.036

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.236-270.240=-0.004
σ0.003-0.004=-0.001
min270.233-270.233=0.000
max270.241-270.244=-0.003
mean2491.000
σ0.000
min2491.000
max2491.000
mean0.380-0.382=-0.002
σ0.002-0.007=-0.006
min0.378-0.377=0.002
max0.383-0.393=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1930.699-1930.699=0.000
σ0.012-0.011=0.001
min1930.683-1930.687=-0.004
max1930.715-1930.712=0.003
mean2491.000
σ0.000
min2491.000
max2491.000
mean2.484-2.483=0.001
σ0.106-0.072=0.034
min2.322-2.413=-0.091
max2.586-2.567=0.019
iters=5
new-facts=6402
prior-facts=1
mean4751.300-4751.363=-0.063
σ1.035-0.950=0.085
min4750.501-4750.874=-0.373
max4753.108-4753.060=0.048
mean2491.000
σ0.000
min2491.000
max2491.000
mean8.574-8.745=-0.171
σ0.601-0.350=0.251
min7.911-8.242=-0.331
max9.243-9.097=0.146
iters=5
new-facts=6402
prior-facts=6402
mean4941.725-4941.867=-0.142
σ0.301-0.011=0.290
min4941.188-4941.854=-0.666
max4941.880-4941.879=0.001
mean2968.200-3017.800=-49.600
σ422.854-312.344=110.510
min2491.000-2598.000=-107.000
max3540.000-3414.000=126.000
mean8.464-8.504=-0.040
σ0.115-0.086=0.030
min8.331-8.400=-0.069
max8.643-8.610=0.033

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.763-1.712=0.051
σ0.194-0.143=0.051
min1.465-1.469=-0.004
max1.916-1.819=0.096

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.363-466.364=-0.002
σ575.917-575.920=-0.003
min178.403-178.402=0.001
max1330.237-1330.244=-0.006
mean84.000
σ8.000
min80.000
max96.000
mean2491.000
σ0.000
min2491.000
max2491.000
mean0.538-0.531=0.008
σ0.515-0.492=0.023
min0.281-0.282=-0.001
max1.311-1.269=0.042
policies=20
mean1784.299-1784.321=-0.022
σ0.349-0.352=-0.003
min1784.076-1784.100=-0.023
max1784.819-1784.846=-0.027
mean800.000
σ0.000
min800.000
max800.000
mean2491.000
σ0.000
min2491.000
max2491.000
mean2.787-2.780=0.007
σ0.008-0.012=-0.004
min2.777-2.769=0.008
max2.796-2.796=-0.000
policies=200
mean17849.760-17849.895=-0.135
σ0.376-0.447=-0.071
min17849.489-17849.635=-0.146
max17850.315-17850.565=-0.250
mean8000.000
σ0.000
min8000.000
max8000.000
mean2491.000
σ0.000
min2491.000
max2491.000
mean27.952-27.896=0.056
σ0.031-0.042=-0.010
min27.914-27.855=0.060
max27.981-27.946=0.035