Compare commits

Home / Compare de2955be .. 283e10d9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.379-70.378=0.001
σ0.048-0.046=0.002
min70.353-70.350=0.003
max70.513-70.507=0.006
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.153-0.154=-0.001
σ0.004-0.004=-0.000
min0.149-0.150=-0.001
max0.159-0.160=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.144-21.144=-0.000
σ0.002-0.002=0.000
min21.141-21.141=0.000
max21.147-21.147=0.001
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.063-0.065=-0.002
σ0.003-0.002=0.001
min0.058-0.064=-0.006
max0.067-0.070=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.386-1752.387=-0.001
σ0.362-0.361=0.001
min1751.818-1751.817=0.002
max1752.980-1752.964=0.016
mean1631.400-1633.600=-2.200
σ622.595-602.339=20.256
min622.000-669.000=-47.000
max2767.000-2456.000=311.000
mean2.784-2.794=-0.010
σ0.205-0.163=0.042
min2.263-2.373=-0.109
max3.054-3.044=0.010

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.106-270.131=-0.025
σ0.007-0.005=0.002
min270.095-270.125=-0.029
max270.114-270.137=-0.023
mean2767.000-2456.000=311.000
σ0.000
min2767.000-2456.000=311.000
max2767.000-2456.000=311.000
mean0.382-0.378=0.004
σ0.005-0.007=-0.002
min0.377-0.373=0.004
max0.390-0.390=0.000
iters=5
new-facts=1
prior-facts=6402
mean1930.594-1930.597=-0.002
σ0.016-0.009=0.007
min1930.577-1930.585=-0.007
max1930.616-1930.606=0.009
mean2767.000-2456.000=311.000
σ0.000
min2767.000-2456.000=311.000
max2767.000-2456.000=311.000
mean2.634-2.589=0.045
σ0.133-0.135=-0.003
min2.464-2.465=-0.002
max2.823-2.764=0.059
iters=5
new-facts=6402
prior-facts=1
mean4750.952-4751.131=-0.179
σ0.627-0.803=-0.176
min4750.580-4750.666=-0.086
max4752.067-4752.558=-0.491
mean2767.000-2456.000=311.000
σ0.000
min2767.000-2456.000=311.000
max2767.000-2456.000=311.000
mean8.705-8.127=0.579
σ0.383-0.417=-0.033
min8.068-7.704=0.364
max9.035-8.685=0.350
iters=5
new-facts=6402
prior-facts=6402
mean4941.527-4941.527=0.000
σ0.094-0.081=0.013
min4941.445-4941.453=-0.008
max4941.636-4941.623=0.013
mean3025.400-2939.400=86.000
σ304.155-428.404=-124.249
min2767.000-2456.000=311.000
max3472.000-3511.000=-39.000
mean8.568-8.418=0.150
σ0.069-0.151=-0.082
min8.517-8.306=0.211
max8.682-8.673=0.009

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.016-1.799=-0.783
σ0.140-0.048=0.092
min0.926-1.726=-0.800
max1.247-1.846=-0.599

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.374-466.353=0.022
σ575.955-575.922=0.033
min178.384-178.389=-0.006
max1330.307-1330.235=0.072
mean84.000
σ8.000
min80.000
max96.000
mean2767.000-2456.000=311.000
σ0.000
min2767.000-2456.000=311.000
max2767.000-2456.000=311.000
mean0.538-0.566=-0.028
σ0.503-0.567=-0.064
min0.282-0.282=-0.000
max1.293-1.417=-0.125
policies=20
mean1784.200-1784.213=-0.013
σ0.349-0.365=-0.015
min1783.965-1783.976=-0.011
max1784.719-1784.755=-0.037
mean800.000
σ0.000
min800.000
max800.000
mean2767.000-2456.000=311.000
σ0.000
min2767.000-2456.000=311.000
max2767.000-2456.000=311.000
mean2.748-2.780=-0.032
σ0.028-0.027=0.001
min2.708-2.740=-0.031
max2.775-2.798=-0.023
policies=200
mean17848.743-17848.932=-0.188
σ0.605-0.458=0.147
min17848.387-17848.635=-0.248
max17849.648-17849.615=0.033
mean8000.000
σ0.000
min8000.000
max8000.000
mean2767.000-2456.000=311.000
σ0.000
min2767.000-2456.000=311.000
max2767.000-2456.000=311.000
mean27.894-27.946=-0.052
σ0.146-0.104=0.041
min27.783-27.806=-0.023
max28.104-28.058=0.047