Compare commits

Home / Compare ab33988b .. 6e62a9fa

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.768-30.771=-0.003
σ0.051-0.049=0.002
min30.744-30.748=-0.004
max30.913-30.909=0.003
mean413.000
σ0.000
min413.000
max413.000
mean0.080-0.079=0.001
σ0.004-0.003=0.001
min0.076-0.076=-0.000
max0.088-0.084=0.004
cache=y
dps=1
iters=10
policies=100
mean21.061-21.061=-0.000
σ0.003-0.003=0.000
min21.055-21.056=-0.002
max21.064-21.066=-0.002
mean413.000
σ0.000
min413.000
max413.000
mean0.064-0.061=0.003
σ0.003-0.004=-0.001
min0.062-0.057=0.005
max0.071-0.068=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.235-1751.238=-0.002
σ0.363-0.363=-0.000
min1750.663-1750.665=-0.003
max1751.823-1751.824=-0.000
mean1646.300-1653.150=-6.850
σ620.589-644.696=-24.107
min679.000-632.000=47.000
max2640.000-2856.000=-216.000
mean2.890-2.908=-0.017
σ0.101-0.111=-0.009
min2.718-2.726=-0.008
max3.100-3.254=-0.154

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.554-275.567=-0.013
σ0.022-0.007=0.015
min275.531-275.558=-0.027
max275.581-275.576=0.005
mean2640.000-2856.000=-216.000
σ0.000
min2640.000-2856.000=-216.000
max2640.000-2856.000=-216.000
mean0.407-0.405=0.002
σ0.011-0.010=0.001
min0.398-0.396=0.002
max0.420-0.418=0.002
iters=5
new-facts=1
prior-facts=6402
mean2168.096-2168.094=0.002
σ0.007-0.014=-0.007
min2168.088-2168.077=0.010
max2168.105-2168.114=-0.009
mean2640.000-2856.000=-216.000
σ0.000
min2640.000-2856.000=-216.000
max2640.000-2856.000=-216.000
mean2.947-2.945=0.002
σ0.126-0.135=-0.010
min2.762-2.792=-0.030
max3.062-3.118=-0.056
iters=5
new-facts=6402
prior-facts=1
mean5047.935-5047.904=0.031
σ0.888-0.911=-0.023
min5047.358-5047.403=-0.045
max5049.507-5049.525=-0.018
mean2640.000-2856.000=-216.000
σ0.000
min2640.000-2856.000=-216.000
max2640.000-2856.000=-216.000
mean8.749-9.034=-0.285
σ0.498-0.408=0.090
min8.097-8.378=-0.281
max9.420-9.464=-0.044
iters=5
new-facts=6402
prior-facts=6402
mean5178.984-5179.044=-0.060
σ0.204-0.078=0.126
min5178.654-5178.966=-0.312
max5179.154-5179.127=0.028
mean3212.000-3320.000=-108.000
σ350.840-365.580=-14.740
min2716.000-2856.000=-140.000
max3641.000-3675.000=-34.000
mean10.042-9.746=0.296
σ0.151-0.278=-0.127
min9.852-9.516=0.337
max10.253-10.214=0.039

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.190-1.088=0.102
σ0.214-0.107=0.106
min0.947-0.948=-0.001
max1.480-1.250=0.230

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.204-463.213=-0.009
σ572.662-572.658=0.004
min176.872-176.877=-0.005
max1322.197-1322.199=-0.002
mean77.500
σ7.000
min74.000
max88.000
mean2640.000-2856.000=-216.000
σ0.000
min2640.000-2856.000=-216.000
max2640.000-2856.000=-216.000
mean0.565-0.441=0.124
σ0.565-0.306=0.259
min0.278-0.285=-0.007
max1.412-0.900=0.512
policies=20
mean1768.972-1769.004=-0.033
σ0.332-0.330=0.003
min1768.759-1768.773=-0.014
max1769.467-1769.490=-0.023
mean740.000
σ0.000
min740.000
max740.000
mean2640.000-2856.000=-216.000
σ0.000
min2640.000-2856.000=-216.000
max2640.000-2856.000=-216.000
mean2.757-2.838=-0.081
σ0.015-0.013=0.003
min2.738-2.820=-0.082
max2.774-2.849=-0.076
policies=200
mean17696.253-17696.209=0.044
σ0.488-0.406=0.082
min17695.967-17695.860=0.107
max17696.984-17696.793=0.191
mean7400.000
σ0.000
min7400.000
max7400.000
mean2640.000-2856.000=-216.000
σ0.000
min2640.000-2856.000=-216.000
max2640.000-2856.000=-216.000
mean27.825-28.262=-0.437
σ0.154-0.449=-0.295
min27.740-27.737=0.003
max28.056-28.682=-0.626