Compare commits

Home / Compare b4dca2ea .. f82192eb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.979=0.000
σ0.049-0.050=-0.000
min33.953-33.951=0.002
max34.114-34.116=-0.002
mean413.000-411.000=2.000
σ0.000
min413.000-411.000=2.000
max413.000-411.000=2.000
mean0.086-0.083=0.003
σ0.004-0.003=0.000
min0.082-0.077=0.005
max0.092-0.090=0.002
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=0.000
σ0.002-0.002=-0.000
min23.314-23.313=0.001
max23.321-23.321=0.000
mean413.000-411.000=2.000
σ0.000
min413.000-411.000=2.000
max413.000-411.000=2.000
mean0.062-0.063=-0.002
σ0.003-0.004=-0.000
min0.059-0.060=-0.000
max0.070-0.070=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.428-1757.430=-0.001
σ0.364-0.365=-0.001
min1756.854-1756.855=-0.002
max1758.016-1758.018=-0.001
mean1659.650-1661.900=-2.250
σ620.789-627.530=-6.740
min668.000-667.000=1.000
max2587.000-2610.000=-23.000
mean2.373-2.370=0.003
σ0.119-0.112=0.007
min2.213-2.264=-0.050
max2.682-2.687=-0.005

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.580-326.578=0.003
σ0.026-0.034=-0.009
min326.535-326.518=0.017
max326.599-326.608=-0.010
mean2587.000-2610.000=-23.000
σ0.000
min2587.000-2610.000=-23.000
max2587.000-2610.000=-23.000
mean0.423-0.424=-0.001
σ0.002-0.003=-0.001
min0.420-0.422=-0.001
max0.426-0.430=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1988.744-1988.736=0.009
σ0.004-0.015=-0.011
min1988.739-1988.717=0.021
max1988.750-1988.752=-0.002
mean2587.000-2610.000=-23.000
σ0.000
min2587.000-2610.000=-23.000
max2587.000-2610.000=-23.000
mean2.752-2.676=0.075
σ0.182-0.124=0.059
min2.633-2.483=0.150
max3.073-2.798=0.275
iters=5
new-facts=6402
prior-facts=1
mean4813.413-4813.575=-0.162
σ7.825-7.743=0.082
min4809.660-4810.039=-0.379
max4827.405-4827.427=-0.021
mean2587.000-2610.000=-23.000
σ0.000
min2587.000-2610.000=-23.000
max2587.000-2610.000=-23.000
mean8.205-8.824=-0.619
σ0.580-0.264=0.317
min7.725-8.598=-0.873
max9.157-9.222=-0.064
iters=5
new-facts=6402
prior-facts=6402
mean5001.128-5001.073=0.055
σ0.023-0.170=-0.147
min5001.098-5000.769=0.329
max5001.155-5001.157=-0.002
mean2971.000-2995.200=-24.200
σ413.722-277.609=136.113
min2587.000-2610.000=-23.000
max3552.000-3305.000=247.000
mean9.599-9.840=-0.241
σ0.334-0.321=0.013
min9.198-9.482=-0.284
max9.943-10.335=-0.392

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.265-1.213=0.052
σ0.224-0.335=-0.111
min1.045-0.923=0.121
max1.505-1.632=-0.127

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.571-464.568=0.003
σ574.787-574.781=0.006
min177.170-177.172=-0.002
max1326.751-1326.739=0.012
mean88.250
σ8.500
min84.000
max101.000
mean2587.000-2610.000=-23.000
σ0.000
min2587.000-2610.000=-23.000
max2587.000-2610.000=-23.000
mean0.548-0.546=0.002
σ0.551-0.546=0.005
min0.270-0.271=-0.001
max1.375-1.365=0.010
policies=20
mean1772.041-1772.041=-0.001
σ0.359-0.358=0.001
min1771.795-1771.804=-0.009
max1772.574-1772.573=0.001
mean840.000
σ0.000
min840.000
max840.000
mean2587.000-2610.000=-23.000
σ0.000
min2587.000-2610.000=-23.000
max2587.000-2610.000=-23.000
mean2.725-2.728=-0.003
σ0.019-0.034=-0.016
min2.706-2.693=0.013
max2.743-2.765=-0.022
policies=200
mean17727.640-17727.481=0.159
σ0.490-0.602=-0.112
min17727.357-17727.123=0.234
max17728.373-17728.379=-0.006
mean8400.000
σ0.000
min8400.000
max8400.000
mean2587.000-2610.000=-23.000
σ0.000
min2587.000-2610.000=-23.000
max2587.000-2610.000=-23.000
mean27.491-27.503=-0.012
σ0.177-0.087=0.090
min27.320-27.408=-0.088
max27.656-27.618=0.038