Compare commits

Home / Compare 67c9cc57 .. afcb83d0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.956-35.956=-0.000
σ0.104-0.101=0.003
min35.913-35.909=0.004
max36.250-36.241=0.008
mean413.000-413.900=-0.900
σ0.000-0.316=-0.316
min413.000
max413.000-414.000=-1.000
mean0.076-0.077=-0.002
σ0.005-0.003=0.002
min0.070-0.075=-0.005
max0.083-0.084=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.204-26.203=0.001
σ0.004-0.005=-0.001
min26.198-26.195=0.003
max26.211-26.209=0.003
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.060-0.058=0.002
σ0.003-0.003=0.000
min0.057-0.057=0.001
max0.068-0.065=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.305-1756.303=0.002
σ0.369-0.367=0.001
min1755.729-1755.728=0.000
max1756.899-1756.897=0.003
mean1653.900-1658.500=-4.600
σ625.168-632.270=-7.102
min611.000-612.000=-1.000
max2696.000-2728.000=-32.000
mean2.369-2.370=-0.001
σ0.121-0.131=-0.010
min2.259-2.222=0.037
max2.746-2.783=-0.037

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.822-278.827=-0.005
σ0.006-0.004=0.002
min278.813-278.820=-0.008
max278.829-278.830=-0.002
mean2696.000-2728.000=-32.000
σ0.000
min2696.000-2728.000=-32.000
max2696.000-2728.000=-32.000
mean0.415-0.413=0.002
σ0.012-0.006=0.006
min0.407-0.407=0.000
max0.436-0.421=0.015
iters=5
new-facts=1
prior-facts=6402
mean2268.896-2268.889=0.007
σ0.013-0.011=0.002
min2268.881-2268.877=0.004
max2268.913-2268.904=0.009
mean2696.000-2728.000=-32.000
σ0.000
min2696.000-2728.000=-32.000
max2696.000-2728.000=-32.000
mean3.207-3.105=0.102
σ0.130-0.131=-0.000
min3.069-2.926=0.143
max3.359-3.274=0.086
iters=5
new-facts=6402
prior-facts=1
mean4954.063-4954.306=-0.243
σ1.154-0.943=0.211
min4952.789-4953.665=-0.875
max4955.941-4955.972=-0.032
mean2696.000-2728.000=-32.000
σ0.000
min2696.000-2728.000=-32.000
max2696.000-2728.000=-32.000
mean8.014-7.980=0.034
σ0.357-0.412=-0.054
min7.752-7.707=0.045
max8.603-8.707=-0.105
iters=5
new-facts=6402
prior-facts=6402
mean5168.821-5168.827=-0.006
σ0.089-0.086=0.003
min5168.721-5168.731=-0.010
max5168.888-5168.892=-0.004
mean3333.400-3366.800=-33.400
σ392.528-410.074=-17.546
min2943.000-2967.000=-24.000
max3728.000-3786.000=-58.000
mean9.238-9.306=-0.068
σ0.330-0.185=0.145
min8.949-9.064=-0.115
max9.700-9.505=0.195

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.035-1.005=0.030
σ0.135-0.063=0.072
min0.943-0.952=-0.008
max1.253-1.077=0.177

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean459.820-459.816=0.003
σ571.587-571.590=-0.003
min174.021-174.017=0.004
max1317.200-1317.202=-0.002
mean79.500
σ7.000
min76.000
max90.000
mean2696.000-2728.000=-32.000
σ0.000
min2696.000-2728.000=-32.000
max2696.000-2728.000=-32.000
mean0.547-0.548=-0.001
σ0.559-0.560=-0.001
min0.265-0.266=-0.001
max1.386-1.388=-0.002
policies=20
mean1740.425-1740.429=-0.005
σ0.318-0.318=0.001
min1740.219-1740.228=-0.010
max1740.899-1740.904=-0.005
mean760.000
σ0.000
min760.000
max760.000
mean2696.000-2728.000=-32.000
σ0.000
min2696.000-2728.000=-32.000
max2696.000-2728.000=-32.000
mean2.686-2.680=0.006
σ0.028-0.013=0.014
min2.669-2.666=0.002
max2.727-2.692=0.035
policies=200
mean17411.249-17411.279=-0.030
σ0.469-0.469=-0.000
min17410.984-17411.004=-0.020
max17411.951-17411.981=-0.030
mean7600.000
σ0.000
min7600.000
max7600.000
mean2696.000-2728.000=-32.000
σ0.000
min2696.000-2728.000=-32.000
max2696.000-2728.000=-32.000
mean26.962-27.041=-0.079
σ0.072-0.047=0.024
min26.873-26.988=-0.114
max27.032-27.099=-0.067