Compare commits

Home / Compare 7d916121 .. 0cb25bd9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.966-35.956=0.010
σ0.103-0.102=0.001
min35.923-35.905=0.018
max36.259-36.245=0.014
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.078-0.076=0.002
σ0.005-0.004=0.001
min0.074-0.074=0.001
max0.085-0.083=0.001
cache=y
dps=1
iters=10
policies=100
mean26.209-26.203=0.007
σ0.005-0.005=0.001
min26.202-26.193=0.010
max26.219-26.208=0.011
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.061-0.061=0.000
σ0.003-0.003=0.000
min0.059-0.059=0.000
max0.070-0.068=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.315-1756.305=0.010
σ0.368-0.368=-0.001
min1755.741-1755.729=0.012
max1756.909-1756.897=0.012
mean1658.100-1655.050=3.050
σ632.614-630.068=2.546
min612.000-619.000=-7.000
max2731.000-2674.000=57.000
mean2.375-2.370=0.004
σ0.135-0.079=0.056
min2.259-2.257=0.002
max2.823-2.561=0.262

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.844-278.824=0.020
σ0.010-0.007=0.003
min278.832-278.812=0.020
max278.857-278.831=0.025
mean2731.000-2674.000=57.000
σ0.000
min2731.000-2674.000=57.000
max2731.000-2674.000=57.000
mean0.409-0.412=-0.003
σ0.001-0.004=-0.003
min0.407-0.407=-0.000
max0.410-0.419=-0.009
iters=5
new-facts=1
prior-facts=6402
mean2268.900-2268.887=0.013
σ0.019-0.007=0.012
min2268.873-2268.878=-0.006
max2268.922-2268.893=0.028
mean2731.000-2674.000=57.000
σ0.000
min2731.000-2674.000=57.000
max2731.000-2674.000=57.000
mean3.207-2.946=0.261
σ0.168-0.092=0.076
min2.919-2.881=0.038
max3.352-3.105=0.247
iters=5
new-facts=6402
prior-facts=1
mean4954.042-4954.156=-0.114
σ1.057-0.594=0.463
min4953.240-4953.836=-0.596
max4955.826-4955.215=0.611
mean2731.000-2674.000=57.000
σ0.000
min2731.000-2674.000=57.000
max2731.000-2674.000=57.000
mean8.046-7.947=0.099
σ0.392-0.239=0.153
min7.794-7.708=0.086
max8.739-8.342=0.396
iters=5
new-facts=6402
prior-facts=6402
mean5168.748-5168.826=-0.078
σ0.210-0.092=0.118
min5168.403-5168.722=-0.319
max5168.935-5168.908=0.028
mean3365.400-3363.200=2.200
σ410.562-467.063=-56.502
min2965.000-2736.000=229.000
max3785.000-3969.000=-184.000
mean9.201-9.089=0.112
σ0.568-0.492=0.075
min8.540-8.412=0.127
max9.813-9.562=0.251

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.000-1.091=-0.091
σ0.067-0.265=-0.198
min0.943-0.933=0.009
max1.073-1.556=-0.483

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.358-459.818=0.540
σ572.652-571.583=1.068
min174.024-174.017=0.007
max1319.335-1317.193=2.142
mean79.500
σ7.000
min76.000
max90.000
mean2731.000-2674.000=57.000
σ0.000
min2731.000-2674.000=57.000
max2731.000-2674.000=57.000
mean0.552-0.533=0.018
σ0.556-0.532=0.024
min0.268-0.263=0.005
max1.386-1.332=0.054
policies=20
mean1740.490-1740.426=0.065
σ0.322-0.335=-0.013
min1740.295-1740.217=0.078
max1740.971-1740.926=0.045
mean760.000
σ0.000
min760.000
max760.000
mean2731.000-2674.000=57.000
σ0.000
min2731.000-2674.000=57.000
max2731.000-2674.000=57.000
mean2.691-2.700=-0.009
σ0.011-0.026=-0.015
min2.676-2.665=0.011
max2.702-2.728=-0.026
policies=200
mean17411.897-17411.276=0.621
σ0.536-0.461=0.075
min17411.546-17411.022=0.524
max17412.694-17411.967=0.727
mean7600.000
σ0.000
min7600.000
max7600.000
mean2731.000-2674.000=57.000
σ0.000
min2731.000-2674.000=57.000
max2731.000-2674.000=57.000
mean27.063-27.096=-0.034
σ0.075-0.125=-0.051
min26.997-27.001=-0.004
max27.170-27.281=-0.110