Compare commits

Home / Compare 567ef3bb .. 7b02b8f6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.793-35.795=-0.002
σ0.110-0.109=0.001
min35.740-35.742=-0.002
max36.102-36.102=0.001
mean412.000-412.300=-0.300
σ0.000-0.483=-0.483
min412.000
max412.000-413.000=-1.000
mean0.076-0.076=0.000
σ0.003-0.004=-0.000
min0.073-0.073=-0.000
max0.082-0.084=-0.002
cache=y
dps=1
iters=10
policies=100
mean26.064-26.066=-0.002
σ0.004-0.004=-0.001
min26.060-26.060=0.001
max26.072-26.076=-0.003
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.059-0.061=-0.002
σ0.003-0.003=0.000
min0.056-0.060=-0.004
max0.065-0.069=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1718.987-1757.000=-38.013
σ170.012-0.369=169.643
min996.686-1756.425=-759.739
max1757.587-1757.590=-0.003
mean1628.200-1660.900=-32.700
σ593.763-639.445=-45.683
min683.000-671.000=12.000
max2789.000-2705.000=84.000
mean2.762-2.885=-0.123
σ0.356-0.090=0.267
min1.448-2.669=-1.222
max3.100-3.031=0.069

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.285-278.285=-0.000
σ0.006-0.006=-0.000
min278.276-278.277=-0.001
max278.294-278.295=-0.001
mean2789.000-2705.000=84.000
σ0.000
min2789.000-2705.000=84.000
max2789.000-2705.000=84.000
mean0.408-0.409=-0.001
σ0.008-0.007=0.001
min0.402-0.403=-0.001
max0.423-0.419=0.003
iters=5
new-facts=1
prior-facts=6402
mean2175.503-2175.530=-0.026
σ0.017-0.011=0.006
min2175.490-2175.519=-0.029
max2175.531-2175.548=-0.017
mean2789.000-2705.000=84.000
σ0.000
min2789.000-2705.000=84.000
max2789.000-2705.000=84.000
mean2.952-3.000=-0.048
σ0.158-0.264=-0.106
min2.788-2.754=0.034
max3.207-3.415=-0.208
iters=5
new-facts=6402
prior-facts=1
mean5134.479-5134.579=-0.100
σ1.106-1.015=0.091
min5133.457-5134.024=-0.567
max5136.374-5136.388=-0.014
mean2789.000-2705.000=84.000
σ0.000
min2789.000-2705.000=84.000
max2789.000-2705.000=84.000
mean8.971-9.083=-0.111
σ0.484-0.408=0.076
min8.338-8.744=-0.406
max9.506-9.772=-0.266
iters=5
new-facts=6402
prior-facts=6402
mean5238.168-5238.308=-0.141
σ0.294-0.121=0.173
min5237.766-5238.132=-0.366
max5238.474-5238.474=0.000
mean3350.800-3257.400=93.400
σ440.999-476.461=-35.462
min2789.000-2705.000=84.000
max3777.000-3896.000=-119.000
mean9.012-8.881=0.132
σ0.108-0.138=-0.029
min8.849-8.734=0.115
max9.128-9.053=0.074

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.008-1.106=-0.097
σ0.144-0.118=0.026
min0.943-0.947=-0.004
max1.266-1.252=0.015

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.468-467.466=0.001
σ572.648-572.658=-0.010
min181.138-181.132=0.005
max1326.439-1326.453=-0.014
mean85.500
σ7.000
min82.000
max96.000
mean2789.000-2705.000=84.000
σ0.000
min2789.000-2705.000=84.000
max2789.000-2705.000=84.000
mean0.450-0.569=-0.119
σ0.306-0.552=-0.246
min0.293-0.285=0.008
max0.909-1.397=-0.488
policies=20
mean1811.704-1811.669=0.035
σ0.377-0.381=-0.004
min1811.441-1811.426=0.015
max1812.253-1812.232=0.021
mean820.000
σ0.000
min820.000
max820.000
mean2789.000-2705.000=84.000
σ0.000
min2789.000-2705.000=84.000
max2789.000-2705.000=84.000
mean2.950-2.867=0.083
σ0.015-0.014=0.001
min2.929-2.853=0.076
max2.963-2.886=0.077
policies=200
mean18123.546-18123.477=0.068
σ0.504-0.378=0.125
min18123.230-18123.255=-0.025
max18124.287-18124.044=0.244
mean8200.000
σ0.000
min8200.000
max8200.000
mean2789.000-2705.000=84.000
σ0.000
min2789.000-2705.000=84.000
max2789.000-2705.000=84.000
mean29.119-28.935=0.184
σ0.604-0.134=0.471
min28.645-28.819=-0.174
max30.003-29.088=0.915