Compare commits

Home / Compare e380f5ba .. d6743edf

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.773-35.798=-5.026
σ0.048-0.107=-0.059
min30.744-35.753=-5.008
max30.907-36.100=-5.193
mean410.000-413.000=-3.000
σ0.000
min410.000-413.000=-3.000
max410.000-413.000=-3.000
mean0.079-0.073=0.005
σ0.003-0.004=-0.001
min0.076-0.069=0.007
max0.084-0.080=0.004
cache=y
dps=1
iters=10
policies=100
mean21.059-26.064=-5.005
σ0.003-0.004=-0.001
min21.056-26.060=-5.004
max21.064-26.072=-5.008
mean410.000-413.000=-3.000
σ0.000
min410.000-413.000=-3.000
max410.000-413.000=-3.000
mean0.064-0.059=0.004
σ0.002-0.003=-0.001
min0.062-0.056=0.006
max0.070-0.065=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.236-1755.924=-4.687
σ0.364-0.367=-0.003
min1750.671-1755.350=-4.679
max1751.826-1756.519=-4.692
mean1650.400-1662.000=-11.600
σ650.332-627.711=22.621
min616.000-670.000=-54.000
max2754.000-2657.000=97.000
mean2.862-2.804=0.058
σ0.086-0.143=-0.056
min2.690-2.480=0.210
max3.039-3.018=0.021

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.568-277.196=-1.628
σ0.004-0.006=-0.002
min275.563-277.191=-1.628
max275.575-277.206=-1.631
mean2754.000-2657.000=97.000
σ0.000
min2754.000-2657.000=97.000
max2754.000-2657.000=97.000
mean0.393-0.405=-0.012
σ0.010-0.010=0.000
min0.384-0.399=-0.015
max0.405-0.422=-0.017
iters=5
new-facts=1
prior-facts=6402
mean2168.099-2174.442=-6.343
σ0.010-0.016=-0.006
min2168.088-2174.428=-6.340
max2168.115-2174.469=-6.354
mean2754.000-2657.000=97.000
σ0.000
min2754.000-2657.000=97.000
max2754.000-2657.000=97.000
mean2.967-2.964=0.002
σ0.145-0.141=0.004
min2.775-2.753=0.021
max3.096-3.102=-0.005
iters=5
new-facts=6402
prior-facts=1
mean5047.945-5052.611=-4.666
σ0.878-1.054=-0.176
min5047.442-5051.988=-4.546
max5049.508-5054.484=-4.976
mean2754.000-2657.000=97.000
σ0.000
min2754.000-2657.000=97.000
max2754.000-2657.000=97.000
mean9.169-9.165=0.005
σ0.619-0.735=-0.117
min8.436-8.092=0.344
max10.059-10.161=-0.102
iters=5
new-facts=6402
prior-facts=6402
mean5179.055-5188.425=-9.369
σ0.094-0.092=0.002
min5178.973-5188.346=-9.374
max5179.159-5188.533=-9.374
mean3234.800-3222.400=12.400
σ366.324-387.524=-21.200
min2754.000-2686.000=68.000
max3708.000-3711.000=-3.000
mean10.037-8.966=1.071
σ0.078-0.424=-0.346
min9.969-8.716=1.253
max10.150-9.716=0.435

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.064-1.283=-0.219
σ0.125-0.434=-0.310
min0.953-0.942=0.012
max1.259-1.938=-0.679

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.207-464.857=-1.650
σ572.659-572.654=0.005
min176.872-178.529=-1.658
max1322.196-1323.838=-1.642
mean77.500-79.500=-2.000
σ7.000
min74.000-76.000=-2.000
max88.000-90.000=-2.000
mean2754.000-2657.000=97.000
σ0.000
min2754.000-2657.000=97.000
max2754.000-2657.000=97.000
mean0.539-0.558=-0.019
σ0.524-0.549=-0.025
min0.270-0.283=-0.013
max1.325-1.382=-0.058
policies=20
mean1768.963-1785.481=-16.518
σ0.332-0.348=-0.016
min1768.750-1785.252=-16.501
max1769.458-1785.997=-16.540
mean740.000-760.000=-20.000
σ0.000
min740.000-760.000=-20.000
max740.000-760.000=-20.000
mean2754.000-2657.000=97.000
σ0.000
min2754.000-2657.000=97.000
max2754.000-2657.000=97.000
mean2.739-2.782=-0.044
σ0.025-0.019=0.006
min2.704-2.765=-0.060
max2.766-2.805=-0.039
policies=200
mean17696.102-17861.444=-165.342
σ0.601-0.412=0.189
min17695.778-17861.132=-165.354
max17697.002-17862.048=-165.046
mean7400.000-7600.000=-200.000
σ0.000
min7400.000-7600.000=-200.000
max7400.000-7600.000=-200.000
mean2754.000-2657.000=97.000
σ0.000
min2754.000-2657.000=97.000
max2754.000-2657.000=97.000
mean27.704-28.127=-0.423
σ0.144-0.170=-0.025
min27.596-27.974=-0.378
max27.917-28.357=-0.440