Compare commits

Home / Compare e33dfac4 .. 0f4eb36a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.966-35.956=0.010
σ0.103-0.102=0.000
min35.922-35.908=0.014
max36.257-36.245=0.012
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.077-0.072=0.005
σ0.004-0.004=0.001
min0.074-0.069=0.005
max0.084-0.080=0.004
cache=y
dps=1
iters=10
policies=100
mean26.209-26.203=0.006
σ0.004-0.005=-0.001
min26.203-26.196=0.006
max26.217-26.212=0.005
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.060-0.061=-0.001
σ0.003-0.003=-0.000
min0.058-0.057=0.001
max0.067-0.068=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.315-1756.303=0.012
σ0.367-0.368=-0.002
min1755.740-1755.729=0.011
max1756.909-1756.896=0.013
mean1657.000-1657.350=-0.350
σ639.392-627.549=11.843
min609.000-613.000=-4.000
max2696.000-2706.000=-10.000
mean2.376-2.359=0.017
σ0.177-0.113=0.064
min2.249-2.181=0.068
max3.054-2.649=0.405

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.840-278.824=0.016
σ0.014-0.006=0.007
min278.819-278.816=0.002
max278.851-278.831=0.020
mean2696.000-2706.000=-10.000
σ0.000
min2696.000-2706.000=-10.000
max2696.000-2706.000=-10.000
mean0.415-0.411=0.003
σ0.005-0.004=0.001
min0.409-0.408=0.001
max0.419-0.419=-0.000
iters=5
new-facts=1
prior-facts=6402
mean2268.907-2102.918=165.989
σ0.010-371.127=-371.118
min2268.895-1439.025=829.870
max2268.918-2268.904=0.014
mean2696.000-2706.000=-10.000
σ0.000
min2696.000-2706.000=-10.000
max2696.000-2706.000=-10.000
mean3.013-2.839=0.174
σ0.190-0.490=-0.300
min2.877-2.002=0.875
max3.319-3.215=0.104
iters=5
new-facts=6402
prior-facts=1
mean4954.265-4954.182=0.082
σ0.872-0.680=0.192
min4953.854-4953.683=0.171
max4955.824-4955.375=0.449
mean2696.000-2706.000=-10.000
σ0.000
min2696.000-2706.000=-10.000
max2696.000-2706.000=-10.000
mean8.082-7.984=0.098
σ0.424-0.373=0.050
min7.688-7.726=-0.037
max8.711-8.643=0.068
iters=5
new-facts=6402
prior-facts=6402
mean5168.743-5168.817=-0.075
σ0.203-0.090=0.113
min5168.400-5168.719=-0.318
max5168.907-5168.886=0.021
mean3452.600-3300.800=151.800
σ472.128-464.223=7.905
min2861.000-2706.000=155.000
max4131.000-3748.000=383.000
mean9.280-9.053=0.227
σ0.224-0.144=0.080
min9.022-8.880=0.141
max9.588-9.258=0.330

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.157-1.030=0.127
σ0.390-0.137=0.253
min0.948-0.939=0.009
max1.850-1.253=0.596

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.361-460.346=0.015
σ572.651-572.646=0.006
min174.029-174.016=0.013
max1319.338-1319.314=0.023
mean79.500
σ7.000
min76.000
max90.000
mean2696.000-2706.000=-10.000
σ0.000
min2696.000-2706.000=-10.000
max2696.000-2706.000=-10.000
mean0.546-0.535=0.010
σ0.537-0.520=0.017
min0.272-0.269=0.002
max1.352-1.315=0.036
policies=20
mean1740.497-1740.435=0.062
σ0.317-0.315=0.002
min1740.292-1740.243=0.049
max1740.970-1740.906=0.064
mean760.000
σ0.000
min760.000
max760.000
mean2696.000-2706.000=-10.000
σ0.000
min2696.000-2706.000=-10.000
max2696.000-2706.000=-10.000
mean2.685-2.683=0.002
σ0.012-0.014=-0.002
min2.678-2.666=0.012
max2.703-2.694=0.009
policies=200
mean17411.932-17411.296=0.636
σ0.516-0.471=0.044
min17411.621-17411.054=0.567
max17412.703-17412.003=0.700
mean7600.000
σ0.000
min7600.000
max7600.000
mean2696.000-2706.000=-10.000
σ0.000
min2696.000-2706.000=-10.000
max2696.000-2706.000=-10.000
mean27.020-27.016=0.004
σ0.088-0.086=0.001
min26.918-26.922=-0.004
max27.098-27.131=-0.033