Compare commits

Home / Compare 8810bf22 .. 6abddff2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.708-53.709=-0.001
σ0.365-0.362=0.003
min53.576-53.573=0.002
max54.746-54.739=0.006
mean413.000-413.800=-0.800
σ0.000-0.422=-0.422
min413.000
max413.000-414.000=-1.000
mean0.136-0.137=-0.001
σ0.005-0.004=0.001
min0.129-0.131=-0.002
max0.143-0.144=-0.001
cache=y
dps=1
iters=10
policies=100
mean42.979
σ0.006-0.005=0.000
min42.967-42.972=-0.005
max42.988-42.988=-0.001
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.122-0.121=0.001
σ0.004-0.005=-0.001
min0.118-0.113=0.006
max0.128-0.128=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean995.223-995.223=0.000
σ1.183-1.174=0.009
min994.681-994.690=-0.009
max1000.187-1000.149=0.038
mean1062.200-1056.150=6.050
σ317.893-311.901=5.993
min606.000-593.000=13.000
max1626.000-1513.000=113.000
mean1.484-1.503=-0.019
σ0.084-0.163=-0.080
min1.371-1.340=0.031
max1.674-2.118=-0.445

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.319-297.318=0.002
σ0.007-0.004=0.003
min297.313-297.312=0.001
max297.327-297.323=0.004
mean1626.000-1513.000=113.000
σ0.000
min1626.000-1513.000=113.000
max1626.000-1513.000=113.000
mean0.384-0.386=-0.001
σ0.001-0.002=-0.001
min0.383-0.384=-0.001
max0.385-0.389=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1299.014-1298.999=0.014
σ0.097-0.094=0.003
min1298.841-1298.842=-0.001
max1299.068-1299.084=-0.016
mean1626.000-1513.000=113.000
σ0.000
min1626.000-1513.000=113.000
max1626.000-1513.000=113.000
mean2.029-2.029=-0.001
σ0.146-0.262=-0.116
min1.852-1.842=0.009
max2.175-2.488=-0.313
iters=5
new-facts=6402
prior-facts=1
mean1719.183-1719.186=-0.003
σ6.894-6.929=-0.035
min1716.002-1715.999=0.003
max1731.512-1731.578=-0.066
mean1626.000-1513.000=113.000
σ0.000
min1626.000-1513.000=113.000
max1626.000-1513.000=113.000
mean3.038-2.963=0.075
σ0.252-0.463=-0.211
min2.748-2.520=0.229
max3.400-3.749=-0.349
iters=5
new-facts=6402
prior-facts=6402
mean1981.927-1981.946=-0.019
σ0.013-0.005=0.007
min1981.914-1981.940=-0.026
max1981.947-1981.952=-0.005
mean1818.800-1780.000=38.800
σ210.423-200.407=10.016
min1626.000-1513.000=113.000
max2131.000-1963.000=168.000
mean3.289-3.138=0.152
σ0.235-0.112=0.123
min3.099-2.958=0.141
max3.698-3.251=0.447

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.253-1.526=-0.274
σ0.342-0.271=0.071
min0.910-1.188=-0.278
max1.799-1.782=0.017

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.465-440.450=0.015
σ573.037-573.028=0.009
min153.933-153.932=0.001
max1300.020-1299.992=0.028
mean94.250
σ8.500
min90.000
max107.000
mean1626.000-1513.000=113.000
σ0.000
min1626.000-1513.000=113.000
max1626.000-1513.000=113.000
mean0.561-0.535=0.026
σ0.605-0.534=0.071
min0.257-0.265=-0.008
max1.468-1.336=0.132
policies=20
mean1539.609-1539.589=0.020
σ0.302-0.299=0.003
min1539.416-1539.389=0.027
max1540.058-1540.034=0.024
mean900.000
σ0.000
min900.000
max900.000
mean1626.000-1513.000=113.000
σ0.000
min1626.000-1513.000=113.000
max1626.000-1513.000=113.000
mean2.564-2.562=0.002
σ0.015-0.010=0.004
min2.546-2.552=-0.006
max2.578-2.572=0.007
policies=200
mean15404.053-15404.005=0.048
σ0.060-0.260=-0.201
min15403.983-15403.619=0.364
max15404.129-15404.186=-0.056
mean9000.000
σ0.000
min9000.000
max9000.000
mean1626.000-1513.000=113.000
σ0.000
min1626.000-1513.000=113.000
max1626.000-1513.000=113.000
mean25.967-25.930=0.037
σ0.115-0.107=0.008
min25.831-25.831=-0.000
max26.107-26.034=0.073