Compare commits

Home / Compare 7f21a274 .. db8141fa

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.798-35.792=0.006
σ0.106-0.107=-0.000
min35.754-35.747=0.007
max36.099-36.095=0.004
mean410.000-412.000=-2.000
σ0.000
min410.000-412.000=-2.000
max410.000-412.000=-2.000
mean0.073-0.074=-0.001
σ0.003-0.004=-0.001
min0.069-0.070=-0.001
max0.077-0.082=-0.005
cache=y
dps=1
iters=10
policies=100
mean26.066-26.065=0.001
σ0.003-0.003=0.000
min26.062-26.060=0.002
max26.071-26.069=0.002
mean410.600-412.000=-1.400
σ0.516-0.000=0.516
min410.000-412.000=-2.000
max411.000-412.000=-1.000
mean0.061-0.059=0.001
σ0.003-0.003=-0.000
min0.059-0.057=0.002
max0.069-0.066=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.236-1752.886=-1.650
σ0.361-0.368=-0.006
min1750.670-1752.319=-1.649
max1751.803-1753.473=-1.671
mean1651.550-1656.750=-5.200
σ643.493-631.441=12.052
min624.000-665.000=-41.000
max2844.000-2611.000=233.000
mean2.810-2.850=-0.040
σ0.147-0.127=0.020
min2.462-2.596=-0.134
max3.012-3.112=-0.100

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.568-277.190=-1.621
σ0.007-0.008=-0.001
min275.557-277.179=-1.622
max275.575-277.199=-1.624
mean2844.000-2611.000=233.000
σ0.000
min2844.000-2611.000=233.000
max2844.000-2611.000=233.000
mean0.404-0.394=0.011
σ0.007-0.006=0.001
min0.397-0.386=0.011
max0.411-0.403=0.007
iters=5
new-facts=1
prior-facts=6402
mean2168.101-2169.696=-1.595
σ0.010-0.027=-0.017
min2168.089-2169.667=-1.578
max2168.113-2169.740=-1.628
mean2844.000-2611.000=233.000
σ0.000
min2844.000-2611.000=233.000
max2844.000-2611.000=233.000
mean3.050-2.830=0.220
σ0.172-0.182=-0.010
min2.811-2.699=0.111
max3.223-3.151=0.072
iters=5
new-facts=6402
prior-facts=1
mean5047.888-5049.563=-1.675
σ0.878-0.952=-0.074
min5047.414-5049.018=-1.604
max5049.450-5051.261=-1.810
mean2844.000-2611.000=233.000
σ0.000
min2844.000-2611.000=233.000
max2844.000-2611.000=233.000
mean8.830-8.877=-0.048
σ0.374-0.541=-0.167
min8.214-8.057=0.157
max9.122-9.375=-0.253
iters=5
new-facts=6402
prior-facts=6402
mean5178.908-5180.518=-1.609
σ0.263-0.266=-0.002
min5178.625-5180.234=-1.609
max5179.149-5180.765=-1.616
mean3250.600-3188.000=62.600
σ328.141-476.129=-147.987
min2844.000-2611.000=233.000
max3695.000-3820.000=-125.000
mean9.855-8.797=1.058
σ0.323-0.300=0.024
min9.463-8.625=0.838
max10.222-9.330=0.891

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.076-1.313=-0.236
σ0.109-0.248=-0.139
min0.944-1.079=-0.135
max1.249-1.667=-0.417

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.205-464.854=-1.649
σ572.653-572.660=-0.007
min176.873-178.521=-1.648
max1322.184-1323.844=-1.660
mean77.500-79.500=-2.000
σ7.000
min74.000-76.000=-2.000
max88.000-90.000=-2.000
mean2844.000-2611.000=233.000
σ0.000
min2844.000-2611.000=233.000
max2844.000-2611.000=233.000
mean0.435-0.560=-0.125
σ0.304-0.547=-0.243
min0.282-0.278=0.003
max0.891-1.380=-0.489
policies=20
mean1769.005-1785.464=-16.459
σ0.331-0.354=-0.023
min1768.773-1785.232=-16.459
max1769.494-1785.990=-16.497
mean740.000-760.000=-20.000
σ0.000
min740.000-760.000=-20.000
max740.000-760.000=-20.000
mean2844.000-2611.000=233.000
σ0.000
min2844.000-2611.000=233.000
max2844.000-2611.000=233.000
mean2.824-2.790=0.034
σ0.009-0.016=-0.007
min2.811-2.775=0.036
max2.831-2.812=0.018
policies=200
mean17696.164-17861.531=-165.368
σ0.533-0.543=-0.010
min17695.728-17861.188=-165.460
max17696.910-17862.339=-165.430
mean7400.000-7600.000=-200.000
σ0.000
min7400.000-7600.000=-200.000
max7400.000-7600.000=-200.000
mean2844.000-2611.000=233.000
σ0.000
min2844.000-2611.000=233.000
max2844.000-2611.000=233.000
mean28.069-28.271=-0.203
σ0.545-0.166=0.379
min27.509-28.121=-0.612
max28.609-28.424=0.185