Compare commits

Home / Compare 1773ed91 .. 9fff0569

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.914-53.913=0.002
σ0.367-0.367=-0.000
min53.783-53.780=0.003
max54.958-54.958=0.001
mean418.000-415.800=2.200
σ0.000-0.422=-0.422
min418.000-415.000=3.000
max418.000-416.000=2.000
mean0.140-0.136=0.003
σ0.005-0.005=0.000
min0.134-0.128=0.006
max0.147-0.143=0.004
cache=y
dps=1
iters=10
policies=100
mean43.143-43.140=0.003
σ0.005-0.006=-0.001
min43.137-43.130=0.007
max43.151-43.152=-0.001
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.123-0.121=0.002
σ0.008-0.004=0.004
min0.118-0.118=0.000
max0.138-0.128=0.010

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.821-991.819=0.001
σ1.240-1.232=0.009
min991.232-991.227=0.005
max997.026-996.985=0.041
mean1074.900-1067.200=7.700
σ318.158-322.771=-4.613
min619.000-569.000=50.000
max1639.000-1637.000=2.000
mean1.529-1.527=0.002
σ0.071-0.069=0.002
min1.459-1.448=0.011
max1.721-1.678=0.042

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.410-285.412=-0.002
σ0.010-0.012=-0.002
min285.393-285.392=0.001
max285.419-285.422=-0.003
mean1639.000-1637.000=2.000
σ0.000
min1639.000-1637.000=2.000
max1639.000-1637.000=2.000
mean0.379-0.382=-0.003
σ0.006-0.008=-0.002
min0.375-0.375=-0.000
max0.389-0.390=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1285.377-1285.369=0.008
σ0.130-0.127=0.003
min1285.312-1285.307=0.005
max1285.609-1285.596=0.014
mean1639.000-1637.000=2.000
σ0.000
min1639.000-1637.000=2.000
max1639.000-1637.000=2.000
mean1.916-1.852=0.064
σ0.068-0.028=0.039
min1.858-1.824=0.034
max2.017-1.891=0.126
iters=5
new-facts=6402
prior-facts=1
mean1807.686-1807.682=0.003
σ7.028-7.002=0.026
min1804.319-1804.326=-0.007
max1820.244-1820.194=0.050
mean1639.000-1637.000=2.000
σ0.000
min1639.000-1637.000=2.000
max1639.000-1637.000=2.000
mean4.091-4.102=-0.011
σ0.217-0.208=0.009
min3.878-3.862=0.016
max4.434-4.413=0.021
iters=5
new-facts=6402
prior-facts=6402
mean2070.195-2070.194=0.001
σ0.010-0.007=0.003
min2070.184-2070.181=0.003
max2070.212-2070.199=0.013
mean1844.400-1861.600=-17.200
σ190.071-200.825=-10.755
min1639.000-1637.000=2.000
max2087.000-2093.000=-6.000
mean4.493-4.556=-0.064
σ0.046-0.111=-0.066
min4.442-4.441=0.001
max4.550-4.707=-0.157

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.200-1.236=-0.036
σ0.346-0.327=0.018
min0.909-0.915=-0.006
max1.755-1.770=-0.015

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.785-436.788=-0.003
σ572.359-572.360=-0.000
min150.597-150.600=-0.003
max1295.324-1295.328=-0.004
mean90.250
σ8.500
min86.000
max103.000
mean1639.000-1637.000=2.000
σ0.000
min1639.000-1637.000=2.000
max1639.000-1637.000=2.000
mean0.537-0.522=0.014
σ0.574-0.540=0.034
min0.247-0.250=-0.003
max1.398-1.333=0.066
policies=20
mean1506.269-1506.265=0.004
σ0.234-0.243=-0.009
min1506.116-1506.118=-0.002
max1506.618-1506.628=-0.010
mean860.000
σ0.000
min860.000
max860.000
mean1639.000-1637.000=2.000
σ0.000
min1639.000-1637.000=2.000
max1639.000-1637.000=2.000
mean2.515-2.530=-0.015
σ0.017-0.004=0.013
min2.491-2.525=-0.033
max2.530-2.535=-0.004
policies=200
mean15070.300-15070.317=-0.016
σ0.132-0.096=0.035
min15070.177-15070.200=-0.024
max15070.486-15070.418=0.068
mean8600.000
σ0.000
min8600.000
max8600.000
mean1639.000-1637.000=2.000
σ0.000
min1639.000-1637.000=2.000
max1639.000-1637.000=2.000
mean25.608-25.472=0.136
σ0.239-0.134=0.104
min25.325-25.340=-0.014
max25.902-25.590=0.313