Compare commits

Home / Compare 66d4f504 .. 9670f421

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.039-31.039=-0.000
σ0.050-0.050=0.000
min30.999-31.003=-0.003
max31.178-31.177=0.000
mean413.000-414.900=-1.900
σ0.000-0.316=-0.316
min413.000-414.000=-1.000
max413.000-415.000=-2.000
mean0.076-0.077=-0.000
σ0.005-0.005=0.001
min0.072-0.070=0.002
max0.088-0.085=0.003
cache=y
dps=1
iters=10
policies=100
mean21.143-21.142=0.001
σ0.002-0.002=0.000
min21.140-21.140=0.000
max21.148-21.147=0.001
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.063-0.064=-0.001
σ0.004-0.002=0.001
min0.058-0.062=-0.004
max0.070-0.071=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.412-1751.409=0.003
σ0.363-0.361=0.002
min1750.835-1750.841=-0.006
max1752.005-1751.975=0.030
mean1650.400-1653.700=-3.300
σ643.363-642.489=0.875
min631.000-633.000=-2.000
max2857.000-2850.000=7.000
mean2.748-2.782=-0.033
σ0.180-0.136=0.043
min2.144-2.510=-0.366
max2.946-2.994=-0.047

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.763-266.783=-0.019
σ0.017-0.009=0.008
min266.749-266.773=-0.024
max266.793-266.795=-0.002
mean2857.000-2850.000=7.000
σ0.000
min2857.000-2850.000=7.000
max2857.000-2850.000=7.000
mean0.365-0.367=-0.002
σ0.001-0.003=-0.001
min0.363-0.365=-0.002
max0.366-0.371=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1927.216-1927.209=0.007
σ0.010-0.007=0.003
min1927.202-1927.202=-0.000
max1927.230-1927.218=0.012
mean2857.000-2850.000=7.000
σ0.000
min2857.000-2850.000=7.000
max2857.000-2850.000=7.000
mean2.999-3.000=-0.001
σ0.096-0.092=0.005
min2.876-2.935=-0.059
max3.114-3.159=-0.045
iters=5
new-facts=6402
prior-facts=1
mean4747.728-4747.738=-0.010
σ0.782-0.777=0.005
min4747.343-4747.370=-0.026
max4749.125-4749.127=-0.002
mean2857.000-2850.000=7.000
σ0.000
min2857.000-2850.000=7.000
max2857.000-2850.000=7.000
mean8.240-8.345=-0.106
σ0.620-0.519=0.101
min7.675-7.694=-0.019
max9.011-8.907=0.104
iters=5
new-facts=6402
prior-facts=6402
mean4938.170-4938.096=0.074
σ0.091-0.211=-0.121
min4938.086-4937.750=0.336
max4938.272-4938.273=-0.000
mean3088.400-3074.400=14.000
σ310.236-236.192=74.044
min2857.000-2850.000=7.000
max3572.000-3416.000=156.000
mean8.517-8.516=0.001
σ0.279-0.224=0.055
min8.285-8.319=-0.035
max8.953-8.876=0.077

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.110-1.092=0.017
σ0.160-0.124=0.037
min0.942-0.954=-0.012
max1.377-1.294=0.083

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.129-465.125=0.004
σ575.766-575.767=-0.001
min177.239-177.230=0.009
max1328.778-1328.776=0.002
mean79.750
σ7.500
min76.000
max91.000
mean2857.000-2850.000=7.000
σ0.000
min2857.000-2850.000=7.000
max2857.000-2850.000=7.000
mean0.441-0.439=0.002
σ0.310-0.308=0.001
min0.283-0.282=0.001
max0.906-0.902=0.004
policies=20
mean1772.635-1772.597=0.037
σ0.335-0.329=0.006
min1772.397-1772.346=0.050
max1773.130-1773.077=0.052
mean760.000
σ0.000
min760.000
max760.000
mean2857.000-2850.000=7.000
σ0.000
min2857.000-2850.000=7.000
max2857.000-2850.000=7.000
mean2.823-2.841=-0.018
σ0.015-0.008=0.008
min2.814-2.833=-0.019
max2.846-2.850=-0.005
policies=200
mean17732.766-17732.507=0.259
σ0.459-0.491=-0.032
min17732.406-17732.171=0.235
max17733.438-17733.237=0.201
mean7600.000
σ0.000
min7600.000
max7600.000
mean2857.000-2850.000=7.000
σ0.000
min2857.000-2850.000=7.000
max2857.000-2850.000=7.000
mean28.173-28.191=-0.018
σ0.554-0.470=0.083
min27.626-27.629=-0.003
max28.757-28.590=0.167