Compare commits

Home / Compare fc66b498 .. 46b14b60

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.727-36.726=0.000
σ0.685-0.687=-0.002
min35.929-35.920=0.009
max37.523-37.525=-0.002
mean3959.000-3944.000=15.000
σ0.000
min3959.000-3944.000=15.000
max3959.000-3944.000=15.000
mean0.075-0.074=0.001
σ0.001-0.002=-0.001
min0.074-0.071=0.003
max0.076-0.076=0.000
cache=y
dps=1
iters=10
policies=100
mean26.579-26.711=-0.132
σ0.528-0.645=-0.117
min26.207-26.204=0.003
max27.462-27.466=-0.005
mean3959.000-3944.000=15.000
σ0.000
min3959.000-3944.000=15.000
max3959.000-3944.000=15.000
mean0.060-0.058=0.002
σ0.001-0.002=-0.002
min0.059-0.056=0.003
max0.062-0.061=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.366-1756.368=-0.001
σ0.371-0.374=-0.003
min1755.794-1755.795=-0.001
max1756.964-1756.972=-0.008
mean1657.300-1661.800=-4.500
σ627.552-627.647=-0.095
min683.000-688.000=-5.000
max2608.000-2612.000=-4.000
mean2.269-2.286=-0.016
σ0.149-0.155=-0.005
min2.154-2.117=0.037
max2.787-2.786=0.000

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.696-278.702=-0.006
σ0.014-0.006=0.007
min278.684-278.695=-0.011
max278.720-278.710=0.010
mean2608.000-2612.000=-4.000
σ0.000
min2608.000-2612.000=-4.000
max2608.000-2612.000=-4.000
mean0.420-0.424=-0.003
σ0.001-0.009=-0.008
min0.419-0.419=0.000
max0.422-0.440=-0.018
iters=5
new-facts=1
prior-facts=6402
mean2268.870-2268.872=-0.003
σ0.005-0.005=-0.001
min2268.863-2268.864=-0.001
max2268.875-2268.878=-0.004
mean2608.000-2612.000=-4.000
σ0.000
min2608.000-2612.000=-4.000
max2608.000-2612.000=-4.000
mean2.971-2.982=-0.012
σ0.120-0.167=-0.047
min2.904-2.856=0.048
max3.183-3.275=-0.091
iters=5
new-facts=6402
prior-facts=1
mean4952.204-4952.315=-0.112
σ0.995-0.894=0.101
min4951.276-4951.837=-0.560
max4953.904-4953.909=-0.005
mean2608.000-2612.000=-4.000
σ0.000
min2608.000-2612.000=-4.000
max2608.000-2612.000=-4.000
mean8.213-8.200=0.012
σ0.279-0.367=-0.088
min7.894-7.741=0.153
max8.478-8.636=-0.158
iters=5
new-facts=6402
prior-facts=6402
mean5167.069-5167.076=-0.007
σ0.009-0.008=0.001
min5167.058-5167.071=-0.013
max5167.078-5167.090=-0.012
mean3406.400-3396.400=10.000
σ451.204-444.408=6.796
min2773.000-2774.000=-1.000
max3959.000-3944.000=15.000
mean9.478-9.513=-0.034
σ0.319-0.369=-0.050
min9.062-9.049=0.014
max9.927-9.976=-0.049

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.058-1.063=-0.005
σ0.126-0.125=0.001
min0.944-0.946=-0.002
max1.254-1.252=0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.258-460.256=0.002
σ572.607-572.609=-0.002
min173.953-173.949=0.005
max1319.168-1319.169=-0.000
mean79.500
σ7.000
min76.000
max90.000
mean437.000
σ0.000
min437.000
max437.000
mean0.543-0.572=-0.029
σ0.536-0.589=-0.054
min0.271-0.269=0.002
max1.347-1.456=-0.109
policies=20
mean1740.053-1740.031=0.022
σ0.336-0.333=0.003
min1739.813-1739.790=0.023
max1740.547-1740.519=0.028
mean760.000
σ0.000
min760.000
max760.000
mean447.000-448.250=-1.250
σ9.381-10.308=-0.927
min437.000
max455.000-457.000=-2.000
mean2.673-2.672=0.001
σ0.006-0.014=-0.008
min2.664-2.657=0.008
max2.679-2.684=-0.005
policies=200
mean17409.664-17409.773=-0.109
σ0.120-0.095=0.025
min17409.531-17409.637=-0.105
max17409.797-17409.855=-0.058
mean7600.000
σ0.000
min7600.000
max7600.000
mean491.250-493.250=-2.000
σ3.096-4.272=-1.176
min487.000-488.000=-1.000
max494.000-498.000=-4.000
mean26.917-26.960=-0.044
σ0.098-0.118=-0.019
min26.832-26.853=-0.020
max27.050-27.078=-0.028