Compare commits

Home / Compare 90dd923c .. 3140750c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.993-35.991=0.001
σ0.103-0.102=0.001
min35.946-35.952=-0.006
max36.285-36.281=0.005
mean3984.000-3779.000=205.000
σ0.000
min3984.000-3779.000=205.000
max3984.000-3779.000=205.000
mean0.075-0.076=-0.000
σ0.001-0.002=-0.001
min0.074-0.073=0.001
max0.076-0.078=-0.003
cache=y
dps=1
iters=10
policies=100
mean26.214-26.212=0.002
σ0.004-0.004=0.000
min26.206-26.208=-0.002
max26.219-26.220=-0.000
mean3984.000-3779.000=205.000
σ0.000
min3984.000-3779.000=205.000
max3984.000-3779.000=205.000
mean0.060-0.060=-0.000
σ0.001-0.001=-0.001
min0.059-0.059=0.000
max0.061-0.064=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.367-1756.369=-0.002
σ0.372-0.373=-0.001
min1755.788-1755.797=-0.009
max1756.967-1756.962=0.005
mean1660.150-1654.300=5.850
σ627.837-621.571=6.266
min619.000-674.000=-55.000
max2640.000-2660.000=-20.000
mean2.295-2.271=0.024
σ0.178-0.139=0.039
min2.145-2.149=-0.004
max2.774-2.773=0.001

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.693-278.690=0.002
σ0.013-0.012=0.000
min278.683-278.680=0.003
max278.714-278.712=0.003
mean2640.000-2660.000=-20.000
σ0.000
min2640.000-2660.000=-20.000
max2640.000-2660.000=-20.000
mean0.417-0.419=-0.001
σ0.002-0.001=0.000
min0.415-0.417=-0.002
max0.419-0.420=-0.001
iters=5
new-facts=1
prior-facts=6402
mean2268.865-2268.855=0.010
σ0.006-0.018=-0.012
min2268.857-2268.834=0.023
max2268.873-2268.870=0.002
mean2640.000-2660.000=-20.000
σ0.000
min2640.000-2660.000=-20.000
max2640.000-2660.000=-20.000
mean2.977-3.100=-0.123
σ0.171-0.144=0.027
min2.880-2.872=0.008
max3.282-3.251=0.031
iters=5
new-facts=6402
prior-facts=1
mean4952.211-4952.031=0.180
σ0.783-0.866=-0.083
min4951.814-4951.253=0.561
max4953.611-4953.516=0.095
mean2640.000-2660.000=-20.000
σ0.000
min2640.000-2660.000=-20.000
max2640.000-2660.000=-20.000
mean7.876-7.949=-0.074
σ0.188-0.445=-0.257
min7.682-7.650=0.031
max8.170-8.717=-0.547
iters=5
new-facts=6402
prior-facts=6402
mean5166.839-5166.851=-0.012
σ0.162-0.168=-0.006
min5166.550-5166.553=-0.002
max5166.926-5166.951=-0.025
mean3413.600-3349.800=63.800
σ466.865-423.692=43.173
min2758.000-2932.000=-174.000
max3984.000-3779.000=205.000
mean9.461-9.445=0.016
σ0.230-0.382=-0.152
min9.051-9.015=0.036
max9.587-10.005=-0.418

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.027-1.635=-0.608
σ0.187-0.318=-0.131
min0.927-1.256=-0.328
max1.362-1.903=-0.542

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.258-460.257=0.000
σ572.607-572.605=0.002
min173.953-173.954=-0.001
max1319.169-1319.165=0.004
mean79.500
σ7.000
min76.000
max90.000
mean435.000
σ0.000
min435.000
max435.000
mean0.550-0.560=-0.011
σ0.549-0.567=-0.018
min0.273-0.273=0.000
max1.374-1.411=-0.038
policies=20
mean1740.041-1740.042=-0.001
σ0.328-0.322=0.006
min1739.805-1739.802=0.003
max1740.522-1740.513=0.009
mean760.000
σ0.000
min760.000
max760.000
mean445.000
σ9.381
min435.000
max453.000
mean2.665-2.653=0.013
σ0.004-0.007=-0.003
min2.659-2.641=0.018
max2.669-2.657=0.012
policies=200
mean17409.862-17409.892=-0.030
σ0.082-0.057=0.025
min17409.746-17409.810=-0.064
max17409.937-17409.940=-0.003
mean7600.000
σ0.000
min7600.000
max7600.000
mean490.250-486.750=3.500
σ3.775-1.708=2.067
min486.000-485.000=1.000
max495.000-489.000=6.000
mean26.906-26.951=-0.045
σ0.134-0.086=0.048
min26.745-26.829=-0.084
max27.028-27.024=0.004