Compare commits

Home / Compare e14959f9 .. ddec9786

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.966-35.957=0.009
σ0.103-0.102=0.000
min35.922-35.911=0.010
max36.257-36.246=0.011
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.075-0.076=-0.002
σ0.005-0.003=0.001
min0.070-0.072=-0.002
max0.083-0.083=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.208-26.202=0.006
σ0.003-0.004=-0.001
min26.204-26.198=0.006
max26.214-26.209=0.004
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.059-0.058=0.001
σ0.003-0.003=-0.000
min0.056-0.056=0.000
max0.066-0.067=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.759-1756.304=1.455
σ0.371-0.370=0.001
min1757.182-1755.728=1.454
max1758.359-1756.898=1.461
mean1652.950-1649.550=3.400
σ629.069-628.342=0.727
min621.000-612.000=9.000
max2752.000-2720.000=32.000
mean2.379-2.380=-0.001
σ0.153-0.097=0.056
min2.259-2.265=-0.007
max2.857-2.586=0.271

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean280.283-278.819=1.465
σ0.006-0.013=-0.007
min280.277-278.797=1.480
max280.290-278.831=1.459
mean2752.000-2720.000=32.000
σ0.000
min2752.000-2720.000=32.000
max2752.000-2720.000=32.000
mean0.416-0.413=0.003
σ0.003-0.005=-0.001
min0.413-0.408=0.005
max0.421-0.420=0.001
iters=5
new-facts=1
prior-facts=6402
mean2270.274-2268.890=1.384
σ0.051-0.012=0.039
min2270.190-2268.881=1.309
max2270.326-2268.910=1.415
mean2752.000-2720.000=32.000
σ0.000
min2752.000-2720.000=32.000
max2752.000-2720.000=32.000
mean3.040-3.188=-0.148
σ0.152-0.214=-0.062
min2.865-2.915=-0.050
max3.179-3.427=-0.248
iters=5
new-facts=6402
prior-facts=1
mean5147.608-4954.230=193.378
σ1.008-0.985=0.023
min5146.978-4953.657=193.321
max5149.400-4955.976=193.423
mean2752.000-2720.000=32.000
σ0.000
min2752.000-2720.000=32.000
max2752.000-2720.000=32.000
mean8.910-8.295=0.615
σ0.778-0.407=0.371
min8.194-7.837=0.357
max9.908-8.771=1.136
iters=5
new-facts=6402
prior-facts=6402
mean5285.582-5168.753=116.828
σ0.206-0.223=-0.017
min5285.254-5168.375=116.879
max5285.755-5168.897=116.858
mean3475.200-3315.200=160.000
σ525.858-388.534=137.324
min2771.000-2929.000=-158.000
max3974.000-3706.000=268.000
mean10.216-9.272=0.944
σ0.159-0.345=-0.186
min9.994-8.932=1.062
max10.402-9.789=0.613

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.025-0.986=0.039
σ0.067-0.074=-0.007
min0.938-0.940=-0.002
max1.079-1.117=-0.038

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.296-460.347=3.949
σ572.657-572.648=0.009
min177.965-174.020=3.945
max1323.281-1319.319=3.962
mean81.500-79.500=2.000
σ7.000
min78.000-76.000=2.000
max92.000-90.000=2.000
mean2752.000-2720.000=32.000
σ0.000
min2752.000-2720.000=32.000
max2752.000-2720.000=32.000
mean0.436-0.542=-0.107
σ0.299-0.537=-0.238
min0.284-0.269=0.015
max0.885-1.348=-0.463
policies=20
mean1779.939-1740.446=39.494
σ0.349-0.327=0.023
min1779.698-1740.252=39.446
max1780.446-1740.934=39.512
mean780.000-760.000=20.000
σ0.000
min780.000-760.000=20.000
max780.000-760.000=20.000
mean2752.000-2720.000=32.000
σ0.000
min2752.000-2720.000=32.000
max2752.000-2720.000=32.000
mean2.832-2.704=0.128
σ0.119-0.025=0.094
min2.763-2.686=0.077
max3.009-2.740=0.269
policies=200
mean17805.432-17411.312=394.120
σ0.960-0.463=0.497
min17804.172-17411.039=393.132
max17806.506-17412.005=394.502
mean7800.000-7600.000=200.000
σ0.000
min7800.000-7600.000=200.000
max7800.000-7600.000=200.000
mean2752.000-2720.000=32.000
σ0.000
min2752.000-2720.000=32.000
max2752.000-2720.000=32.000
mean28.104-27.168=0.936
σ0.108-0.075=0.033
min27.998-27.072=0.926
max28.214-27.246=0.968