Compare commits

Home / Compare b873d8fe .. 1903d62e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.701-31.040=39.661
σ0.047-0.050=-0.003
min70.670-31.003=39.667
max70.831-31.181=39.650
mean411.000-413.000=-2.000
σ0.000
min411.000-413.000=-2.000
max411.000-413.000=-2.000
mean0.159-0.077=0.082
σ0.006-0.005=0.001
min0.147-0.071=0.076
max0.167-0.086=0.082
cache=y
dps=1
iters=10
policies=100
mean21.408-21.143=0.265
σ0.003-0.003=-0.001
min21.405-21.139=0.266
max21.413-21.148=0.265
mean411.000-413.000=-2.000
σ0.000
min411.000-413.000=-2.000
max411.000-413.000=-2.000
mean0.065-0.065=-0.000
σ0.004-0.002=0.002
min0.059-0.063=-0.004
max0.073-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.929-1751.411=3.518
σ0.361-0.362=-0.000
min1754.362-1750.839=3.523
max1755.519-1751.992=3.527
mean1665.950-1652.950=13.000
σ625.436-646.928=-21.492
min623.000-649.000=-26.000
max2522.000-2853.000=-331.000
mean2.845-2.835=0.010
σ0.111-0.173=-0.062
min2.503-2.284=0.219
max3.027-3.228=-0.200

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.793-273.405=-0.611
σ0.006-0.008=-0.002
min272.787-273.392=-0.605
max272.803-273.413=-0.610
mean2522.000-2853.000=-331.000
σ0.000
min2522.000-2853.000=-331.000
max2522.000-2853.000=-331.000
mean0.382-0.400=-0.018
σ0.008-0.013=-0.005
min0.378-0.383=-0.005
max0.397-0.416=-0.018
iters=5
new-facts=1
prior-facts=6402
mean1933.215-1933.839=-0.625
σ0.015-0.013=0.002
min1933.198-1933.825=-0.628
max1933.233-1933.852=-0.619
mean2522.000-2853.000=-331.000
σ0.000
min2522.000-2853.000=-331.000
max2522.000-2853.000=-331.000
mean3.052-2.871=0.182
σ0.182-0.213=-0.030
min2.895-2.620=0.274
max3.347-3.092=0.256
iters=5
new-facts=6402
prior-facts=1
mean4756.939-4754.168=2.771
σ7.648-1.009=6.638
min4753.459-4753.378=0.081
max4770.619-4755.914=14.705
mean2522.000-2853.000=-331.000
σ0.000
min2522.000-2853.000=-331.000
max2522.000-2853.000=-331.000
mean8.658-8.142=0.516
σ0.467-0.560=-0.093
min7.874-7.704=0.170
max9.004-9.009=-0.005
iters=5
new-facts=6402
prior-facts=6402
mean4944.389-4944.791=-0.402
σ0.153-0.079=0.073
min4944.117-4944.711=-0.594
max4944.478-4944.882=-0.404
mean2948.800-3067.000=-118.200
σ366.627-289.804=76.823
min2522.000-2853.000=-331.000
max3460.000-3519.000=-59.000
mean8.600-8.436=0.164
σ0.245-0.124=0.122
min8.329-8.297=0.032
max8.969-8.618=0.351

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.541-1.059=0.482
σ0.206-0.129=0.077
min1.226-0.941=0.285
max1.792-1.260=0.532

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.304-463.339=4.965
σ574.232-572.194=2.038
min181.183-177.241=3.942
max1329.652-1321.630=8.022
mean88.250-79.750=8.500
σ8.500-7.500=1.000
min84.000-76.000=8.000
max101.000-91.000=10.000
mean2522.000-2853.000=-331.000
σ0.000
min2522.000-2853.000=-331.000
max2522.000-2853.000=-331.000
mean0.558-0.439=0.120
σ0.547-0.307=0.240
min0.282-0.283=-0.001
max1.379-0.899=0.480
policies=20
mean1812.144-1772.629=39.514
σ0.385-0.335=0.050
min1811.881-1772.382=39.498
max1812.712-1773.118=39.594
mean840.000-760.000=80.000
σ0.000
min840.000-760.000=80.000
max840.000-760.000=80.000
mean2522.000-2853.000=-331.000
σ0.000
min2522.000-2853.000=-331.000
max2522.000-2853.000=-331.000
mean2.815-2.853=-0.038
σ0.010-0.007=0.003
min2.808-2.848=-0.040
max2.829-2.863=-0.034
policies=200
mean18128.857-17732.536=396.320
σ0.608-0.389=0.219
min18128.450-17732.316=396.135
max18129.753-17733.119=396.633
mean8400.000-7600.000=800.000
σ0.000
min8400.000-7600.000=800.000
max8400.000-7600.000=800.000
mean2522.000-2853.000=-331.000
σ0.000
min2522.000-2853.000=-331.000
max2522.000-2853.000=-331.000
mean28.274-28.363=-0.089
σ0.086-0.463=-0.376
min28.194-27.832=0.362
max28.349-28.803=-0.454