Compare commits

Home / Compare 77f00784 .. c8b27e15

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-30.773=4.490
σ0.055-0.045=0.010
min35.230-30.751=4.479
max35.418-30.901=4.518
mean413.000
σ0.000
min413.000
max413.000
mean0.083-0.079=0.004
σ0.004-0.004=-0.000
min0.077-0.076=0.001
max0.088-0.085=0.003
cache=y
dps=1
iters=10
policies=100
mean23.769-21.059=2.710
σ0.003-0.002=0.001
min23.764-21.056=2.708
max23.774-21.064=2.710
mean413.000
σ0.000
min413.000
max413.000
mean0.067-0.063=0.004
σ0.005-0.003=0.002
min0.061-0.059=0.002
max0.076-0.070=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1751.236=5.250
σ0.366-0.362=0.004
min1755.909-1750.676=5.233
max1757.079-1751.825=5.254
mean1646.300-1667.100=-20.800
σ639.692-630.176=9.516
min623.000-679.000=-56.000
max2823.000-2640.000=183.000
mean2.330-2.837=-0.507
σ0.067-0.106=-0.039
min2.238-2.621=-0.383
max2.468-2.970=-0.501

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.682-275.567=49.115
σ0.051-0.007=0.044
min324.593-275.562=49.031
max324.716-275.578=49.138
mean2823.000-2640.000=183.000
σ0.000
min2823.000-2640.000=183.000
max2823.000-2640.000=183.000
mean0.438-0.391=0.047
σ0.017-0.008=0.009
min0.425-0.383=0.041
max0.466-0.400=0.066
iters=5
new-facts=1
prior-facts=6402
mean1985.266-2168.099=-182.833
σ0.010-0.009=0.001
min1985.250-2168.089=-182.839
max1985.274-2168.110=-182.836
mean2823.000-2640.000=183.000
σ0.000
min2823.000-2640.000=183.000
max2823.000-2640.000=183.000
mean2.687-2.997=-0.310
σ0.163-0.161=0.002
min2.510-2.836=-0.326
max2.890-3.223=-0.332
iters=5
new-facts=6402
prior-facts=1
mean4808.672-5047.922=-239.250
σ7.216-0.896=6.320
min4805.422-5047.391=-241.969
max4821.581-5049.516=-227.935
mean2823.000-2640.000=183.000
σ0.000
min2823.000-2640.000=183.000
max2823.000-2640.000=183.000
mean9.145-9.018=0.128
σ0.200-0.328=-0.128
min8.977-8.597=0.380
max9.469-9.493=-0.024
iters=5
new-facts=6402
prior-facts=6402
mean4996.467-5179.041=-182.575
σ0.018-0.082=-0.064
min4996.446-5178.961=-182.514
max4996.489-5179.131=-182.642
mean3029.400-3218.800=-189.400
σ281.789-388.112=-106.323
min2823.000-2684.000=139.000
max3471.000-3704.000=-233.000
mean8.507-9.864=-1.357
σ0.127-0.271=-0.144
min8.359-9.489=-1.131
max8.699-10.214=-1.515

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.973-1.295=-0.322
σ0.067-0.381=-0.314
min0.916-0.950=-0.033
max1.052-1.871=-0.819

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.972-463.203=-0.231
σ574.256-572.661=1.594
min175.836-176.872=-1.036
max1324.355-1322.194=2.161
mean86.250-77.500=8.750
σ8.500-7.000=1.500
min82.000-74.000=8.000
max99.000-88.000=11.000
mean2823.000-2640.000=183.000
σ0.000
min2823.000-2640.000=183.000
max2823.000-2640.000=183.000
mean0.431-0.550=-0.119
σ0.298-0.541=-0.243
min0.278-0.275=0.003
max0.879-1.362=-0.484
policies=20
mean1758.718-1768.970=-10.252
σ0.342-0.334=0.007
min1758.487-1768.757=-10.270
max1759.225-1769.469=-10.244
mean820.000-740.000=80.000
σ0.000
min820.000-740.000=80.000
max820.000-740.000=80.000
mean2823.000-2640.000=183.000
σ0.000
min2823.000-2640.000=183.000
max2823.000-2640.000=183.000
mean2.799-2.744=0.055
σ0.004-0.019=-0.016
min2.794-2.718=0.076
max2.801-2.764=0.038
policies=200
mean17593.366-17696.103=-102.737
σ0.723-0.589=0.134
min17592.370-17695.750=-103.380
max17593.930-17696.981=-103.051
mean8200.000-7400.000=800.000
σ0.000
min8200.000-7400.000=800.000
max8200.000-7400.000=800.000
mean2823.000-2640.000=183.000
σ0.000
min2823.000-2640.000=183.000
max2823.000-2640.000=183.000
mean27.935-27.657=0.277
σ0.353-0.132=0.221
min27.588-27.467=0.120
max28.350-27.772=0.578