Compare commits

Home / Compare 96e4b7fa .. e6a0f0cf

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-35.617=-1.637
σ0.049-0.053=-0.004
min33.950-35.590=-1.640
max34.115-35.767=-1.652
mean413.000-411.000=2.000
σ0.000
min413.000-411.000=2.000
max413.000-411.000=2.000
mean0.085-0.082=0.003
σ0.003-0.004=-0.001
min0.083-0.077=0.006
max0.091-0.088=0.003
cache=y
dps=1
iters=10
policies=100
mean23.317-24.047=-0.730
σ0.003-0.004=-0.001
min23.312-24.042=-0.731
max23.321-24.057=-0.735
mean413.000-411.000=2.000
σ0.000
min413.000-411.000=2.000
max413.000-411.000=2.000
mean0.063-0.067=-0.004
σ0.003-0.004=-0.001
min0.060-0.062=-0.002
max0.068-0.075=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.492-1756.491=1.002
σ0.365-0.365=0.000
min1756.920-1755.914=1.006
max1758.082-1757.075=1.007
mean1646.100-1646.750=-0.650
σ624.806-644.701=-19.896
min634.000-646.000=-12.000
max2832.000-2831.000=1.000
mean2.388-2.336=0.051
σ0.092-0.088=0.004
min2.234-2.219=0.015
max2.686-2.568=0.118

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.640-324.766=1.874
σ0.052-0.044=0.008
min326.551-324.688=1.863
max326.682-324.790=1.892
mean2832.000-2831.000=1.000
σ0.000
min2832.000-2831.000=1.000
max2832.000-2831.000=1.000
mean0.433-0.427=0.006
σ0.011-0.007=0.004
min0.423-0.423=0.001
max0.448-0.440=0.008
iters=5
new-facts=1
prior-facts=6402
mean1988.796-1985.322=3.474
σ0.015-0.016=-0.001
min1988.780-1985.305=3.475
max1988.811-1985.340=3.471
mean2832.000-2831.000=1.000
σ0.000
min2832.000-2831.000=1.000
max2832.000-2831.000=1.000
mean2.703-2.616=0.087
σ0.140-0.060=0.080
min2.574-2.559=0.015
max2.939-2.689=0.250
iters=5
new-facts=6402
prior-facts=1
mean4813.650-4809.084=4.566
σ7.742-7.669=0.072
min4810.174-4805.615=4.559
max4827.499-4822.803=4.696
mean2832.000-2831.000=1.000
σ0.000
min2832.000-2831.000=1.000
max2832.000-2831.000=1.000
mean8.936-8.929=0.007
σ0.248-0.199=0.050
min8.547-8.613=-0.066
max9.156-9.064=0.092
iters=5
new-facts=6402
prior-facts=6402
mean5001.211-4996.485=4.726
σ0.028-0.192=-0.164
min5001.189-4996.248=4.941
max5001.259-4996.640=4.619
mean3011.400-3044.600=-33.200
σ192.110-288.217=-96.107
min2832.000-2831.000=1.000
max3295.000-3498.000=-203.000
mean9.921-8.521=1.400
σ0.102-0.124=-0.023
min9.803-8.442=1.361
max10.062-8.742=1.320

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.054-0.948=0.106
σ0.103-0.056=0.046
min0.922-0.914=0.007
max1.210-1.046=0.165

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.631-463.205=1.427
σ574.772-574.769=0.003
min177.240-175.814=1.426
max1326.789-1325.358=1.431
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2832.000-2831.000=1.000
σ0.000
min2832.000-2831.000=1.000
max2832.000-2831.000=1.000
mean0.416-0.428=-0.012
σ0.269-0.295=-0.026
min0.280-0.278=0.002
max0.820-0.870=-0.050
policies=20
mean1772.699-1758.532=14.168
σ0.377-0.343=0.034
min1772.433-1758.309=14.124
max1773.256-1759.041=14.215
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2832.000-2831.000=1.000
σ0.000
min2832.000-2831.000=1.000
max2832.000-2831.000=1.000
mean2.824-2.785=0.039
σ0.033-0.030=0.003
min2.781-2.749=0.032
max2.851-2.822=0.029
policies=200
mean17734.133-17592.089=142.044
σ0.483-0.563=-0.080
min17733.730-17591.769=141.960
max17734.826-17592.930=141.896
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2832.000-2831.000=1.000
σ0.000
min2832.000-2831.000=1.000
max2832.000-2831.000=1.000
mean27.958-27.880=0.078
σ0.396-0.353=0.043
min27.597-27.565=0.032
max28.379-28.254=0.125