Compare commits

Home / Compare ec94ac0d .. 714b2773

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.958-30.959=-0.001
σ0.049-0.049=-0.000
min30.913-30.918=-0.006
max31.092-31.095=-0.003
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.078-0.078=-0.000
σ0.003-0.003=0.001
min0.075-0.075=0.000
max0.084-0.085=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.060-21.061=-0.001
σ0.003-0.004=-0.001
min21.058-21.056=0.001
max21.065-21.069=-0.004
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.063-0.065=-0.002
σ0.003-0.003=-0.000
min0.059-0.062=-0.003
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.412-1751.411=0.001
σ0.360-0.359=0.001
min1750.847-1750.847=0.001
max1751.982-1751.996=-0.014
mean1663.300-1662.150=1.150
σ619.861-622.901=-3.040
min642.000-640.000=2.000
max2504.000-2510.000=-6.000
mean2.819-2.821=-0.002
σ0.166-0.169=-0.003
min2.277-2.468=-0.191
max3.063-3.136=-0.073

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.401-273.384=0.017
σ0.013-0.016=-0.003
min273.390-273.365=0.025
max273.417-273.405=0.012
mean2504.000-2510.000=-6.000
σ0.000
min2504.000-2510.000=-6.000
max2504.000-2510.000=-6.000
mean0.383-0.388=-0.005
σ0.010-0.009=0.001
min0.376-0.378=-0.001
max0.401-0.398=0.003
iters=5
new-facts=1
prior-facts=6402
mean1933.839-1933.846=-0.007
σ0.012-0.009=0.003
min1933.825-1933.830=-0.005
max1933.858-1933.853=0.005
mean2504.000-2510.000=-6.000
σ0.000
min2504.000-2510.000=-6.000
max2504.000-2510.000=-6.000
mean2.870-3.037=-0.167
σ0.121-0.102=0.019
min2.724-2.892=-0.167
max3.017-3.131=-0.113
iters=5
new-facts=6402
prior-facts=1
mean4754.217-4754.351=-0.134
σ0.973-0.834=0.139
min4753.457-4753.830=-0.373
max4755.920-4755.835=0.086
mean2504.000-2510.000=-6.000
σ0.000
min2504.000-2510.000=-6.000
max2504.000-2510.000=-6.000
mean8.542-8.417=0.126
σ0.746-0.437=0.309
min7.629-7.666=-0.036
max9.122-8.740=0.383
iters=5
new-facts=6402
prior-facts=6402
mean4944.578-4944.805=-0.227
σ0.331-0.079=0.252
min4944.031-4944.737=-0.706
max4944.882-4944.901=-0.020
mean2969.000-2981.800=-12.800
σ433.244-354.064=79.180
min2504.000-2528.000=-24.000
max3559.000-3322.000=237.000
mean8.430-8.794=-0.364
σ0.149-0.515=-0.365
min8.319-8.414=-0.095
max8.684-9.697=-1.013

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.755-1.704=0.051
σ0.195-0.116=0.079
min1.430-1.564=-0.134
max1.893-1.842=0.051

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.332-463.331=0.000
σ572.196-572.198=-0.002
min177.231-177.232=-0.001
max1321.625-1321.628=-0.002
mean79.750
σ7.500
min76.000
max91.000
mean2504.000-2510.000=-6.000
σ0.000
min2504.000-2510.000=-6.000
max2504.000-2510.000=-6.000
mean0.554-0.571=-0.018
σ0.553-0.575=-0.022
min0.277-0.276=0.001
max1.383-1.433=-0.051
policies=20
mean1772.589-1772.562=0.026
σ0.335-0.338=-0.002
min1772.366-1772.341=0.025
max1773.086-1773.063=0.023
mean760.000
σ0.000
min760.000
max760.000
mean2504.000-2510.000=-6.000
σ0.000
min2504.000-2510.000=-6.000
max2504.000-2510.000=-6.000
mean2.757-2.751=0.006
σ0.014-0.026=-0.012
min2.740-2.715=0.024
max2.773-2.775=-0.002
policies=200
mean17732.493-17732.404=0.089
σ0.454-0.400=0.054
min17732.224-17732.032=0.192
max17733.171-17732.971=0.200
mean7600.000
σ0.000
min7600.000
max7600.000
mean2504.000-2510.000=-6.000
σ0.000
min2504.000-2510.000=-6.000
max2504.000-2510.000=-6.000
mean27.732-27.688=0.043
σ0.157-0.093=0.065
min27.618-27.617=0.001
max27.963-27.823=0.141