Compare commits

Home / Compare d3bb4296 .. 307ef5d8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.727-36.726=0.001
σ0.683-0.860=-0.177
min35.925-35.921=0.004
max37.523-38.454=-0.931
mean4049.000-3985.000=64.000
σ0.000
min4049.000-3985.000=64.000
max4049.000-3985.000=64.000
mean0.075-0.071=0.004
σ0.001-0.000=0.000
min0.074-0.070=0.004
max0.076-0.071=0.005
cache=y
dps=1
iters=10
policies=100
mean26.586-26.585=0.002
σ0.604-0.605=-0.001
min26.206-26.204=0.002
max27.467-27.466=0.001
mean4049.000-3985.000=64.000
σ0.000
min4049.000-3985.000=64.000
max4049.000-3985.000=64.000
mean0.060-0.057=0.003
σ0.001-0.001=0.000
min0.059-0.056=0.003
max0.061-0.058=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.368-1756.366=0.002
σ0.373-0.372=0.001
min1755.766-1755.801=-0.036
max1756.967-1756.959=0.008
mean1656.200-1662.350=-6.150
σ627.392-627.156=0.237
min683.000-620.000=63.000
max2606.000-2636.000=-30.000
mean2.261-2.291=-0.030
σ0.154-0.160=-0.006
min2.128-2.133=-0.005
max2.775-2.790=-0.015

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.693-278.693=0.000
σ0.012-0.014=-0.002
min278.683-278.680=0.003
max278.713-278.712=0.000
mean2606.000-2636.000=-30.000
σ0.000
min2606.000-2636.000=-30.000
max2606.000-2636.000=-30.000
mean0.424-0.421=0.003
σ0.009-0.002=0.007
min0.417-0.419=-0.002
max0.437-0.423=0.014
iters=5
new-facts=1
prior-facts=6402
mean2268.862-2268.865=-0.004
σ0.010-0.004=0.007
min2268.846-2268.861=-0.015
max2268.871-2268.870=0.001
mean2606.000-2636.000=-30.000
σ0.000
min2606.000-2636.000=-30.000
max2606.000-2636.000=-30.000
mean3.004-2.949=0.055
σ0.169-0.053=0.116
min2.900-2.909=-0.009
max3.296-3.041=0.255
iters=5
new-facts=6402
prior-facts=1
mean4952.127-4952.250=-0.123
σ0.738-0.881=-0.143
min4951.272-4951.435=-0.164
max4953.314-4953.759=-0.445
mean2606.000-2636.000=-30.000
σ0.000
min2606.000-2636.000=-30.000
max2606.000-2636.000=-30.000
mean7.885-7.935=-0.050
σ0.337-0.209=0.128
min7.634-7.650=-0.016
max8.475-8.163=0.312
iters=5
new-facts=6402
prior-facts=6402
mean5167.003-5167.068=-0.065
σ0.141-0.014=0.127
min5166.750-5167.051=-0.300
max5167.077-5167.087=-0.009
mean3396.800-3423.400=-26.600
σ459.413-451.612=7.800
min2808.000-2810.000=-2.000
max4049.000-3985.000=64.000
mean9.425-9.341=0.084
σ0.381-0.134=0.248
min8.997-9.164=-0.167
max9.955-9.522=0.433

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.055-1.026=0.028
σ0.125-0.134=-0.009
min0.936-0.938=-0.002
max1.242-1.247=-0.005

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.259-460.259=-0.000
σ572.608-572.606=0.002
min173.953-173.954=-0.001
max1319.170-1319.168=0.002
mean79.500
σ7.000
min76.000
max90.000
mean435.000-437.000=-2.000
σ0.000
min435.000-437.000=-2.000
max435.000-437.000=-2.000
mean0.571-0.536=0.035
σ0.590-0.532=0.058
min0.274-0.265=0.008
max1.456-1.334=0.122
policies=20
mean1740.051-1740.056=-0.005
σ0.326-0.339=-0.013
min1739.817-1739.809=0.008
max1740.529-1740.553=-0.024
mean760.000
σ0.000
min760.000
max760.000
mean446.000-447.250=-1.250
σ10.520-9.179=1.341
min435.000-437.000=-2.000
max455.000
mean2.656-2.677=-0.020
σ0.022-0.007=0.015
min2.628-2.668=-0.040
max2.679-2.683=-0.004
policies=200
mean17409.815-17409.682=0.133
σ0.068-0.122=-0.054
min17409.736-17409.563=0.174
max17409.897-17409.809=0.088
mean7600.000
σ0.000
min7600.000
max7600.000
mean489.500-493.500=-4.000
σ3.109-2.082=1.027
min486.000-491.000=-5.000
max493.000-496.000=-3.000
mean26.930-26.957=-0.027
σ0.071-0.099=-0.028
min26.824-26.868=-0.044
max26.975-27.092=-0.117