Compare commits

Home / Compare c096cbb8 .. 9055f829

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.967-35.966=0.001
σ0.102-0.103=-0.001
min35.922-35.923=-0.001
max36.255-36.259=-0.004
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.077-0.078=-0.001
σ0.003-0.005=-0.001
min0.075-0.074=0.000
max0.084-0.085=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.209-26.209=-0.000
σ0.002-0.005=-0.003
min26.207-26.202=0.005
max26.214-26.219=-0.005
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.060-0.061=-0.002
σ0.003-0.003=-0.000
min0.057-0.059=-0.002
max0.067-0.070=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.316-1756.315=0.001
σ0.368-0.368=0.000
min1755.736-1755.741=-0.005
max1756.906-1756.909=-0.003
mean1656.400-1658.100=-1.700
σ625.477-632.614=-7.137
min613.000-612.000=1.000
max2700.000-2731.000=-31.000
mean2.374-2.375=-0.001
σ0.140-0.135=0.004
min2.212-2.259=-0.047
max2.743-2.823=-0.080

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.838-278.844=-0.006
σ0.018-0.010=0.008
min278.807-278.832=-0.025
max278.849-278.857=-0.008
mean2700.000-2731.000=-31.000
σ0.000
min2700.000-2731.000=-31.000
max2700.000-2731.000=-31.000
mean0.417-0.409=0.008
σ0.008-0.001=0.007
min0.410-0.407=0.003
max0.429-0.410=0.018
iters=5
new-facts=1
prior-facts=6402
mean2268.900-2268.900=-0.000
σ0.019-0.019=0.000
min2268.877-2268.873=0.005
max2268.921-2268.922=-0.001
mean2700.000-2731.000=-31.000
σ0.000
min2700.000-2731.000=-31.000
max2700.000-2731.000=-31.000
mean2.935-3.207=-0.273
σ0.045-0.168=-0.123
min2.897-2.919=-0.021
max3.012-3.352=-0.340
iters=5
new-facts=6402
prior-facts=1
mean4954.245-4954.042=0.203
σ0.881-1.057=-0.176
min4953.689-4953.240=0.448
max4955.809-4955.826=-0.017
mean2700.000-2731.000=-31.000
σ0.000
min2700.000-2731.000=-31.000
max2700.000-2731.000=-31.000
mean8.099-8.046=0.053
σ0.459-0.392=0.067
min7.722-7.794=-0.072
max8.694-8.739=-0.044
iters=5
new-facts=6402
prior-facts=6402
mean5168.677-5168.748=-0.070
σ0.192-0.210=-0.018
min5168.413-5168.403=0.010
max5168.901-5168.935=-0.034
mean3368.200-3365.400=2.800
σ473.088-410.562=62.526
min2741.000-2965.000=-224.000
max3996.000-3785.000=211.000
mean9.549-9.201=0.349
σ0.264-0.568=-0.304
min9.117-8.540=0.578
max9.824-9.813=0.011

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.973-1.000=-0.027
σ0.055-0.067=-0.012
min0.940-0.943=-0.003
max1.069-1.073=-0.004

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.358-460.358=-0.000
σ572.654-572.652=0.002
min174.028-174.024=0.004
max1319.338-1319.335=0.003
mean79.500
σ7.000
min76.000
max90.000
mean2700.000-2731.000=-31.000
σ0.000
min2700.000-2731.000=-31.000
max2700.000-2731.000=-31.000
mean0.546-0.552=-0.005
σ0.538-0.556=-0.018
min0.270-0.268=0.001
max1.354-1.386=-0.032
policies=20
mean1740.471-1740.490=-0.020
σ0.311-0.322=-0.011
min1740.283-1740.295=-0.013
max1740.935-1740.971=-0.036
mean760.000
σ0.000
min760.000
max760.000
mean2700.000-2731.000=-31.000
σ0.000
min2700.000-2731.000=-31.000
max2700.000-2731.000=-31.000
mean2.678-2.691=-0.013
σ0.016-0.011=0.005
min2.662-2.676=-0.014
max2.701-2.702=-0.001
policies=200
mean17411.880-17411.897=-0.017
σ0.552-0.536=0.016
min17411.546-17411.546=-0.001
max17412.705-17412.694=0.011
mean7600.000
σ0.000
min7600.000
max7600.000
mean2700.000-2731.000=-31.000
σ0.000
min2700.000-2731.000=-31.000
max2700.000-2731.000=-31.000
mean27.061-27.063=-0.001
σ0.187-0.075=0.112
min26.928-26.997=-0.070
max27.335-27.170=0.165