Compare commits

Home / Compare e34a481f .. de616d2e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.045-73.043=0.001
σ0.046-0.047=-0.001
min73.019-73.017=0.002
max73.175-73.177=-0.002
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.161-0.160=0.001
σ0.003-0.006=-0.003
min0.158-0.151=0.007
max0.166-0.169=-0.003
cache=y
dps=1
iters=10
policies=100
mean23.741-23.741=-0.000
σ0.003-0.004=-0.001
min23.736-23.734=0.002
max23.746-23.749=-0.003
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.067-0.066=0.000
σ0.003-0.002=0.001
min0.065-0.064=0.000
max0.074-0.072=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.786-1758.787=-0.001
σ0.360-0.360=0.000
min1758.214-1758.215=-0.001
max1759.357-1759.352=0.005
mean1659.050-1658.150=0.900
σ631.191-625.735=5.457
min617.000-622.000=-5.000
max2853.000-2515.000=338.000
mean2.812-2.823=-0.011
σ0.155-0.110=0.045
min2.376-2.451=-0.075
max2.990-2.959=0.031

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.029-324.005=0.024
σ0.028-0.050=-0.023
min323.981-323.915=0.065
max324.050-324.037=0.014
mean2853.000-2515.000=338.000
σ0.000
min2853.000-2515.000=338.000
max2853.000-2515.000=338.000
mean0.431-0.421=0.011
σ0.005-0.021=-0.016
min0.426-0.384=0.042
max0.437-0.440=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1984.598-1984.591=0.007
σ0.006-0.021=-0.014
min1984.590-1984.558=0.032
max1984.606-1984.610=-0.004
mean2853.000-2515.000=338.000
σ0.000
min2853.000-2515.000=338.000
max2853.000-2515.000=338.000
mean2.620-2.727=-0.107
σ0.143-0.271=-0.128
min2.462-2.539=-0.076
max2.844-3.180=-0.336
iters=5
new-facts=6402
prior-facts=1
mean4808.108-4808.261=-0.153
σ7.556-7.748=-0.192
min4804.685-4804.666=0.019
max4821.624-4822.120=-0.496
mean2853.000-2515.000=338.000
σ0.000
min2853.000-2515.000=338.000
max2853.000-2515.000=338.000
mean8.979-9.044=-0.065
σ0.113-0.380=-0.266
min8.841-8.673=0.168
max9.144-9.632=-0.488
iters=5
new-facts=6402
prior-facts=6402
mean4995.736-4995.809=-0.073
σ0.147-0.022=0.125
min4995.474-4995.785=-0.311
max4995.816-4995.833=-0.017
mean3040.000-2960.400=79.600
σ196.019-270.847=-74.828
min2853.000-2600.000=253.000
max3322.000-3307.000=15.000
mean8.716-8.617=0.099
σ0.244-0.078=0.167
min8.476-8.528=-0.053
max9.089-8.730=0.358

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.986-1.670=-0.684
σ0.141-0.247=-0.106
min0.918-1.234=-0.316
max1.238-1.828=-0.590

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.346-468.327=0.020
σ574.232-574.230=0.002
min181.227-181.206=0.021
max1329.695-1329.672=0.022
mean88.250
σ8.500
min84.000
max101.000
mean2853.000-2515.000=338.000
σ0.000
min2853.000-2515.000=338.000
max2853.000-2515.000=338.000
mean0.442-0.556=-0.114
σ0.301-0.535=-0.234
min0.288-0.286=0.002
max0.894-1.359=-0.464
policies=20
mean1812.623-1812.425=0.198
σ0.399-0.378=0.022
min1812.341-1812.172=0.169
max1813.208-1812.984=0.224
mean840.000
σ0.000
min840.000
max840.000
mean2853.000-2515.000=338.000
σ0.000
min2853.000-2515.000=338.000
max2853.000-2515.000=338.000
mean2.901-2.818=0.083
σ0.010-0.008=0.002
min2.891-2.808=0.084
max2.915-2.826=0.089
policies=200
mean18132.558-18131.476=1.082
σ0.636-0.419=0.216
min18131.736-18131.079=0.657
max18133.114-18132.068=1.046
mean8400.000
σ0.000
min8400.000
max8400.000
mean2853.000-2515.000=338.000
σ0.000
min2853.000-2515.000=338.000
max2853.000-2515.000=338.000
mean28.840-28.400=0.439
σ0.362-0.105=0.257
min28.388-28.257=0.130
max29.139-28.488=0.652