Compare commits

Home / Compare 318a157c .. b1d132a5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.041-31.041=-0.000
σ0.050-0.051=-0.001
min30.999-31.002=-0.003
max31.180-31.184=-0.004
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.080-0.076=0.004
σ0.003-0.004=-0.001
min0.077-0.071=0.006
max0.087-0.083=0.004
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=0.000
σ0.003-0.002=0.001
min21.140-21.141=-0.001
max21.149-21.145=0.004
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.062-0.064=-0.003
σ0.003-0.003=-0.001
min0.059-0.058=0.001
max0.066-0.071=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.410-1751.411=-0.001
σ0.362-0.361=0.001
min1750.839-1750.845=-0.006
max1751.993-1751.984=0.009
mean1655.700-1665.100=-9.400
σ630.484-628.407=2.077
min622.000-636.000=-14.000
max2753.000-2521.000=232.000
mean2.757-2.850=-0.093
σ0.231-0.184=0.048
min2.171-2.314=-0.143
max2.985-3.135=-0.150

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.783-273.407=-6.624
σ0.008-0.009=-0.001
min266.773-273.392=-6.618
max266.791-273.414=-6.623
mean2753.000-2521.000=232.000
σ0.000
min2753.000-2521.000=232.000
max2753.000-2521.000=232.000
mean0.363-0.390=-0.026
σ0.001-0.015=-0.014
min0.362-0.376=-0.014
max0.364-0.413=-0.049
iters=5
new-facts=1
prior-facts=6402
mean1927.214-1933.838=-6.624
σ0.009-0.011=-0.003
min1927.209-1933.826=-6.617
max1927.229-1933.856=-6.628
mean2753.000-2521.000=232.000
σ0.000
min2753.000-2521.000=232.000
max2753.000-2521.000=232.000
mean3.091-3.106=-0.015
σ0.112-0.144=-0.032
min2.967-2.973=-0.006
max3.217-3.303=-0.086
iters=5
new-facts=6402
prior-facts=1
mean4747.734-4754.351=-6.618
σ0.791-0.884=-0.093
min4747.312-4753.768=-6.455
max4749.145-4755.918=-6.773
mean2753.000-2521.000=232.000
σ0.000
min2753.000-2521.000=232.000
max2753.000-2521.000=232.000
mean8.292-8.470=-0.178
σ0.325-0.574=-0.249
min7.929-7.632=0.297
max8.806-9.031=-0.225
iters=5
new-facts=6402
prior-facts=6402
mean4938.162-4944.800=-6.638
σ0.083-0.080=0.003
min4938.083-4944.735=-6.652
max4938.257-4944.903=-6.646
mean3025.800-3009.400=16.400
σ318.240-366.110=-47.870
min2753.000-2521.000=232.000
max3494.000-3358.000=136.000
mean8.415-8.757=-0.342
σ0.124-0.439=-0.314
min8.267-8.367=-0.100
max8.604-9.489=-0.885

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.022-1.640=-0.618
σ0.140-0.168=-0.029
min0.930-1.372=-0.442
max1.254-1.823=-0.569

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.120-463.336=1.784
σ575.753-572.196=3.557
min177.235-177.234=0.001
max1328.750-1321.630=7.120
mean79.750
σ7.500
min76.000
max91.000
mean2753.000-2521.000=232.000
σ0.000
min2753.000-2521.000=232.000
max2753.000-2521.000=232.000
mean0.561-0.568=-0.006
σ0.561-0.584=-0.023
min0.278-0.274=0.004
max1.403-1.443=-0.040
policies=20
mean1772.595-1772.591=0.004
σ0.319-0.341=-0.022
min1772.392-1772.366=0.026
max1773.071-1773.097=-0.026
mean760.000
σ0.000
min760.000
max760.000
mean2753.000-2521.000=232.000
σ0.000
min2753.000-2521.000=232.000
max2753.000-2521.000=232.000
mean2.741-2.752=-0.011
σ0.011-0.011=-0.000
min2.725-2.742=-0.017
max2.747-2.766=-0.019
policies=200
mean17732.376-17732.507=-0.131
σ0.599-0.493=0.106
min17732.056-17732.248=-0.191
max17733.274-17733.245=0.029
mean7600.000
σ0.000
min7600.000
max7600.000
mean2753.000-2521.000=232.000
σ0.000
min2753.000-2521.000=232.000
max2753.000-2521.000=232.000
mean27.702-27.698=0.004
σ0.177-0.105=0.072
min27.505-27.595=-0.090
max27.853-27.831=0.022