Compare commits

Home / Compare 495f1f6e .. 644f7a20

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.972-53.837=0.135
σ0.368-0.368=0.001
min53.834-53.690=0.144
max55.019-54.883=0.137
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.141-0.139=0.002
σ0.005-0.004=0.001
min0.138-0.136=0.002
max0.150-0.145=0.005
cache=y
dps=1
iters=10
policies=100
mean43.341-43.208=0.133
σ0.006-0.005=0.001
min43.335-43.202=0.134
max43.355-43.216=0.140
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.122-0.121=0.001
σ0.004-0.005=-0.001
min0.115-0.114=0.001
max0.129-0.130=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.893-1016.205=0.688
σ1.176-1.192=-0.016
min1016.350-1015.658=0.692
max1021.826-1021.207=0.620
mean1065.350-1055.750=9.600
σ318.298-317.380=0.918
min605.000-548.000=57.000
max1637.000-1631.000=6.000
mean1.583-1.557=0.026
σ0.090-0.098=-0.008
min1.498-1.475=0.023
max1.841-1.785=0.056

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.861-301.307=0.554
σ0.233-0.198=0.035
min301.705-301.163=0.543
max302.490-301.836=0.654
mean2044.000-2039.000=5.000
σ0.000
min2044.000-2039.000=5.000
max2044.000-2039.000=5.000
mean0.554-0.563=-0.009
σ0.052-0.034=0.018
min0.496-0.499=-0.003
max0.612-0.592=0.020

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.508-301.483=2.025
σ0.068-0.045=0.023
min303.396-301.416=1.980
max303.568-301.533=2.035
mean1637.000-1631.000=6.000
σ0.000
min1637.000-1631.000=6.000
max1637.000-1631.000=6.000
mean0.394-0.390=0.004
σ0.008-0.002=0.007
min0.388-0.389=-0.001
max0.409-0.392=0.016
iters=5
new-facts=1
prior-facts=6402
mean1326.052-1324.050=2.002
σ0.100-0.096=0.004
min1325.932-1323.929=2.003
max1326.186-1324.174=2.012
mean1637.000-1631.000=6.000
σ0.000
min1637.000-1631.000=6.000
max1637.000-1631.000=6.000
mean1.909-1.915=-0.005
σ0.144-0.109=0.035
min1.775-1.820=-0.045
max2.155-2.083=0.073
iters=5
new-facts=6402
prior-facts=1
mean1564.103-1562.115=1.988
σ6.913-6.903=0.010
min1560.803-1558.836=1.967
max1576.465-1574.460=2.005
mean1637.000-1631.000=6.000
σ0.000
min1637.000-1631.000=6.000
max1637.000-1631.000=6.000
mean2.296-2.405=-0.109
σ0.270-0.327=-0.057
min2.053-2.076=-0.023
max2.663-2.751=-0.088
iters=5
new-facts=6402
prior-facts=6402
mean1894.004-1891.975=2.029
σ0.070-0.067=0.003
min1893.881-1891.857=2.023
max1894.047-1892.022=2.024
mean1774.800-1773.200=1.600
σ170.513-172.720=-2.207
min1637.000-1631.000=6.000
max2044.000-2039.000=5.000
mean2.938-2.926=0.012
σ0.090-0.123=-0.033
min2.867-2.865=0.002
max3.050-3.146=-0.095

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.313-1.179=0.133
σ0.310-0.278=0.032
min1.038-0.910=0.128
max1.753-1.634=0.119

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.707-443.941=0.766
σ575.147-575.145=0.002
min157.128-156.367=0.761
max1307.427-1306.658=0.769
mean96.250
σ8.500
min92.000
max109.000
mean1637.000-1631.000=6.000
σ0.000
min1637.000-1631.000=6.000
max1637.000-1631.000=6.000
mean0.538-0.531=0.007
σ0.553-0.538=0.015
min0.261-0.260=0.000
max1.368-1.338=0.030
policies=20
mean1571.529-1563.918=7.611
σ0.339-0.326=0.014
min1571.328-1563.736=7.592
max1572.037-1564.406=7.631
mean920.000
σ0.000
min920.000
max920.000
mean1637.000-1631.000=6.000
σ0.000
min1637.000-1631.000=6.000
max1637.000-1631.000=6.000
mean2.638-2.617=0.021
σ0.016-0.021=-0.004
min2.621-2.589=0.031
max2.659-2.634=0.024
policies=200
mean15723.261-15646.926=76.335
σ0.154-0.153=0.001
min15723.119-15646.745=76.374
max15723.432-15647.109=76.322
mean9200.000
σ0.000
min9200.000
max9200.000
mean1637.000-1631.000=6.000
σ0.000
min1637.000-1631.000=6.000
max1637.000-1631.000=6.000
mean26.716-26.551=0.166
σ0.097-0.239=-0.143
min26.625-26.320=0.305
max26.852-26.774=0.078