Compare commits

Home / Compare 8533ac9e .. 8067487d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.040-53.970=0.070
σ0.370-0.369=0.002
min53.894-53.827=0.068
max55.094-55.018=0.075
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.139-0.134=0.005
σ0.003-0.004=-0.000
min0.135-0.130=0.005
max0.146-0.140=0.006
cache=y
dps=1
iters=10
policies=100
mean43.343-43.343=0.000
σ0.006-0.006=0.001
min43.334-43.335=-0.001
max43.357-43.352=0.005
mean414.600-418.000=-3.400
σ0.516-0.000=0.516
min414.000-418.000=-4.000
max415.000-418.000=-3.000
mean0.125-0.122=0.003
σ0.010-0.004=0.006
min0.115-0.116=-0.001
max0.142-0.129=0.013

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1017.198-1016.894=0.304
σ1.192-1.167=0.024
min1016.655-1016.349=0.306
max1022.196-1021.782=0.414
mean1052.850-1062.200=-9.350
σ310.326-313.378=-3.052
min562.000-589.000=-27.000
max1510.000-1638.000=-128.000
mean1.559-1.537=0.022
σ0.054-0.080=-0.026
min1.472-1.390=0.082
max1.658-1.753=-0.096

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean302.035-302.148=-0.113
σ0.248-0.216=0.033
min301.778-301.878=-0.100
max302.685-302.679=0.006
mean2042.000-2020.000=22.000
σ0.000
min2042.000-2020.000=22.000
max2042.000-2020.000=22.000
mean0.580-0.586=-0.006
σ0.041-0.026=0.015
min0.499-0.534=-0.034
max0.612-0.604=0.007

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.782-303.495=0.287
σ0.061-0.085=-0.024
min303.684-303.353=0.331
max303.836-303.570=0.267
mean1510.000-1638.000=-128.000
σ0.000
min1510.000-1638.000=-128.000
max1510.000-1638.000=-128.000
mean0.393-0.393=-0.000
σ0.001-0.004=-0.002
min0.392-0.391=0.001
max0.395-0.400=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1326.328-1326.045=0.283
σ0.106-0.093=0.013
min1326.199-1325.926=0.273
max1326.461-1326.164=0.298
mean1510.000-1638.000=-128.000
σ0.000
min1510.000-1638.000=-128.000
max1510.000-1638.000=-128.000
mean1.928-1.895=0.033
σ0.146-0.090=0.057
min1.791-1.780=0.011
max2.130-2.004=0.125
iters=5
new-facts=6402
prior-facts=1
mean1564.375-1564.145=0.231
σ6.912-6.880=0.032
min1561.081-1560.879=0.202
max1576.735-1576.448=0.287
mean1510.000-1638.000=-128.000
σ0.000
min1510.000-1638.000=-128.000
max1510.000-1638.000=-128.000
mean2.297-2.367=-0.070
σ0.261-0.252=0.009
min2.040-2.094=-0.053
max2.619-2.704=-0.086
iters=5
new-facts=6402
prior-facts=6402
mean1894.277-1894.006=0.270
σ0.068-0.068=0.000
min1894.156-1893.888=0.268
max1894.316-1894.055=0.261
mean1735.200-1767.200=-32.000
σ217.188-159.929=57.259
min1510.000-1638.000=-128.000
max2042.000-2020.000=22.000
mean2.947-2.988=-0.041
σ0.114-0.150=-0.036
min2.879-2.849=0.030
max3.150-3.211=-0.061

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.515-1.231=0.284
σ0.276-0.331=-0.055
min1.217-0.907=0.310
max1.810-1.777=0.034

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.051-444.703=3.347
σ581.227-575.141=6.086
min157.432-157.124=0.308
max1319.891-1307.415=12.476
mean96.250
σ8.500
min92.000
max109.000
mean1510.000-1638.000=-128.000
σ0.000
min1510.000-1638.000=-128.000
max1510.000-1638.000=-128.000
mean0.551-0.532=0.020
σ0.563-0.536=0.027
min0.266-0.260=0.006
max1.396-1.336=0.060
policies=20
mean1574.599-1571.524=3.076
σ0.358-0.334=0.024
min1574.367-1571.319=3.048
max1575.133-1572.023=3.110
mean920.000
σ0.000
min920.000
max920.000
mean1510.000-1638.000=-128.000
σ0.000
min1510.000-1638.000=-128.000
max1510.000-1638.000=-128.000
mean2.649-2.619=0.030
σ0.042-0.007=0.035
min2.611-2.609=0.002
max2.707-2.625=0.082
policies=200
mean15754.092-15723.224=30.868
σ0.048-0.110=-0.063
min15754.041-15723.073=30.968
max15754.148-15723.336=30.811
mean9200.000
σ0.000
min9200.000
max9200.000
mean1510.000-1638.000=-128.000
σ0.000
min1510.000-1638.000=-128.000
max1510.000-1638.000=-128.000
mean26.849-26.411=0.438
σ0.172-0.179=-0.007
min26.716-26.217=0.499
max27.089-26.602=0.488