Compare commits

Home / Compare 94e4977c .. 9c53e2de

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.822-53.655=0.167
σ0.369-0.367=0.002
min53.679-53.519=0.160
max54.872-54.700=0.173
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.137-0.139=-0.002
σ0.004-0.003=0.001
min0.131-0.137=-0.006
max0.144-0.145=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.209-42.983=0.226
σ0.006-0.004=0.003
min43.196-42.977=0.219
max43.220-42.988=0.232
mean417.000-416.000=1.000
σ0.000
min417.000-416.000=1.000
max417.000-416.000=1.000
mean0.127-0.128=-0.001
σ0.008-0.010=-0.002
min0.119-0.117=0.002
max0.141-0.140=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.181-1013.972=2.208
σ1.138-1.196=-0.059
min1015.606-1013.433=2.172
max1020.928-1018.979=1.949
mean1053.850-1054.650=-0.800
σ319.068-317.362=1.705
min548.000-554.000=-6.000
max1677.000-1524.000=153.000
mean1.573-1.616=-0.043
σ0.090-0.056=0.034
min1.460-1.548=-0.088
max1.829-1.735=0.094

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.426-299.169=2.257
σ0.210-0.217=-0.008
min301.237-299.007=2.230
max301.980-299.753=2.227
mean1952.000-1935.000=17.000
σ0.000
min1952.000-1935.000=17.000
max1952.000-1935.000=17.000
mean0.563-0.602=-0.040
σ0.032-0.045=-0.013
min0.513-0.549=-0.036
max0.600-0.700=-0.100

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.680-294.680=6.000
σ0.049-0.020=0.030
min300.595-294.655=5.941
max300.720-294.710=6.009
mean1677.000-1524.000=153.000
σ0.000
min1677.000-1524.000=153.000
max1677.000-1524.000=153.000
mean0.400-0.383=0.018
σ0.012-0.010=0.002
min0.389-0.374=0.014
max0.417-0.393=0.024
iters=5
new-facts=1
prior-facts=6402
mean1322.858-1316.957=5.901
σ0.092-0.102=-0.010
min1322.800-1316.895=5.905
max1323.023-1317.136=5.887
mean1677.000-1524.000=153.000
σ0.000
min1677.000-1524.000=153.000
max1677.000-1524.000=153.000
mean1.947-1.926=0.021
σ0.079-0.040=0.039
min1.833-1.871=-0.038
max2.028-1.979=0.048
iters=5
new-facts=6402
prior-facts=1
mean1561.312-1555.308=6.004
σ6.895-6.845=0.050
min1557.977-1551.992=5.986
max1573.639-1567.545=6.094
mean1677.000-1524.000=153.000
σ0.000
min1677.000-1524.000=153.000
max1677.000-1524.000=153.000
mean2.343-2.327=0.017
σ0.299-0.210=0.089
min2.026-2.083=-0.057
max2.707-2.653=0.054
iters=5
new-facts=6402
prior-facts=6402
mean1890.796-1884.780=6.016
σ0.020-0.024=-0.004
min1890.777-1884.749=6.028
max1890.830-1884.814=6.015
mean1787.800-1750.400=37.400
σ104.119-186.316=-82.198
min1677.000-1524.000=153.000
max1952.000-1935.000=17.000
mean2.960-3.058=-0.098
σ0.075-0.214=-0.139
min2.881-2.865=0.015
max3.041-3.425=-0.384

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.035-1.519=-0.484
σ0.168-0.291=-0.124
min0.902-1.192=-0.290
max1.235-1.838=-0.602

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.053-440.671=2.382
σ573.405-573.405=0.000
min156.346-153.964=2.382
max1303.161-1300.778=2.383
mean96.250
σ8.500
min92.000
max109.000
mean1677.000-1524.000=153.000
σ0.000
min1677.000-1524.000=153.000
max1677.000-1524.000=153.000
mean0.543-0.561=-0.017
σ0.552-0.579=-0.027
min0.265-0.270=-0.005
max1.371-1.429=-0.057
policies=20
mean1563.633-1539.881=23.751
σ0.338-0.313=0.025
min1563.444-1539.669=23.775
max1564.139-1540.348=23.792
mean920.000
σ0.000
min920.000
max920.000
mean1677.000-1524.000=153.000
σ0.000
min1677.000-1524.000=153.000
max1677.000-1524.000=153.000
mean2.631-2.590=0.040
σ0.025-0.022=0.003
min2.601-2.566=0.035
max2.661-2.618=0.043
policies=200
mean15644.164-15406.973=237.191
σ0.066-0.100=-0.034
min15644.080-15406.880=237.200
max15644.230-15407.088=237.142
mean9200.000
σ0.000
min9200.000
max9200.000
mean1677.000-1524.000=153.000
σ0.000
min1677.000-1524.000=153.000
max1677.000-1524.000=153.000
mean26.690-26.168=0.521
σ0.275-0.122=0.152
min26.414-26.019=0.395
max27.031-26.277=0.754