Compare commits

Home / Compare 997c38a9 .. 2e00c7ef

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.403-54.152=-0.748
σ0.368-0.366=0.002
min53.266-54.010=-0.744
max54.451-55.194=-0.744
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.135-0.139=-0.003
σ0.006-0.003=0.003
min0.129-0.136=-0.007
max0.145-0.144=0.001
cache=y
dps=1
iters=10
policies=100
mean42.791-43.540=-0.749
σ0.006-0.006=-0.000
min42.782-43.531=-0.750
max42.801-43.548=-0.746
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.120-0.122=-0.002
σ0.003-0.004=-0.001
min0.117-0.118=-0.001
max0.126-0.130=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1014.180-1014.178=0.002
σ1.179-1.185=-0.006
min1013.639-1013.641=-0.002
max1019.117-1019.138=-0.020
mean1049.850-1063.150=-13.300
σ316.977-322.393=-5.416
min598.000-554.000=44.000
max1660.000-1531.000=129.000
mean1.630-1.628=0.002
σ0.082-0.058=0.024
min1.467-1.552=-0.086
max1.872-1.749=0.124

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.288-299.268=0.020
σ0.231-0.231=-0.001
min299.103-299.097=0.007
max299.924-299.901=0.023
mean1951.000-1961.000=-10.000
σ0.000
min1951.000-1961.000=-10.000
max1951.000-1961.000=-10.000
mean0.564-0.544=0.020
σ0.056-0.041=0.015
min0.496-0.493=0.002
max0.682-0.587=0.095

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean295.204-295.228=-0.023
σ0.013-0.020=-0.007
min295.191-295.206=-0.015
max295.225-295.257=-0.033
mean1660.000-1531.000=129.000
σ0.000
min1660.000-1531.000=129.000
max1660.000-1531.000=129.000
mean0.385-0.387=-0.002
σ0.005-0.006=-0.000
min0.382-0.381=0.000
max0.394-0.394=0.000
iters=5
new-facts=1
prior-facts=6402
mean1317.497-1317.502=-0.005
σ0.099-0.098=0.001
min1317.445-1317.442=0.003
max1317.674-1317.676=-0.001
mean1660.000-1531.000=129.000
σ0.000
min1660.000-1531.000=129.000
max1660.000-1531.000=129.000
mean1.956-1.886=0.070
σ0.074-0.069=0.006
min1.886-1.811=0.075
max2.079-1.971=0.108
iters=5
new-facts=6402
prior-facts=1
mean1555.833-1555.838=-0.005
σ6.824-6.862=-0.038
min1552.510-1552.514=-0.004
max1568.032-1568.105=-0.073
mean1660.000-1531.000=129.000
σ0.000
min1660.000-1531.000=129.000
max1660.000-1531.000=129.000
mean2.272-2.332=-0.061
σ0.168-0.262=-0.094
min2.087-2.059=0.028
max2.446-2.650=-0.205
iters=5
new-facts=6402
prior-facts=6402
mean1885.324-1885.330=-0.006
σ0.016-0.021=-0.005
min1885.312-1885.310=0.002
max1885.351-1885.366=-0.015
mean1794.600-1772.200=22.400
σ147.527-149.936=-2.408
min1660.000-1545.000=115.000
max1951.000-1961.000=-10.000
mean3.119-2.967=0.152
σ0.329-0.104=0.226
min2.877-2.872=0.005
max3.694-3.134=0.560

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.084-1.507=-0.423
σ0.193-0.315=-0.123
min0.907-1.124=-0.216
max1.338-1.840=-0.502

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.867-440.862=0.005
σ573.398-573.407=-0.009
min154.159-154.153=0.006
max1300.964-1300.973=-0.008
mean96.250
σ8.500
min92.000
max109.000
mean1660.000-1531.000=129.000
σ0.000
min1660.000-1531.000=129.000
max1660.000-1531.000=129.000
mean0.537-0.535=0.002
σ0.539-0.550=-0.010
min0.265-0.259=0.006
max1.345-1.359=-0.014
policies=20
mean1541.832-1541.788=0.044
σ0.318-0.325=-0.007
min1541.653-1541.583=0.069
max1542.308-1542.273=0.036
mean920.000
σ0.000
min920.000
max920.000
mean1660.000-1531.000=129.000
σ0.000
min1660.000-1531.000=129.000
max1660.000-1531.000=129.000
mean2.610-2.605=0.006
σ0.035-0.014=0.021
min2.571-2.594=-0.023
max2.655-2.624=0.031
policies=200
mean15425.991-15426.029=-0.038
σ0.077-0.120=-0.043
min15425.890-15425.881=0.009
max15426.068-15426.170=-0.102
mean9200.000
σ0.000
min9200.000
max9200.000
mean1660.000-1531.000=129.000
σ0.000
min1660.000-1531.000=129.000
max1660.000-1531.000=129.000
mean26.175-26.315=-0.140
σ0.163-0.136=0.027
min26.029-26.158=-0.129
max26.375-26.462=-0.087