Compare commits

Home / Compare 02ce8f80 .. 468197fe

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.654-53.653=0.000
σ0.369-0.367=0.002
min53.509-53.519=-0.010
max54.702-54.698=0.004
mean417.000-419.000=-2.000
σ0.000
min417.000-419.000=-2.000
max417.000-419.000=-2.000
mean0.136-0.135=0.001
σ0.004-0.004=-0.000
min0.131-0.130=0.001
max0.142-0.141=0.001
cache=y
dps=1
iters=10
policies=100
mean42.979-42.981=-0.002
σ0.006-0.006=0.000
min42.969-42.974=-0.005
max42.992-42.995=-0.003
mean417.000-419.000=-2.000
σ0.000
min417.000-419.000=-2.000
max417.000-419.000=-2.000
mean0.121-0.122=-0.001
σ0.003-0.005=-0.002
min0.118-0.118=0.000
max0.127-0.134=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.978-1013.973=0.005
σ1.159-1.207=-0.049
min1013.422-1013.428=-0.006
max1018.821-1019.028=-0.207
mean1051.150-1051.700=-0.550
σ319.572-314.062=5.510
min600.000-603.000=-3.000
max1660.000-1652.000=8.000
mean1.595-1.640=-0.045
σ0.072-0.075=-0.002
min1.527-1.550=-0.023
max1.826-1.835=-0.009

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.315-299.287=0.028
σ0.221-0.240=-0.019
min299.131-299.050=0.081
max299.922-299.919=0.003
mean2049.000-1952.000=97.000
σ0.000
min2049.000-1952.000=97.000
max2049.000-1952.000=97.000
mean0.592-0.573=0.019
σ0.020-0.022=-0.002
min0.553-0.539=0.013
max0.617-0.597=0.020

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.682-294.684=-0.002
σ0.015-0.013=0.003
min294.660-294.667=-0.007
max294.703-294.703=0.001
mean1660.000-1652.000=8.000
σ0.000
min1660.000-1652.000=8.000
max1660.000-1652.000=8.000
mean0.376-0.389=-0.012
σ0.005-0.006=-0.001
min0.373-0.382=-0.008
max0.385-0.395=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1316.942-1316.940=0.002
σ0.102-0.093=0.009
min1316.881-1316.882=-0.001
max1317.122-1317.105=0.017
mean1660.000-1652.000=8.000
σ0.000
min1660.000-1652.000=8.000
max1660.000-1652.000=8.000
mean1.975-1.929=0.046
σ0.094-0.052=0.042
min1.878-1.866=0.011
max2.117-2.000=0.118
iters=5
new-facts=6402
prior-facts=1
mean1555.285-1555.311=-0.026
σ6.877-6.854=0.023
min1551.979-1552.006=-0.027
max1567.581-1567.566=0.016
mean1660.000-1652.000=8.000
σ0.000
min1660.000-1652.000=8.000
max1660.000-1652.000=8.000
mean2.270-2.360=-0.090
σ0.307-0.182=0.125
min2.104-2.112=-0.009
max2.817-2.601=0.216
iters=5
new-facts=6402
prior-facts=6402
mean1884.773-1884.782=-0.009
σ0.024-0.033=-0.008
min1884.742-1884.758=-0.017
max1884.799-1884.838=-0.039
mean1796.000-1780.200=15.800
σ168.925-110.484=58.441
min1660.000-1652.000=8.000
max2049.000-1952.000=97.000
mean2.954-2.960=-0.006
σ0.148-0.110=0.038
min2.748-2.879=-0.130
max3.134-3.087=0.047

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.177-1.206=-0.028
σ0.358-0.374=-0.016
min0.915-0.921=-0.006
max1.771-1.843=-0.072

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.684-440.680=0.004
σ573.411-573.414=-0.003
min153.973-153.967=0.007
max1300.800-1300.801=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1660.000-1652.000=8.000
σ0.000
min1660.000-1652.000=8.000
max1660.000-1652.000=8.000
mean0.548-0.545=0.003
σ0.563-0.564=-0.001
min0.261-0.263=-0.002
max1.392-1.391=0.001
policies=20
mean1539.914-1539.904=0.011
σ0.313-0.306=0.008
min1539.739-1539.724=0.015
max1540.384-1540.361=0.023
mean920.000
σ0.000
min920.000
max920.000
mean1660.000-1652.000=8.000
σ0.000
min1660.000-1652.000=8.000
max1660.000-1652.000=8.000
mean2.605-2.608=-0.003
σ0.028-0.020=0.008
min2.569-2.584=-0.015
max2.637-2.630=0.007
policies=200
mean15406.590-15406.969=-0.379
σ0.603-0.163=0.440
min15405.687-15406.829=-1.142
max15406.927-15407.180=-0.253
mean9200.000
σ0.000
min9200.000
max9200.000
mean1660.000-1652.000=8.000
σ0.000
min1660.000-1652.000=8.000
max1660.000-1652.000=8.000
mean26.265-26.352=-0.087
σ0.127-0.087=0.040
min26.112-26.259=-0.147
max26.407-26.436=-0.029