Compare commits

Home / Compare c93c2f88 .. 2e4e9664

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.039-54.039=-0.001
σ0.369-0.370=-0.002
min53.897-53.894=0.003
max55.088-55.093=-0.005
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.139-0.138=0.001
σ0.004-0.006=-0.002
min0.132-0.128=0.004
max0.144-0.146=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.341-43.341=0.000
σ0.007-0.007=0.000
min43.333-43.328=0.004
max43.357-43.354=0.003
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.119-0.119=0.000
σ0.004-0.005=-0.000
min0.115-0.113=0.001
max0.126-0.128=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1017.204-1017.201=0.003
σ1.204-1.243=-0.039
min1016.662-1016.664=-0.002
max1022.233-1022.412=-0.179
mean1047.800-1057.450=-9.650
σ324.191-313.418=10.773
min543.000-562.000=-19.000
max1626.000-1517.000=109.000
mean1.599-1.558=0.041
σ0.142-0.150=-0.007
min1.483-1.468=0.015
max2.005-2.165=-0.160

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean302.147-301.899=0.248
σ0.168-0.219=-0.052
min302.048-301.743=0.305
max302.605-302.450=0.155
mean1910.000-2056.000=-146.000
σ0.000
min1910.000-2056.000=-146.000
max1910.000-2056.000=-146.000
mean0.605-0.596=0.009
σ0.048-0.012=0.037
min0.502-0.564=-0.062
max0.704-0.603=0.100

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.792-303.785=0.007
σ0.052-0.053=-0.001
min303.718-303.708=0.010
max303.851-303.844=0.007
mean1626.000-1517.000=109.000
σ0.000
min1626.000-1517.000=109.000
max1626.000-1517.000=109.000
mean0.392-0.390=0.001
σ0.001-0.001=-0.000
min0.391-0.389=0.001
max0.393-0.391=0.001
iters=5
new-facts=1
prior-facts=6402
mean1326.340-1326.335=0.005
σ0.112-0.108=0.004
min1326.198-1326.196=0.002
max1326.468-1326.458=0.009
mean1626.000-1517.000=109.000
σ0.000
min1626.000-1517.000=109.000
max1626.000-1517.000=109.000
mean1.905-1.941=-0.036
σ0.061-0.104=-0.043
min1.838-1.819=0.019
max1.979-2.026=-0.048
iters=5
new-facts=6402
prior-facts=1
mean1564.427-1564.416=0.011
σ6.865-6.876=-0.010
min1561.173-1561.168=0.005
max1576.704-1576.711=-0.008
mean1626.000-1517.000=109.000
σ0.000
min1626.000-1517.000=109.000
max1626.000-1517.000=109.000
mean2.352-2.354=-0.001
σ0.261-0.245=0.016
min1.974-2.061=-0.086
max2.605-2.670=-0.065
iters=5
new-facts=6402
prior-facts=6402
mean1894.275-1894.288=-0.013
σ0.067-0.075=-0.008
min1894.157-1894.157=0.000
max1894.320-1894.336=-0.017
mean1766.600-1769.400=-2.800
σ140.886-220.392=-79.507
min1626.000-1517.000=109.000
max1910.000-2056.000=-146.000
mean3.027-3.031=-0.004
σ0.111-0.117=-0.006
min2.877-2.883=-0.006
max3.181-3.203=-0.022

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.225-1.583=-0.359
σ0.300-0.357=-0.057
min0.929-1.136=-0.207
max1.626-1.867=-0.241

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.061-448.049=0.012
σ581.231-581.224=0.007
min157.434-157.434=-0.000
max1319.907-1319.885=0.022
mean96.250
σ8.500
min92.000
max109.000
mean1626.000-1517.000=109.000
σ0.000
min1626.000-1517.000=109.000
max1626.000-1517.000=109.000
mean0.540-0.532=0.007
σ0.554-0.541=0.013
min0.262-0.261=0.001
max1.370-1.343=0.027
policies=20
mean1574.622-1574.621=0.001
σ0.340-0.349=-0.009
min1574.423-1574.400=0.023
max1575.131-1575.142=-0.011
mean920.000
σ0.000
min920.000
max920.000
mean1626.000-1517.000=109.000
σ0.000
min1626.000-1517.000=109.000
max1626.000-1517.000=109.000
mean2.630-2.646=-0.016
σ0.010-0.071=-0.061
min2.620-2.605=0.014
max2.643-2.752=-0.109
policies=200
mean15754.250-15754.127=0.124
σ0.056-0.410=-0.354
min15754.199-15753.515=0.684
max15754.330-15754.380=-0.050
mean9200.000
σ0.000
min9200.000
max9200.000
mean1626.000-1517.000=109.000
σ0.000
min1626.000-1517.000=109.000
max1626.000-1517.000=109.000
mean26.683-26.542=0.141
σ0.228-0.126=0.102
min26.450-26.424=0.026
max26.933-26.716=0.217