Compare commits

Home / Compare fdf1c4c6 .. fd5c164d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.972-53.973=-0.001
σ0.369-0.370=-0.001
min53.828-53.834=-0.006
max55.021-55.027=-0.005
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.140-0.141=-0.002
σ0.004-0.010=-0.005
min0.135-0.135=0.000
max0.146-0.167=-0.021
cache=y
dps=1
iters=10
policies=100
mean43.342-43.342=-0.000
σ0.007-0.007=0.001
min43.328-43.334=-0.006
max43.357-43.356=0.001
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.121-0.118=0.002
σ0.004-0.003=0.001
min0.114-0.112=0.002
max0.127-0.121=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.896-1016.894=0.002
σ1.151-1.154=-0.003
min1016.321-1016.322=-0.001
max1021.710-1021.728=-0.018
mean1065.750-1058.000=7.750
σ318.418-310.965=7.453
min605.000-589.000=16.000
max1637.000-1617.000=20.000
mean1.522-1.511=0.011
σ0.053-0.055=-0.001
min1.464-1.418=0.046
max1.604-1.628=-0.024

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean302.033-302.027=0.006
σ0.209-0.251=-0.042
min301.862-301.874=-0.011
max302.609-302.725=-0.116
mean2038.000-2048.000=-10.000
σ0.000
min2038.000-2048.000=-10.000
max2038.000-2048.000=-10.000
mean0.602-0.602=-0.000
σ0.004-0.009=-0.005
min0.595-0.582=0.013
max0.607-0.613=-0.006

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.493-303.521=-0.028
σ0.088-0.039=0.049
min303.352-303.478=-0.126
max303.581-303.569=0.012
mean1637.000-1617.000=20.000
σ0.000
min1637.000-1617.000=20.000
max1637.000-1617.000=20.000
mean0.390-0.389=0.000
σ0.002-0.000=0.001
min0.387-0.389=-0.002
max0.391-0.390=0.001
iters=5
new-facts=1
prior-facts=6402
mean1326.061-1326.060=0.001
σ0.107-0.111=-0.004
min1325.927-1325.925=0.002
max1326.192-1326.203=-0.011
mean1637.000-1617.000=20.000
σ0.000
min1637.000-1617.000=20.000
max1637.000-1617.000=20.000
mean1.897-1.930=-0.033
σ0.061-0.077=-0.016
min1.836-1.842=-0.007
max1.969-2.005=-0.036
iters=5
new-facts=6402
prior-facts=1
mean1564.113-1564.104=0.009
σ6.905-6.920=-0.015
min1560.826-1560.771=0.055
max1576.460-1576.477=-0.017
mean1637.000-1617.000=20.000
σ0.000
min1637.000-1617.000=20.000
max1637.000-1617.000=20.000
mean2.298-2.263=0.036
σ0.241-0.246=-0.005
min2.079-2.129=-0.050
max2.603-2.698=-0.095
iters=5
new-facts=6402
prior-facts=6402
mean1894.006-1894.002=0.004
σ0.065-0.074=-0.008
min1893.893-1893.871=0.022
max1894.050-1894.043=0.007
mean1776.000-1768.200=7.800
σ171.183-180.421=-9.238
min1637.000-1617.000=20.000
max2038.000-2048.000=-10.000
mean2.918-2.996=-0.078
σ0.060-0.227=-0.168
min2.883-2.737=0.145
max3.025-3.345=-0.320

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.197-1.268=-0.071
σ0.324-0.276=0.048
min0.913-1.051=-0.138
max1.705-1.729=-0.024

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.706-444.710=-0.005
σ575.143-575.146=-0.004
min157.130-157.135=-0.005
max1307.420-1307.430=-0.010
mean96.250
σ8.500
min92.000
max109.000
mean1637.000-1617.000=20.000
σ0.000
min1637.000-1617.000=20.000
max1637.000-1617.000=20.000
mean0.548-0.534=0.013
σ0.552-0.534=0.019
min0.264-0.263=0.001
max1.376-1.335=0.041
policies=20
mean1571.512-1571.555=-0.042
σ0.264-0.345=-0.081
min1571.356-1571.346=0.010
max1571.908-1572.070=-0.163
mean920.000
σ0.000
min920.000
max920.000
mean1637.000-1617.000=20.000
σ0.000
min1637.000-1617.000=20.000
max1637.000-1617.000=20.000
mean2.611-2.635=-0.024
σ0.014-0.014=-0.000
min2.593-2.617=-0.025
max2.622-2.652=-0.030
policies=200
mean15723.175-15723.336=-0.160
σ0.219-0.089=0.130
min15722.914-15723.238=-0.324
max15723.444-15723.453=-0.009
mean9200.000
σ0.000
min9200.000
max9200.000
mean1637.000-1617.000=20.000
σ0.000
min1637.000-1617.000=20.000
max1637.000-1617.000=20.000
mean26.510-26.576=-0.066
σ0.144-0.081=0.064
min26.349-26.480=-0.130
max26.651-26.674=-0.023