Compare commits

Home / Compare 8d3da6dd .. ea987b0f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.039-54.041=-0.002
σ0.368-0.368=0.000
min53.900-53.895=0.004
max55.087-55.088=-0.002
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.141-0.149=-0.008
σ0.003-0.012=-0.008
min0.139-0.136=0.003
max0.148-0.166=-0.018
cache=y
dps=1
iters=10
policies=100
mean43.341-43.347=-0.006
σ0.006-0.007=-0.001
min43.335-43.335=-0.001
max43.353-43.358=-0.005
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.121-0.137=-0.016
σ0.004-0.007=-0.003
min0.115-0.121=-0.006
max0.127-0.148=-0.020

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1017.203-1017.208=-0.006
σ1.177-1.189=-0.012
min1016.657-1016.660=-0.002
max1022.128-1022.190=-0.062
mean1046.650-1052.400=-5.750
σ304.946-304.811=0.134
min569.000-574.000=-5.000
max1635.000-1640.000=-5.000
mean1.605-1.573=0.032
σ0.099-0.080=0.019
min1.506-1.492=0.015
max1.860-1.825=0.036

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean302.037-301.877=0.160
σ0.221-0.197=0.024
min301.842-301.717=0.125
max302.613-302.404=0.209
mean2026.000-2063.000=-37.000
σ0.000
min2026.000-2063.000=-37.000
max2026.000-2063.000=-37.000
mean0.601-0.594=0.007
σ0.009-0.019=-0.010
min0.584-0.559=0.025
max0.619-0.626=-0.008

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.785-303.775=0.009
σ0.047-0.076=-0.030
min303.712-303.650=0.062
max303.841-303.848=-0.007
mean1635.000-1640.000=-5.000
σ0.000
min1635.000-1640.000=-5.000
max1635.000-1640.000=-5.000
mean0.393-0.395=-0.002
σ0.002-0.003=-0.001
min0.391-0.392=-0.001
max0.395-0.399=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1326.340-1326.323=0.017
σ0.111-0.097=0.014
min1326.204-1326.197=0.006
max1326.471-1326.446=0.026
mean1635.000-1640.000=-5.000
σ0.000
min1635.000-1640.000=-5.000
max1635.000-1640.000=-5.000
mean1.937-1.898=0.039
σ0.096-0.066=0.030
min1.839-1.837=0.002
max2.038-1.987=0.051
iters=5
new-facts=6402
prior-facts=1
mean1564.476-1564.412=0.064
σ6.870-6.918=-0.048
min1561.242-1561.117=0.124
max1576.761-1576.783=-0.022
mean1635.000-1640.000=-5.000
σ0.000
min1635.000-1640.000=-5.000
max1635.000-1640.000=-5.000
mean2.469-2.399=0.070
σ0.319-0.348=-0.029
min2.070-2.045=0.026
max2.798-2.794=0.004
iters=5
new-facts=6402
prior-facts=6402
mean1894.278-1894.275=0.003
σ0.066-0.065=0.001
min1894.163-1894.162=0.001
max1894.328-1894.324=0.004
mean1785.200-1782.800=2.400
σ171.523-177.267=-5.744
min1635.000-1640.000=-5.000
max2026.000-2063.000=-37.000
mean3.046-2.981=0.065
σ0.123-0.131=-0.008
min2.872-2.879=-0.006
max3.188-3.132=0.056

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.218-1.261=-0.043
σ0.257-0.375=-0.118
min0.954-0.946=0.008
max1.534-1.898=-0.364

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.059-448.060=-0.000
σ581.232-581.235=-0.003
min157.438-157.435=0.003
max1319.908-1319.913=-0.006
mean96.250
σ8.500
min92.000
max109.000
mean1635.000-1640.000=-5.000
σ0.000
min1635.000-1640.000=-5.000
max1635.000-1640.000=-5.000
mean0.525-0.532=-0.007
σ0.510-0.522=-0.012
min0.266-0.267=-0.001
max1.289-1.314=-0.025
policies=20
mean1574.615-1574.630=-0.015
σ0.342-0.349=-0.007
min1574.415-1574.416=-0.001
max1575.127-1575.152=-0.025
mean920.000
σ0.000
min920.000
max920.000
mean1635.000-1640.000=-5.000
σ0.000
min1635.000-1640.000=-5.000
max1635.000-1640.000=-5.000
mean2.641-2.646=-0.005
σ0.006-0.004=0.002
min2.635-2.642=-0.007
max2.647-2.649=-0.003
policies=200
mean15754.278-15754.343=-0.065
σ0.127-0.085=0.042
min15754.140-15754.229=-0.089
max15754.417-15754.429=-0.012
mean9200.000
σ0.000
min9200.000
max9200.000
mean1635.000-1640.000=-5.000
σ0.000
min1635.000-1640.000=-5.000
max1635.000-1640.000=-5.000
mean26.910-26.876=0.034
σ0.196-0.262=-0.067
min26.703-26.649=0.054
max27.105-27.126=-0.021