Compare commits

Home / Compare 42a633e9 .. 319a8bf5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.040-54.039=0.001
σ0.369-0.369=0.001
min53.897-53.894=0.004
max55.090-55.088=0.003
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.140-0.139=0.001
σ0.005-0.003=0.002
min0.136-0.136=0.000
max0.151-0.144=0.008
cache=y
dps=1
iters=10
policies=100
mean43.341-43.343=-0.002
σ0.006-0.007=-0.001
min43.333-43.331=0.002
max43.353-43.354=-0.001
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.121-0.123=-0.002
σ0.002-0.003=-0.001
min0.120-0.120=0.000
max0.127-0.127=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1017.203-1017.204=-0.002
σ1.178-1.180=-0.002
min1016.657-1016.652=0.005
max1022.137-1022.144=-0.007
mean1056.700-1051.650=5.050
σ312.613-308.027=4.587
min576.000-569.000=7.000
max1627.000-1513.000=114.000
mean1.551-1.557=-0.007
σ0.042-0.056=-0.013
min1.490-1.498=-0.007
max1.646-1.711=-0.066

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean302.159-301.944=0.215
σ0.195-0.157=0.038
min301.973-301.842=0.131
max302.646-302.367=0.279
mean2056.000-2026.000=30.000
σ0.000
min2056.000-2026.000=30.000
max2056.000-2026.000=30.000
mean0.593-0.597=-0.004
σ0.028-0.012=0.016
min0.517-0.577=-0.060
max0.611-0.612=-0.001

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.794-303.783=0.011
σ0.039-0.065=-0.026
min303.744-303.679=0.065
max303.843-303.845=-0.001
mean1627.000-1513.000=114.000
σ0.000
min1627.000-1513.000=114.000
max1627.000-1513.000=114.000
mean0.392-0.400=-0.008
σ0.001-0.012=-0.011
min0.391-0.389=0.001
max0.393-0.413=-0.021
iters=5
new-facts=1
prior-facts=6402
mean1326.334-1326.334=0.000
σ0.101-0.109=-0.008
min1326.202-1326.200=0.002
max1326.453-1326.474=-0.021
mean1627.000-1513.000=114.000
σ0.000
min1627.000-1513.000=114.000
max1627.000-1513.000=114.000
mean1.946-1.919=0.026
σ0.154-0.086=0.068
min1.818-1.831=-0.014
max2.152-2.033=0.118
iters=5
new-facts=6402
prior-facts=1
mean1564.401-1564.391=0.010
σ6.899-6.926=-0.027
min1561.143-1561.083=0.060
max1576.738-1576.775=-0.037
mean1627.000-1513.000=114.000
σ0.000
min1627.000-1513.000=114.000
max1627.000-1513.000=114.000
mean2.345-2.304=0.041
σ0.311-0.209=0.102
min2.061-2.056=0.006
max2.709-2.623=0.085
iters=5
new-facts=6402
prior-facts=6402
mean1894.287-1894.284=0.003
σ0.081-0.070=0.011
min1894.149-1894.160=-0.011
max1894.350-1894.333=0.017
mean1774.200-1755.200=19.000
σ179.730-210.349=-30.619
min1627.000-1513.000=114.000
max2056.000-2026.000=30.000
mean2.951-3.028=-0.077
σ0.201-0.124=0.078
min2.725-2.892=-0.166
max3.266-3.220=0.046

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.154-1.558=-0.404
σ0.189-0.232=-0.042
min0.945-1.268=-0.323
max1.428-1.793=-0.365

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.057-448.049=0.008
σ581.234-581.224=0.010
min157.434-157.435=-0.001
max1319.908-1319.886=0.022
mean96.250
σ8.500
min92.000
max109.000
mean1627.000-1513.000=114.000
σ0.000
min1627.000-1513.000=114.000
max1627.000-1513.000=114.000
mean0.535-0.561=-0.026
σ0.536-0.594=-0.058
min0.265-0.263=0.001
max1.339-1.452=-0.113
policies=20
mean1574.616-1574.624=-0.008
σ0.336-0.354=-0.018
min1574.437-1574.389=0.047
max1575.119-1575.151=-0.032
mean920.000
σ0.000
min920.000
max920.000
mean1627.000-1513.000=114.000
σ0.000
min1627.000-1513.000=114.000
max1627.000-1513.000=114.000
mean2.642-2.639=0.003
σ0.010-0.019=-0.009
min2.627-2.612=0.015
max2.651-2.655=-0.004
policies=200
mean15754.241-15754.292=-0.051
σ0.184-0.053=0.131
min15754.089-15754.251=-0.163
max15754.468-15754.364=0.104
mean9200.000
σ0.000
min9200.000
max9200.000
mean1627.000-1513.000=114.000
σ0.000
min1627.000-1513.000=114.000
max1627.000-1513.000=114.000
mean26.826-26.772=0.054
σ0.087-0.112=-0.026
min26.732-26.671=0.061
max26.907-26.922=-0.015