Compare commits

Home / Compare 18aec7aa .. bf1ac47e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.971-53.969=0.001
σ0.368-0.368=-0.000
min53.826-53.829=-0.003
max55.017-55.017=0.000
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.137-0.137=0.000
σ0.005-0.006=-0.001
min0.132-0.130=0.001
max0.145-0.147=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.343-43.343=0.000
σ0.007-0.006=0.001
min43.333-43.335=-0.002
max43.356-43.356=-0.000
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.122-0.124=-0.002
σ0.004-0.004=-0.000
min0.118-0.120=-0.002
max0.128-0.131=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.894-1016.892=0.002
σ1.173-1.164=0.010
min1016.333-1016.322=0.011
max1021.808-1021.766=0.041
mean1063.600-1058.800=4.800
σ317.221-311.436=5.785
min604.000-589.000=15.000
max1630.000-1617.000=13.000
mean1.556-1.550=0.006
σ0.060-0.059=0.001
min1.478-1.451=0.027
max1.697-1.667=0.029

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.890-301.955=-0.065
σ0.252-0.200=0.051
min301.674-301.821=-0.147
max302.588-302.511=0.077
mean2023.000-1939.000=84.000
σ0.000
min2023.000-1939.000=84.000
max2023.000-1939.000=84.000
mean0.527-0.594=-0.067
σ0.028-0.040=-0.012
min0.505-0.543=-0.038
max0.590-0.670=-0.081

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.514-303.515=-0.001
σ0.047-0.057=-0.009
min303.448-303.420=0.028
max303.566-303.560=0.005
mean1630.000-1617.000=13.000
σ0.000
min1630.000-1617.000=13.000
max1630.000-1617.000=13.000
mean0.393-0.394=-0.001
σ0.001-0.001=0.001
min0.391-0.393=-0.002
max0.395-0.395=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1326.081-1326.057=0.024
σ0.112-0.109=0.003
min1325.957-1325.923=0.034
max1326.258-1326.208=0.050
mean1630.000-1617.000=13.000
σ0.000
min1630.000-1617.000=13.000
max1630.000-1617.000=13.000
mean2.067-1.921=0.146
σ0.206-0.092=0.114
min1.841-1.827=0.013
max2.299-2.016=0.283
iters=5
new-facts=6402
prior-facts=1
mean1564.147-1564.113=0.034
σ6.912-6.922=-0.010
min1560.878-1560.758=0.120
max1576.508-1576.489=0.020
mean1630.000-1617.000=13.000
σ0.000
min1630.000-1617.000=13.000
max1630.000-1617.000=13.000
mean2.289-2.360=-0.072
σ0.291-0.318=-0.027
min1.969-2.133=-0.164
max2.765-2.798=-0.033
iters=5
new-facts=6402
prior-facts=6402
mean1894.009-1894.011=-0.002
σ0.073-0.069=0.003
min1893.881-1893.889=-0.008
max1894.063-1894.055=0.007
mean1760.600-1774.200=-13.600
σ168.760-161.224=7.536
min1630.000-1617.000=13.000
max2023.000-1939.000=84.000
mean3.016-2.985=0.031
σ0.190-0.185=0.005
min2.880-2.727=0.153
max3.294-3.207=0.087

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.184-1.199=-0.015
σ0.198-0.262=-0.064
min1.041-0.927=0.113
max1.509-1.591=-0.082

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.703-444.704=-0.001
σ575.144-575.146=-0.002
min157.130-157.124=0.006
max1307.418-1307.422=-0.004
mean96.250
σ8.500
min92.000
max109.000
mean1630.000-1617.000=13.000
σ0.000
min1630.000-1617.000=13.000
max1630.000-1617.000=13.000
mean0.531-0.555=-0.024
σ0.529-0.567=-0.038
min0.265-0.265=-0.000
max1.325-1.406=-0.081
policies=20
mean1571.543-1571.553=-0.010
σ0.347-0.346=0.002
min1571.338-1571.338=-0.000
max1572.063-1572.070=-0.007
mean920.000
σ0.000
min920.000
max920.000
mean1630.000-1617.000=13.000
σ0.000
min1630.000-1617.000=13.000
max1630.000-1617.000=13.000
mean2.648-2.642=0.007
σ0.012-0.013=-0.001
min2.636-2.629=0.008
max2.661-2.653=0.008
policies=200
mean15723.284-15723.363=-0.079
σ0.113-0.105=0.008
min15723.117-15723.246=-0.130
max15723.356-15723.484=-0.129
mean9200.000
σ0.000
min9200.000
max9200.000
mean1630.000-1617.000=13.000
σ0.000
min1630.000-1617.000=13.000
max1630.000-1617.000=13.000
mean26.730-26.801=-0.071
σ0.100-0.158=-0.058
min26.625-26.602=0.023
max26.830-26.971=-0.141