Compare commits

Home / Compare 3e7efd16 .. 91c60908

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.837-53.822=0.015
σ0.369-0.368=0.001
min53.692-53.679=0.014
max54.886-54.870=0.016
mean422.000-417.000=5.000
σ0.000
min422.000-417.000=5.000
max422.000-417.000=5.000
mean0.138-0.139=-0.000
σ0.003-0.004=-0.001
min0.132-0.135=-0.003
max0.142-0.145=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.208-43.208=0.001
σ0.006-0.008=-0.003
min43.200-43.194=0.006
max43.220-43.219=0.000
mean422.000-417.000=5.000
σ0.000
min422.000-417.000=5.000
max422.000-417.000=5.000
mean0.119-0.120=-0.001
σ0.003-0.004=-0.001
min0.113-0.114=-0.001
max0.123-0.125=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.207-1016.179=0.028
σ1.168-1.171=-0.004
min1015.631-1015.616=0.015
max1021.095-1021.080=0.015
mean1053.600-1048.650=4.950
σ311.247-311.490=-0.242
min562.000-556.000=6.000
max1517.000-1514.000=3.000
mean1.537-1.569=-0.032
σ0.049-0.064=-0.014
min1.472-1.495=-0.023
max1.634-1.693=-0.059

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.222-301.372=-0.151
σ0.180-0.203=-0.024
min301.096-301.252=-0.156
max301.706-301.937=-0.231
mean2008.000-2032.000=-24.000
σ0.000
min2008.000-2032.000=-24.000
max2008.000-2032.000=-24.000
mean0.563-0.557=0.006
σ0.031-0.030=0.001
min0.500-0.510=-0.010
max0.605-0.600=0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean301.475-300.701=0.774
σ0.057-0.017=0.041
min301.383-300.684=0.700
max301.531-300.723=0.808
mean1517.000-1514.000=3.000
σ0.000
min1517.000-1514.000=3.000
max1517.000-1514.000=3.000
mean0.390-0.399=-0.008
σ0.001-0.006=-0.005
min0.389-0.391=-0.002
max0.391-0.404=-0.013
iters=5
new-facts=1
prior-facts=6402
mean1324.065-1322.873=1.192
σ0.113-0.089=0.024
min1323.925-1322.820=1.105
max1324.204-1323.027=1.176
mean1517.000-1514.000=3.000
σ0.000
min1517.000-1514.000=3.000
max1517.000-1514.000=3.000
mean1.872-1.887=-0.015
σ0.055-0.057=-0.002
min1.815-1.825=-0.010
max1.954-1.964=-0.010
iters=5
new-facts=6402
prior-facts=1
mean1562.072-1561.310=0.762
σ6.898-6.901=-0.003
min1558.755-1558.018=0.737
max1574.405-1573.649=0.756
mean1517.000-1514.000=3.000
σ0.000
min1517.000-1514.000=3.000
max1517.000-1514.000=3.000
mean2.262-2.345=-0.083
σ0.185-0.349=-0.164
min2.029-2.046=-0.018
max2.503-2.755=-0.252
iters=5
new-facts=6402
prior-facts=6402
mean1891.970-1890.788=1.182
σ0.066-0.015=0.050
min1891.854-1890.770=1.084
max1892.009-1890.810=1.199
mean1725.800-1735.200=-9.400
σ207.106-214.436=-7.330
min1517.000-1514.000=3.000
max2008.000-2032.000=-24.000
mean3.027-2.940=0.086
σ0.367-0.101=0.265
min2.816-2.871=-0.055
max3.680-3.117=0.563

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.476-1.547=-0.071
σ0.327-0.284=0.043
min1.049-1.228=-0.179
max1.787-1.826=-0.039

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.478-443.039=0.440
σ574.230-573.402=0.828
min156.362-156.334=0.028
max1304.824-1303.142=1.682
mean96.250
σ8.500
min92.000
max109.000
mean1517.000-1514.000=3.000
σ0.000
min1517.000-1514.000=3.000
max1517.000-1514.000=3.000
mean0.533-0.534=-0.001
σ0.549-0.544=0.005
min0.256-0.260=-0.004
max1.356-1.350=0.006
policies=20
mean1563.892-1563.607=0.285
σ0.346-0.337=0.009
min1563.675-1563.384=0.291
max1564.409-1564.110=0.299
mean920.000
σ0.000
min920.000
max920.000
mean1517.000-1514.000=3.000
σ0.000
min1517.000-1514.000=3.000
max1517.000-1514.000=3.000
mean2.625-2.619=0.006
σ0.010-0.007=0.003
min2.613-2.612=0.001
max2.636-2.627=0.009
policies=200
mean15646.948-15644.172=2.776
σ0.147-0.077=0.070
min15646.820-15644.105=2.714
max15647.093-15644.281=2.812
mean9200.000
σ0.000
min9200.000
max9200.000
mean1517.000-1514.000=3.000
σ0.000
min1517.000-1514.000=3.000
max1517.000-1514.000=3.000
mean26.497-26.547=-0.050
σ0.113-0.128=-0.015
min26.397-26.435=-0.038
max26.615-26.731=-0.116