Compare commits

Home / Compare 8e63d7cd .. afb18f9d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.823-53.823=0.001
σ0.367-0.368=-0.001
min53.678-53.676=0.001
max54.867-54.869=-0.002
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.138-0.138=0.001
σ0.004-0.003=0.001
min0.134-0.135=-0.001
max0.145-0.143=0.002
cache=y
dps=1
iters=10
policies=100
mean43.208-43.208=-0.000
σ0.007-0.006=0.001
min43.199-43.202=-0.003
max43.219-43.219=-0.001
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.120-0.120=0.000
σ0.004-0.005=-0.001
min0.114-0.113=0.002
max0.126-0.129=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.174-1016.180=-0.006
σ1.194-1.150=0.043
min1015.628-1015.603=0.025
max1021.180-1020.982=0.198
mean1042.300-1062.450=-20.150
σ303.959-307.497=-3.538
min586.000-601.000=-15.000
max1654.000-1537.000=117.000
mean1.543-1.541=0.001
σ0.100-0.051=0.049
min1.459-1.475=-0.016
max1.817-1.635=0.182

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.343-301.332=0.011
σ0.216-0.226=-0.010
min301.116-301.128=-0.012
max301.890-301.906=-0.016
mean1947.000-2020.000=-73.000
σ0.000
min1947.000-2020.000=-73.000
max1947.000-2020.000=-73.000
mean0.552-0.580=-0.028
σ0.038-0.030=0.007
min0.500-0.503=-0.003
max0.594-0.610=-0.016

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.704-300.696=0.009
σ0.023-0.022=0.000
min300.677-300.662=0.014
max300.736-300.720=0.016
mean1654.000-1537.000=117.000
σ0.000
min1654.000-1537.000=117.000
max1654.000-1537.000=117.000
mean0.397-0.396=0.001
σ0.009-0.008=0.002
min0.390-0.389=0.001
max0.412-0.406=0.007
iters=5
new-facts=1
prior-facts=6402
mean1322.867-1322.857=0.009
σ0.104-0.084=0.020
min1322.786-1322.816=-0.030
max1323.040-1323.007=0.033
mean1654.000-1537.000=117.000
σ0.000
min1654.000-1537.000=117.000
max1654.000-1537.000=117.000
mean1.916-1.919=-0.003
σ0.125-0.089=0.036
min1.747-1.822=-0.074
max2.045-2.004=0.041
iters=5
new-facts=6402
prior-facts=1
mean1561.294-1561.339=-0.045
σ6.868-6.848=0.021
min1557.979-1558.029=-0.050
max1573.575-1573.583=-0.008
mean1654.000-1537.000=117.000
σ0.000
min1654.000-1537.000=117.000
max1654.000-1537.000=117.000
mean2.226-2.351=-0.125
σ0.198-0.158=0.039
min2.058-2.096=-0.038
max2.553-2.507=0.046
iters=5
new-facts=6402
prior-facts=6402
mean1890.799-1890.791=0.008
σ0.019-0.007=0.012
min1890.780-1890.783=-0.003
max1890.830-1890.803=0.027
mean1775.200-1748.400=26.800
σ108.080-203.515=-95.435
min1654.000-1537.000=117.000
max1947.000-2020.000=-73.000
mean2.999-2.901=0.098
σ0.137-0.075=0.062
min2.877-2.812=0.065
max3.196-2.982=0.214

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.197-1.474=-0.276
σ0.424-0.355=0.068
min0.909-1.042=-0.133
max1.926-1.836=0.090

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.334-443.316=0.018
σ573.991-573.963=0.028
min156.338-156.331=0.006
max1304.321-1304.261=0.060
mean96.250
σ8.500
min92.000
max109.000
mean1654.000-1537.000=117.000
σ0.000
min1654.000-1537.000=117.000
max1654.000-1537.000=117.000
mean0.531-0.540=-0.009
σ0.537-0.553=-0.016
min0.250-0.262=-0.012
max1.336-1.369=-0.032
policies=20
mean1563.619-1563.617=0.002
σ0.327-0.341=-0.014
min1563.438-1563.413=0.025
max1564.108-1564.127=-0.018
mean920.000
σ0.000
min920.000
max920.000
mean1654.000-1537.000=117.000
σ0.000
min1654.000-1537.000=117.000
max1654.000-1537.000=117.000
mean2.622-2.622=-0.000
σ0.018-0.015=0.003
min2.602-2.609=-0.007
max2.643-2.644=-0.001
policies=200
mean15644.051-15643.976=0.075
σ0.141-0.061=0.080
min15643.946-15643.903=0.043
max15644.249-15644.040=0.209
mean9200.000
σ0.000
min9200.000
max9200.000
mean1654.000-1537.000=117.000
σ0.000
min1654.000-1537.000=117.000
max1654.000-1537.000=117.000
mean26.392-26.439=-0.047
σ0.136-0.109=0.027
min26.244-26.360=-0.116
max26.526-26.600=-0.074