Compare commits

Home / Compare d70eef4f .. 8af7cf69

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.653-53.654=-0.001
σ0.367-0.366=0.001
min53.511-53.513=-0.002
max54.698-54.695=0.003
mean413.000-414.900=-1.900
σ0.000-0.316=-0.316
min413.000-414.000=-1.000
max413.000-415.000=-2.000
mean0.137-0.138=-0.001
σ0.005-0.003=0.002
min0.130-0.135=-0.004
max0.144-0.143=0.001
cache=y
dps=1
iters=10
policies=100
mean42.979-42.979=0.000
σ0.006-0.005=0.001
min42.971-42.972=-0.001
max42.990-42.986=0.003
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.120-0.118=0.003
σ0.004-0.004=0.001
min0.115-0.115=-0.000
max0.127-0.124=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.973-1013.978=-0.005
σ1.169-1.172=-0.003
min1013.431-1013.431=0.000
max1018.862-1018.880=-0.018
mean1046.750-1051.650=-4.900
σ315.945-316.675=-0.730
min598.000
max1651.000-1654.000=-3.000
mean1.661-1.658=0.004
σ0.124-0.106=0.018
min1.554-1.568=-0.014
max2.074-2.000=0.074

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.066-299.217=-0.151
σ0.202-0.274=-0.072
min298.909-298.954=-0.045
max299.615-299.945=-0.330
mean2032.000-1968.000=64.000
σ0.000
min2032.000-1968.000=64.000
max2032.000-1968.000=64.000
mean0.570-0.572=-0.002
σ0.018-0.022=-0.005
min0.545-0.537=0.007
max0.591-0.598=-0.007

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.681-294.683=-0.002
σ0.010-0.015=-0.005
min294.666-294.659=0.007
max294.694-294.702=-0.008
mean1651.000-1654.000=-3.000
σ0.000
min1651.000-1654.000=-3.000
max1651.000-1654.000=-3.000
mean0.383-0.383=0.000
σ0.005-0.002=0.004
min0.379-0.381=-0.002
max0.393-0.386=0.007
iters=5
new-facts=1
prior-facts=6402
mean1316.936-1316.972=-0.036
σ0.102-0.092=0.010
min1316.860-1316.902=-0.043
max1317.116-1317.129=-0.013
mean1651.000-1654.000=-3.000
σ0.000
min1651.000-1654.000=-3.000
max1651.000-1654.000=-3.000
mean1.872-1.955=-0.082
σ0.102-0.083=0.019
min1.746-1.851=-0.105
max1.966-2.083=-0.117
iters=5
new-facts=6402
prior-facts=1
mean1555.288-1555.289=-0.001
σ6.878-6.893=-0.015
min1551.959-1551.956=0.003
max1567.586-1567.613=-0.027
mean1651.000-1654.000=-3.000
σ0.000
min1651.000-1654.000=-3.000
max1651.000-1654.000=-3.000
mean2.287-2.273=0.014
σ0.248-0.302=-0.054
min2.128-2.071=0.058
max2.724-2.804=-0.080
iters=5
new-facts=6402
prior-facts=6402
mean1884.780-1884.782=-0.002
σ0.041-0.024=0.017
min1884.749-1884.766=-0.016
max1884.852-1884.823=0.028
mean1782.000-1777.600=4.400
σ166.337-130.785=35.552
min1651.000-1654.000=-3.000
max2032.000-1968.000=64.000
mean2.943-2.931=0.012
σ0.115-0.123=-0.008
min2.872-2.776=0.096
max3.147-3.082=0.065

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.216-1.088=0.128
σ0.326-0.160=0.166
min0.919-0.914=0.005
max1.763-1.294=0.468

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.680-440.676=0.004
σ573.411-573.399=0.012
min153.968-153.973=-0.006
max1300.796-1300.774=0.021
mean96.250
σ8.500
min92.000
max109.000
mean1651.000-1654.000=-3.000
σ0.000
min1651.000-1654.000=-3.000
max1651.000-1654.000=-3.000
mean0.549-0.555=-0.006
σ0.569-0.574=-0.005
min0.262-0.267=-0.004
max1.402-1.415=-0.013
policies=20
mean1539.887-1539.917=-0.030
σ0.265-0.307=-0.041
min1539.726-1539.736=-0.011
max1540.283-1540.376=-0.092
mean920.000
σ0.000
min920.000
max920.000
mean1651.000-1654.000=-3.000
σ0.000
min1651.000-1654.000=-3.000
max1651.000-1654.000=-3.000
mean2.597-2.597=0.001
σ0.014-0.008=0.006
min2.582-2.589=-0.007
max2.615-2.606=0.009
policies=200
mean15406.948-15407.041=-0.094
σ0.137-0.053=0.084
min15406.775-15406.980=-0.206
max15407.086-15407.101=-0.014
mean9200.000
σ0.000
min9200.000
max9200.000
mean1651.000-1654.000=-3.000
σ0.000
min1651.000-1654.000=-3.000
max1651.000-1654.000=-3.000
mean26.353-26.256=0.097
σ0.238-0.146=0.092
min26.154-26.095=0.059
max26.693-26.411=0.281