Compare commits

Home / Compare d10079ac .. 83d7c664

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-31.039=0.001
σ0.048-0.049=-0.001
min31.001-30.996=0.005
max31.175-31.175=-0.000
mean412.000-418.000=-6.000
σ0.000
min412.000-418.000=-6.000
max412.000-418.000=-6.000
mean0.079-0.077=0.002
σ0.003-0.004=-0.001
min0.076-0.072=0.005
max0.085-0.085=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.142-21.142=0.000
σ0.003-0.002=0.001
min21.137-21.138=-0.001
max21.146-21.146=-0.000
mean412.000-418.000=-6.000
σ0.000
min412.000-418.000=-6.000
max412.000-418.000=-6.000
mean0.063-0.063=0.000
σ0.003-0.005=-0.002
min0.062-0.058=0.004
max0.071-0.074=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.411-1751.413=-0.001
σ0.362-0.359=0.003
min1750.839-1750.848=-0.009
max1751.998-1751.985=0.013
mean1659.850-1644.300=15.550
σ637.509-616.226=21.283
min624.000-632.000=-8.000
max2812.000-2479.000=333.000
mean2.825-2.877=-0.052
σ0.207-0.184=0.023
min2.312-2.212=0.100
max3.103-3.060=0.043

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.780-266.786=-0.005
σ0.006-0.008=-0.003
min266.774-266.773=0.001
max266.788-266.794=-0.006
mean2812.000-2479.000=333.000
σ0.000
min2812.000-2479.000=333.000
max2812.000-2479.000=333.000
mean0.365-0.378=-0.013
σ0.009-0.008=0.002
min0.356-0.374=-0.019
max0.380-0.392=-0.011
iters=5
new-facts=1
prior-facts=6402
mean1927.209-1927.210=-0.001
σ0.012-0.007=0.005
min1927.197-1927.201=-0.003
max1927.230-1927.220=0.010
mean2812.000-2479.000=333.000
σ0.000
min2812.000-2479.000=333.000
max2812.000-2479.000=333.000
mean2.988-3.095=-0.107
σ0.064-0.166=-0.102
min2.927-3.001=-0.074
max3.088-3.390=-0.301
iters=5
new-facts=6402
prior-facts=1
mean4747.668-4747.665=0.003
σ0.861-0.499=0.362
min4747.170-4747.381=-0.211
max4749.197-4748.549=0.648
mean2812.000-2479.000=333.000
σ0.000
min2812.000-2479.000=333.000
max2812.000-2479.000=333.000
mean8.685-7.928=0.757
σ0.478-0.363=0.115
min7.910-7.689=0.221
max9.127-8.566=0.561
iters=5
new-facts=6402
prior-facts=6402
mean4938.167-4938.095=0.072
σ0.091-0.124=-0.033
min4938.097-4937.902=0.195
max4938.270-4938.247=0.022
mean3034.000-2940.600=93.400
σ221.011-402.633=-181.622
min2812.000-2479.000=333.000
max3326.000-3463.000=-137.000
mean8.562-8.536=0.026
σ0.187-0.335=-0.148
min8.367-8.339=0.027
max8.815-9.131=-0.316

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.052-1.881=-0.829
σ0.181-0.067=0.114
min0.941-1.771=-0.830
max1.358-1.933=-0.574

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.117-465.113=0.005
σ575.763-575.757=0.005
min177.235-177.232=0.003
max1328.761-1328.749=0.012
mean79.750
σ7.500
min76.000
max91.000
mean2812.000-2479.000=333.000
σ0.000
min2812.000-2479.000=333.000
max2812.000-2479.000=333.000
mean0.440-0.564=-0.124
σ0.309-0.557=-0.248
min0.282-0.278=0.004
max0.904-1.399=-0.496
policies=20
mean1772.622-1772.589=0.033
σ0.318-0.334=-0.016
min1772.394-1772.361=0.033
max1773.086-1773.084=0.003
mean760.000
σ0.000
min760.000
max760.000
mean2812.000-2479.000=333.000
σ0.000
min2812.000-2479.000=333.000
max2812.000-2479.000=333.000
mean2.860-2.760=0.100
σ0.134-0.006=0.128
min2.747-2.754=-0.007
max3.054-2.766=0.288
policies=200
mean17732.493-17732.520=-0.027
σ0.485-0.473=0.012
min17732.214-17732.274=-0.060
max17733.220-17733.230=-0.010
mean7600.000
σ0.000
min7600.000
max7600.000
mean2812.000-2479.000=333.000
σ0.000
min2812.000-2479.000=333.000
max2812.000-2479.000=333.000
mean27.827-27.801=0.027
σ0.219-0.060=0.159
min27.650-27.716=-0.066
max28.109-27.845=0.264