Compare commits

Home / Compare bf7f6431 .. 8ebdbf88

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.037-31.041=-0.004
σ0.051-0.050=0.001
min30.997-31.003=-0.007
max31.178-31.181=-0.003
mean413.000
σ0.000
min413.000
max413.000
mean0.064-0.080=-0.016
σ0.009-0.004=0.005
min0.043-0.077=-0.033
max0.078-0.089=-0.011
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=-0.000
σ0.003-0.002=0.001
min21.138-21.141=-0.003
max21.148-21.147=0.001
mean413.000
σ0.000
min413.000
max413.000
mean0.063-0.062=0.001
σ0.004-0.004=0.000
min0.057-0.058=-0.001
max0.072-0.072=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.415-1751.414=0.000
σ0.361-0.361=0.001
min1750.846-1750.842=0.004
max1751.993-1751.991=0.003
mean1636.850-1637.650=-0.800
σ614.961-616.786=-1.825
min626.000-627.000=-1.000
max2469.000-2473.000=-4.000
mean2.887-2.872=0.015
σ0.096-0.086=0.009
min2.672-2.658=0.014
max3.045-3.047=-0.001

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.783-266.788=-0.005
σ0.007-0.007=-0.000
min266.775-266.780=-0.005
max266.793-266.796=-0.003
mean2469.000-2473.000=-4.000
σ0.000
min2469.000-2473.000=-4.000
max2469.000-2473.000=-4.000
mean0.373-0.373=-0.000
σ0.001-0.004=-0.003
min0.372-0.370=0.002
max0.374-0.380=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1927.209-1927.199=0.010
σ0.013-0.011=0.003
min1927.190-1927.188=0.002
max1927.222-1927.216=0.006
mean2469.000-2473.000=-4.000
σ0.000
min2469.000-2473.000=-4.000
max2469.000-2473.000=-4.000
mean3.127-3.014=0.113
σ0.205-0.135=0.070
min2.961-2.894=0.067
max3.475-3.236=0.239
iters=5
new-facts=6402
prior-facts=1
mean4747.737-4747.658=0.079
σ0.798-0.898=-0.100
min4747.334-4747.144=0.190
max4749.164-4749.253=-0.089
mean2469.000-2473.000=-4.000
σ0.000
min2469.000-2473.000=-4.000
max2469.000-2473.000=-4.000
mean8.203-8.786=-0.583
σ0.572-0.500=0.072
min7.695-8.056=-0.361
max8.929-9.360=-0.430
iters=5
new-facts=6402
prior-facts=6402
mean4938.098-4938.025=0.072
σ0.118-0.270=-0.152
min4937.917-4937.559=0.357
max4938.248-4938.265=-0.017
mean2937.800-2955.000=-17.200
σ403.295-265.966=137.329
min2481.000-2597.000=-116.000
max3469.000-3305.000=164.000
mean8.475-8.440=0.035
σ0.157-0.100=0.057
min8.318-8.321=-0.003
max8.700-8.526=0.175

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.796-1.823=-0.027
σ0.094-0.125=-0.031
min1.645-1.630=0.015
max1.903-1.959=-0.056

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.112-465.115=-0.002
σ575.754-575.754=-0.000
min177.233-177.234=-0.001
max1328.743-1328.745=-0.002
mean79.750
σ7.500
min76.000
max91.000
mean2469.000-2473.000=-4.000
σ0.000
min2469.000-2473.000=-4.000
max2469.000-2473.000=-4.000
mean0.555-0.564=-0.009
σ0.549-0.575=-0.026
min0.278-0.269=0.009
max1.379-1.426=-0.047
policies=20
mean1772.580-1772.594=-0.014
σ0.336-0.321=0.015
min1772.354-1772.386=-0.032
max1773.078-1773.072=0.007
mean760.000
σ0.000
min760.000
max760.000
mean2469.000-2473.000=-4.000
σ0.000
min2469.000-2473.000=-4.000
max2469.000-2473.000=-4.000
mean2.750-2.758=-0.008
σ0.014-0.027=-0.013
min2.733-2.736=-0.004
max2.765-2.794=-0.029
policies=200
mean17732.594-17732.597=-0.004
σ0.371-0.559=-0.188
min17732.285-17732.216=0.069
max17733.132-17733.414=-0.282
mean7600.000
σ0.000
min7600.000
max7600.000
mean2469.000-2473.000=-4.000
σ0.000
min2469.000-2473.000=-4.000
max2469.000-2473.000=-4.000
mean27.676-27.629=0.046
σ0.161-0.071=0.089
min27.519-27.553=-0.034
max27.872-27.721=0.151