Compare commits

Home / Compare 4c18f692 .. 065b7aee

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.793-35.794=-0.001
σ0.109-0.108=0.001
min35.751-35.752=-0.001
max36.102-36.100=0.002
mean410.900-415.000=-4.100
σ0.316-0.000=0.316
min410.000-415.000=-5.000
max411.000-415.000=-4.000
mean0.076-0.076=0.000
σ0.003-0.003=-0.000
min0.073-0.073=0.000
max0.082-0.083=-0.000
cache=y
dps=1
iters=10
policies=100
mean26.064-26.065=-0.001
σ0.002-0.004=-0.002
min26.061-26.057=0.004
max26.067-26.070=-0.003
mean411.000-415.000=-4.000
σ0.000
min411.000-415.000=-4.000
max411.000-415.000=-4.000
mean0.059-0.060=-0.000
σ0.004-0.003=0.001
min0.056-0.056=-0.000
max0.068-0.065=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.235-1751.237=-0.002
σ0.361-0.361=0.000
min1750.666-1750.670=-0.004
max1751.838-1751.831=0.007
mean1657.800-1656.350=1.450
σ633.658-645.401=-11.743
min614.000-629.000=-15.000
max2701.000-2856.000=-155.000
mean2.846-2.845=0.001
σ0.160-0.142=0.017
min2.529-2.481=0.048
max3.184-3.217=-0.033

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.568-275.569=-0.001
σ0.008-0.009=-0.001
min275.561-275.554=0.007
max275.580-275.580=0.000
mean2701.000-2856.000=-155.000
σ0.000
min2701.000-2856.000=-155.000
max2701.000-2856.000=-155.000
mean0.407-0.405=0.001
σ0.012-0.008=0.004
min0.395-0.398=-0.003
max0.422-0.415=0.006
iters=5
new-facts=1
prior-facts=6402
mean2168.094-2168.099=-0.005
σ0.011-0.006=0.005
min2168.079-2168.093=-0.015
max2168.106-2168.109=-0.003
mean2701.000-2856.000=-155.000
σ0.000
min2701.000-2856.000=-155.000
max2701.000-2856.000=-155.000
mean2.966-2.943=0.023
σ0.131-0.130=0.000
min2.776-2.783=-0.007
max3.133-3.134=-0.001
iters=5
new-facts=6402
prior-facts=1
mean5047.924-5047.886=0.038
σ0.906-0.911=-0.005
min5047.398-5047.367=0.031
max5049.539-5049.509=0.029
mean2701.000-2856.000=-155.000
σ0.000
min2701.000-2856.000=-155.000
max2701.000-2856.000=-155.000
mean8.994-8.768=0.226
σ0.392-0.453=-0.061
min8.304-7.985=0.319
max9.246-9.126=0.120
iters=5
new-facts=6402
prior-facts=6402
mean5179.047-5178.984=0.063
σ0.081-0.116=-0.035
min5178.970-5178.805=0.165
max5179.151-5179.125=0.025
mean3284.200-3256.400=27.800
σ418.538-340.591=77.946
min2701.000-2856.000=-155.000
max3671.000-3738.000=-67.000
mean9.788-9.961=-0.173
σ0.584-0.305=0.279
min8.830-9.631=-0.801
max10.247-10.272=-0.025

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.090-1.124=-0.034
σ0.107-0.253=-0.146
min0.944-0.945=-0.000
max1.247-1.561=-0.314

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.209-463.210=-0.002
σ572.660-572.659=0.001
min176.869-176.868=0.001
max1322.198-1322.199=-0.000
mean77.500
σ7.000
min74.000
max88.000
mean2701.000-2856.000=-155.000
σ0.000
min2701.000-2856.000=-155.000
max2701.000-2856.000=-155.000
mean0.579-0.435=0.144
σ0.611-0.302=0.309
min0.271-0.280=-0.009
max1.496-0.888=0.608
policies=20
mean1768.975-1769.004=-0.029
σ0.332-0.344=-0.013
min1768.763-1768.772=-0.009
max1769.469-1769.513=-0.044
mean740.000
σ0.000
min740.000
max740.000
mean2701.000-2856.000=-155.000
σ0.000
min2701.000-2856.000=-155.000
max2701.000-2856.000=-155.000
mean2.735-2.821=-0.086
σ0.017-0.019=-0.002
min2.721-2.805=-0.084
max2.760-2.846=-0.086
policies=200
mean17696.139-17696.166=-0.026
σ0.377-0.432=-0.055
min17695.870-17695.702=0.168
max17696.698-17696.745=-0.048
mean7400.000
σ0.000
min7400.000
max7400.000
mean2701.000-2856.000=-155.000
σ0.000
min2701.000-2856.000=-155.000
max2701.000-2856.000=-155.000
mean27.725-28.134=-0.409
σ0.093-0.543=-0.450
min27.588-27.576=0.012
max27.795-28.735=-0.940