Compare commits

Home / Compare 851109c1 .. 20a02c46

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.915-53.915=0.000
σ0.367-0.369=-0.002
min53.784-53.784=-0.001
max54.959-54.964=-0.006
mean416.300-412.000=4.300
σ0.483-0.000=0.483
min416.000-412.000=4.000
max417.000-412.000=5.000
mean0.138-0.135=0.003
σ0.005-0.004=0.001
min0.130-0.130=0.000
max0.146-0.143=0.003
cache=y
dps=1
iters=10
policies=100
mean43.141-43.141=-0.000
σ0.005-0.005=0.000
min43.133-43.133=-0.000
max43.151-43.148=0.003
mean417.000-412.000=5.000
σ0.000
min417.000-412.000=5.000
max417.000-412.000=5.000
mean0.121-0.121=0.000
σ0.003-0.003=-0.000
min0.118-0.118=-0.000
max0.126-0.126=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean992.085-992.081=0.004
σ1.234-1.250=-0.016
min991.495-991.493=0.002
max997.260-997.335=-0.075
mean1070.700-1072.000=-1.300
σ318.073-317.713=0.360
min602.000-601.000=1.000
max1632.000-1635.000=-3.000
mean1.530-1.552=-0.022
σ0.069-0.094=-0.025
min1.409-1.475=-0.066
max1.735-1.889=-0.154

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.674-285.676=-0.002
σ0.009-0.010=-0.001
min285.658-285.664=-0.005
max285.682-285.692=-0.011
mean1632.000-1635.000=-3.000
σ0.000
min1632.000-1635.000=-3.000
max1632.000-1635.000=-3.000
mean0.377-0.375=0.002
σ0.001-0.001=0.001
min0.375-0.374=0.001
max0.379-0.376=0.003
iters=5
new-facts=1
prior-facts=6402
mean1285.639-1285.639=-0.000
σ0.135-0.132=0.004
min1285.573-1285.574=-0.001
max1285.881-1285.875=0.006
mean1632.000-1635.000=-3.000
σ0.000
min1632.000-1635.000=-3.000
max1632.000-1635.000=-3.000
mean1.933-1.897=0.036
σ0.132-0.077=0.055
min1.850-1.820=0.030
max2.167-2.019=0.148
iters=5
new-facts=6402
prior-facts=1
mean1807.971-1807.971=0.000
σ7.065-7.002=0.063
min1804.604-1804.623=-0.018
max1820.594-1820.481=0.113
mean1632.000-1635.000=-3.000
σ0.000
min1632.000-1635.000=-3.000
max1632.000-1635.000=-3.000
mean4.226-4.170=0.056
σ0.373-0.146=0.227
min3.965-3.927=0.038
max4.883-4.306=0.577
iters=5
new-facts=6402
prior-facts=6402
mean2070.462-2070.459=0.004
σ0.010-0.008=0.002
min2070.448-2070.447=0.001
max2070.477-2070.467=0.011
mean1834.800-1861.800=-27.000
σ172.498-194.879=-22.380
min1632.000-1635.000=-3.000
max2073.000-2078.000=-5.000
mean4.522-4.465=0.057
σ0.069-0.029=0.041
min4.440-4.442=-0.003
max4.609-4.514=0.095

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.203-1.327=-0.123
σ0.348-0.333=0.015
min0.912-0.914=-0.002
max1.790-1.696=0.094

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean437.385-437.384=0.001
σ572.358-572.357=0.001
min151.195-151.197=-0.001
max1295.922-1295.919=0.003
mean90.250
σ8.500
min86.000
max103.000
mean1632.000-1635.000=-3.000
σ0.000
min1632.000-1635.000=-3.000
max1632.000-1635.000=-3.000
mean0.534-0.545=-0.011
σ0.559-0.576=-0.017
min0.251-0.256=-0.005
max1.372-1.408=-0.036
policies=20
mean1512.220-1512.195=0.025
σ0.262-0.257=0.005
min1512.058-1512.021=0.037
max1512.611-1512.577=0.035
mean860.000
σ0.000
min860.000
max860.000
mean1632.000-1635.000=-3.000
σ0.000
min1632.000-1635.000=-3.000
max1632.000-1635.000=-3.000
mean2.552-2.541=0.010
σ0.032-0.008=0.024
min2.528-2.535=-0.006
max2.598-2.551=0.047
policies=200
mean15129.677-15129.619=0.058
σ0.060-0.099=-0.038
min15129.602-15129.488=0.113
max15129.740-15129.697=0.042
mean8600.000
σ0.000
min8600.000
max8600.000
mean1632.000-1635.000=-3.000
σ0.000
min1632.000-1635.000=-3.000
max1632.000-1635.000=-3.000
mean25.682-25.727=-0.045
σ0.136-0.146=-0.009
min25.554-25.594=-0.040
max25.821-25.916=-0.095