Compare commits

Home / Compare 4ff53f1f .. add05485

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.389-70.390=-0.000
σ0.046-0.048=-0.001
min70.361-70.357=0.003
max70.519-70.521=-0.002
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.161-0.157=0.004
σ0.003-0.004=-0.001
min0.158-0.150=0.008
max0.167-0.164=0.004
cache=y
dps=1
iters=10
policies=100
mean21.145-21.145=-0.001
σ0.002-0.002=0.000
min21.141-21.141=0.001
max21.150-21.148=0.001
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.064-0.065=-0.001
σ0.003-0.002=0.001
min0.060-0.063=-0.003
max0.071-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.393-1752.393=0.001
σ0.358-0.363=-0.005
min1751.827-1751.832=-0.005
max1752.976-1752.976=-0.001
mean1638.300-1655.500=-17.200
σ612.989-617.618=-4.629
min628.000-638.000=-10.000
max2468.000-2494.000=-26.000
mean2.797-2.839=-0.042
σ0.167-0.152=0.015
min2.320-2.352=-0.032
max3.020-3.143=-0.123

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.142-270.145=-0.003
σ0.005-0.008=-0.002
min270.134-270.135=-0.001
max270.147-270.153=-0.006
mean2468.000-2494.000=-26.000
σ0.000
min2468.000-2494.000=-26.000
max2468.000-2494.000=-26.000
mean0.379-0.380=-0.001
σ0.006-0.005=0.001
min0.370-0.375=-0.005
max0.388-0.389=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1930.609-1930.608=0.001
σ0.015-0.009=0.005
min1930.587-1930.599=-0.012
max1930.621-1930.619=0.002
mean2468.000-2494.000=-26.000
σ0.000
min2468.000-2494.000=-26.000
max2468.000-2494.000=-26.000
mean2.514-2.531=-0.017
σ0.095-0.103=-0.008
min2.428-2.447=-0.019
max2.663-2.676=-0.013
iters=5
new-facts=6402
prior-facts=1
mean4751.341-4751.336=0.005
σ0.900-0.860=0.040
min4750.775-4750.831=-0.056
max4752.925-4752.863=0.062
mean2468.000-2494.000=-26.000
σ0.000
min2468.000-2494.000=-26.000
max2468.000-2494.000=-26.000
mean8.426-8.428=-0.002
σ0.615-0.409=0.206
min7.804-7.791=0.013
max9.143-8.876=0.267
iters=5
new-facts=6402
prior-facts=6402
mean4941.771-4941.774=-0.003
σ0.018-0.014=0.004
min4941.752-4941.760=-0.008
max4941.797-4941.794=0.003
mean3006.200-3013.800=-7.600
σ262.837-259.617=3.219
min2621.000-2627.000=-6.000
max3321.000-3320.000=1.000
mean8.556-8.603=-0.047
σ0.126-0.145=-0.018
min8.430-8.438=-0.009
max8.749-8.780=-0.032

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.813-1.626=0.187
σ0.124-0.215=-0.091
min1.650-1.345=0.305
max1.981-1.841=0.140

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.360-466.367=-0.007
σ575.917-575.920=-0.003
min178.400-178.402=-0.002
max1330.235-1330.246=-0.011
mean84.000
σ8.000
min80.000
max96.000
mean2468.000-2494.000=-26.000
σ0.000
min2468.000-2494.000=-26.000
max2468.000-2494.000=-26.000
mean0.557-0.554=0.003
σ0.544-0.544=-0.000
min0.285-0.281=0.004
max1.373-1.371=0.003
policies=20
mean1784.302-1784.327=-0.024
σ0.351-0.360=-0.009
min1784.069-1784.085=-0.016
max1784.822-1784.860=-0.038
mean800.000
σ0.000
min800.000
max800.000
mean2468.000-2494.000=-26.000
σ0.000
min2468.000-2494.000=-26.000
max2468.000-2494.000=-26.000
mean2.792-2.792=0.000
σ0.051-0.010=0.041
min2.765-2.778=-0.013
max2.868-2.800=0.068
policies=200
mean17849.840-17849.904=-0.064
σ0.493-0.447=0.045
min17849.516-17849.619=-0.102
max17850.574-17850.570=0.004
mean8000.000
σ0.000
min8000.000
max8000.000
mean2468.000-2494.000=-26.000
σ0.000
min2468.000-2494.000=-26.000
max2468.000-2494.000=-26.000
mean28.044-28.020=0.024
σ0.079-0.048=0.031
min27.927-27.992=-0.065
max28.100-28.091=0.009