Compare commits

Home / Compare 2acd9103 .. d202e6be

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.389-70.388=0.001
σ0.048-0.045=0.003
min70.358-70.359=-0.001
max70.521-70.514=0.007
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.159-0.160=-0.001
σ0.003-0.003=-0.001
min0.156-0.157=-0.001
max0.164-0.167=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.145-21.145=0.000
σ0.001-0.002=-0.001
min21.143-21.142=0.001
max21.147-21.149=-0.002
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.063-0.065=-0.002
σ0.004-0.002=0.002
min0.058-0.063=-0.005
max0.070-0.070=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.700-1752.699=0.001
σ0.361-0.361=0.001
min1752.123-1752.126=-0.003
max1753.267-1753.282=-0.015
mean1654.500-1658.150=-3.650
σ627.640-638.278=-10.638
min627.000-687.000=-60.000
max2858.000-2769.000=89.000
mean2.863-2.776=0.087
σ0.055-0.184=-0.128
min2.761-2.399=0.362
max2.966-3.179=-0.213

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.518-270.514=0.004
σ0.006-0.006=-0.000
min270.510-270.507=0.003
max270.524-270.519=0.005
mean2858.000-2769.000=89.000
σ0.000
min2858.000-2769.000=89.000
max2858.000-2769.000=89.000
mean0.391-0.383=0.008
σ0.014-0.010=0.004
min0.377-0.375=0.002
max0.411-0.396=0.015
iters=5
new-facts=1
prior-facts=6402
mean1930.940-1930.947=-0.006
σ0.011-0.003=0.008
min1930.922-1930.944=-0.022
max1930.949-1930.952=-0.004
mean2858.000-2769.000=89.000
σ0.000
min2858.000-2769.000=89.000
max2858.000-2769.000=89.000
mean2.977-2.965=0.012
σ0.059-0.224=-0.165
min2.874-2.603=0.271
max3.022-3.179=-0.157
iters=5
new-facts=6402
prior-facts=1
mean4751.635-4751.324=0.310
σ0.921-0.793=0.128
min4751.147-4750.734=0.413
max4753.278-4752.701=0.577
mean2858.000-2769.000=89.000
σ0.000
min2858.000-2769.000=89.000
max2858.000-2769.000=89.000
mean8.921-8.477=0.444
σ0.259-0.720=-0.462
min8.676-7.545=1.131
max9.358-9.215=0.143
iters=5
new-facts=6402
prior-facts=6402
mean4942.001-4942.069=-0.067
σ0.186-0.155=0.032
min4941.794-4941.794=0.000
max4942.167-4942.154=0.013
mean3018.400-3033.800=-15.400
σ184.263-323.556=-139.293
min2858.000-2769.000=89.000
max3308.000-3520.000=-212.000
mean8.619-8.496=0.123
σ0.271-0.141=0.130
min8.367-8.322=0.045
max9.073-8.655=0.418

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.018-1.018=0.000
σ0.143-0.134=0.009
min0.924-0.928=-0.004
max1.255-1.236=0.019

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.828-466.827=0.002
σ575.925-575.926=-0.001
min178.859-178.859=-0.000
max1330.716-1330.716=0.000
mean84.000
σ8.000
min80.000
max96.000
mean2858.000-2769.000=89.000
σ0.000
min2858.000-2769.000=89.000
max2858.000-2769.000=89.000
mean0.440-0.438=0.001
σ0.303-0.300=0.003
min0.282-0.285=-0.004
max0.894-0.888=0.006
policies=20
mean1788.849-1788.841=0.008
σ0.356-0.320=0.036
min1788.604-1788.640=-0.036
max1789.375-1789.312=0.062
mean800.000
σ0.000
min800.000
max800.000
mean2858.000-2769.000=89.000
σ0.000
min2858.000-2769.000=89.000
max2858.000-2769.000=89.000
mean2.846-2.800=0.046
σ0.011-0.064=-0.053
min2.831-2.755=0.076
max2.857-2.894=-0.037
policies=200
mean17894.685-17894.777=-0.092
σ0.540-0.452=0.088
min17894.393-17894.505=-0.112
max17895.493-17895.452=0.041
mean8000.000
σ0.000
min8000.000
max8000.000
mean2858.000-2769.000=89.000
σ0.000
min2858.000-2769.000=89.000
max2858.000-2769.000=89.000
mean28.257-27.895=0.363
σ0.564-0.121=0.442
min27.733-27.775=-0.042
max28.841-28.021=0.819