Compare commits

Home / Compare 929db996 .. 5734836d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-31.040=0.000
σ0.049-0.047=0.002
min30.996-31.005=-0.009
max31.176-31.172=0.004
mean411.000-412.000=-1.000
σ0.000
min411.000-412.000=-1.000
max411.000-412.000=-1.000
mean0.079-0.079=-0.000
σ0.005-0.003=0.001
min0.072-0.076=-0.004
max0.087-0.086=0.001
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=0.000
σ0.003-0.003=0.000
min21.138-21.139=-0.000
max21.146-21.146=-0.000
mean411.000-412.000=-1.000
σ0.000
min411.000-412.000=-1.000
max411.000-412.000=-1.000
mean0.062-0.064=-0.002
σ0.003-0.003=0.000
min0.057-0.062=-0.005
max0.066-0.071=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.411-1751.413=-0.002
σ0.359-0.363=-0.003
min1750.842-1750.841=0.001
max1751.992-1752.000=-0.008
mean1636.550-1656.700=-20.150
σ616.349-642.369=-26.020
min625.000-629.000=-4.000
max2472.000-2851.000=-379.000
mean2.831-2.877=-0.046
σ0.203-0.155=0.047
min2.432-2.493=-0.061
max3.224-3.061=0.164

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.779-266.760=0.019
σ0.009-0.008=0.002
min266.766-266.753=0.012
max266.790-266.772=0.019
mean2472.000-2851.000=-379.000
σ0.000
min2472.000-2851.000=-379.000
max2472.000-2851.000=-379.000
mean0.372-0.364=0.008
σ0.018-0.002=0.016
min0.364-0.363=0.001
max0.405-0.368=0.037
iters=5
new-facts=1
prior-facts=6402
mean1927.207-1927.209=-0.002
σ0.003-0.009=-0.006
min1927.203-1927.200=0.003
max1927.211-1927.224=-0.013
mean2472.000-2851.000=-379.000
σ0.000
min2472.000-2851.000=-379.000
max2472.000-2851.000=-379.000
mean2.998-2.998=-0.000
σ0.063-0.128=-0.064
min2.923-2.815=0.108
max3.093-3.166=-0.073
iters=5
new-facts=6402
prior-facts=1
mean4747.658-4747.562=0.096
σ0.862-0.935=-0.074
min4746.886-4746.595=0.291
max4749.135-4749.125=0.010
mean2472.000-2851.000=-379.000
σ0.000
min2472.000-2851.000=-379.000
max2472.000-2851.000=-379.000
mean8.014-8.507=-0.494
σ0.343-0.670=-0.327
min7.657-7.663=-0.006
max8.516-9.041=-0.525
iters=5
new-facts=6402
prior-facts=6402
mean4938.164-4938.169=-0.004
σ0.076-0.090=-0.015
min4938.101-4938.088=0.013
max4938.248-4938.274=-0.025
mean2957.200-3065.000=-107.800
σ438.021-220.575=217.446
min2472.000-2851.000=-379.000
max3545.000-3385.000=160.000
mean8.433-8.608=-0.175
σ0.133-0.286=-0.153
min8.303-8.327=-0.025
max8.651-8.992=-0.341

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.759-1.051=0.708
σ0.073-0.132=-0.059
min1.650-0.932=0.719
max1.839-1.254=0.585

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.111-465.119=-0.008
σ575.753-575.756=-0.002
min177.230-177.240=-0.009
max1328.741-1328.752=-0.011
mean79.750
σ7.500
min76.000
max91.000
mean2472.000-2851.000=-379.000
σ0.000
min2472.000-2851.000=-379.000
max2472.000-2851.000=-379.000
mean0.559-0.448=0.111
σ0.566-0.312=0.254
min0.274-0.287=-0.013
max1.408-0.915=0.492
policies=20
mean1772.563-1772.622=-0.058
σ0.332-0.335=-0.004
min1772.341-1772.377=-0.037
max1773.055-1773.114=-0.058
mean760.000
σ0.000
min760.000
max760.000
mean2472.000-2851.000=-379.000
σ0.000
min2472.000-2851.000=-379.000
max2472.000-2851.000=-379.000
mean2.758-2.835=-0.077
σ0.016-0.006=0.010
min2.740-2.827=-0.086
max2.777-2.841=-0.064
policies=200
mean17732.373-17732.440=-0.068
σ0.436-0.532=-0.096
min17732.035-17732.036=-0.001
max17733.011-17733.217=-0.205
mean7600.000
σ0.000
min7600.000
max7600.000
mean2472.000-2851.000=-379.000
σ0.000
min2472.000-2851.000=-379.000
max2472.000-2851.000=-379.000
mean27.722-28.193=-0.472
σ0.174-0.475=-0.301
min27.546-27.677=-0.130
max27.947-28.630=-0.683