Compare commits

Home / Compare e65fc4c7 .. 7d5355ee

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.969-35.967=0.002
σ0.106-0.106=0.000
min35.922-35.916=0.005
max36.271-36.267=0.003
mean417.000-413.400=3.600
σ0.000-0.843=-0.843
min417.000-413.000=4.000
max417.000-415.000=2.000
mean0.077-0.076=0.001
σ0.004-0.003=0.001
min0.074-0.074=0.000
max0.085-0.084=0.001
cache=y
dps=1
iters=10
policies=100
mean26.206-26.204=0.002
σ0.003-0.003=0.000
min26.199-26.198=0.001
max26.211-26.209=0.002
mean417.000-415.000=2.000
σ0.000
min417.000-415.000=2.000
max417.000-415.000=2.000
mean0.061-0.059=0.002
σ0.003-0.003=-0.000
min0.059-0.056=0.003
max0.068-0.064=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.372-1758.374=-0.002
σ0.371-0.373=-0.002
min1757.795-1757.794=0.001
max1758.968-1758.971=-0.003
mean1650.400-1641.750=8.650
σ642.707-627.890=14.817
min679.000-675.000=4.000
max2738.000-2700.000=38.000
mean2.402-2.374=0.028
σ0.109-0.063=0.046
min2.280-2.301=-0.021
max2.728-2.488=0.240

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.530-279.534=-0.004
σ0.007-0.009=-0.002
min279.524-279.524=0.000
max279.539-279.544=-0.005
mean2738.000-2700.000=38.000
σ0.000
min2738.000-2700.000=38.000
max2738.000-2700.000=38.000
mean0.413-0.414=-0.000
σ0.008-0.009=-0.001
min0.407-0.406=0.001
max0.426-0.427=-0.001
iters=5
new-facts=1
prior-facts=6402
mean2178.453-2178.457=-0.004
σ0.014-0.007=0.007
min2178.437-2178.449=-0.012
max2178.474-2178.468=0.006
mean2738.000-2700.000=38.000
σ0.000
min2738.000-2700.000=38.000
max2738.000-2700.000=38.000
mean3.275-3.277=-0.003
σ0.335-0.258=0.077
min2.785-2.933=-0.149
max3.726-3.566=0.160
iters=5
new-facts=6402
prior-facts=1
mean5056.158-5056.326=-0.168
σ1.259-1.174=0.085
min5055.226-5055.241=-0.015
max5058.295-5058.333=-0.038
mean2738.000-2700.000=38.000
σ0.000
min2738.000-2700.000=38.000
max2738.000-2700.000=38.000
mean8.982-8.645=0.336
σ0.257-0.612=-0.355
min8.746-8.123=0.623
max9.404-9.506=-0.103
iters=5
new-facts=6402
prior-facts=6402
mean5193.800-5193.597=0.203
σ0.083-0.267=-0.184
min5193.704-5193.176=0.528
max5193.870-5193.857=0.012
mean3199.400-3236.400=-37.000
σ450.588-368.579=82.010
min2738.000-2716.000=22.000
max3825.000-3682.000=143.000
mean8.742-9.035=-0.293
σ0.119-0.402=-0.283
min8.660-8.735=-0.075
max8.942-9.712=-0.771

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.985-1.031=-0.046
σ0.055-0.132=-0.077
min0.951-0.943=0.008
max1.082-1.247=-0.166

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.522-465.518=0.004
σ572.660-572.658=0.002
min179.184-179.185=-0.001
max1324.512-1324.504=0.007
mean79.500
σ7.000
min76.000
max90.000
mean2738.000-2700.000=38.000
σ0.000
min2738.000-2700.000=38.000
max2738.000-2700.000=38.000
mean0.577-0.566=0.010
σ0.582-0.558=0.024
min0.284-0.284=0.000
max1.450-1.404=0.046
policies=20
mean1792.085-1792.108=-0.023
σ0.331-0.346=-0.015
min1791.888-1791.871=0.017
max1792.579-1792.621=-0.042
mean760.000
σ0.000
min760.000
max760.000
mean2738.000-2700.000=38.000
σ0.000
min2738.000-2700.000=38.000
max2738.000-2700.000=38.000
mean2.807-2.802=0.005
σ0.009-0.014=-0.005
min2.799-2.794=0.005
max2.817-2.823=-0.006
policies=200
mean17927.669-17927.774=-0.105
σ0.557-0.531=0.027
min17927.298-17927.487=-0.189
max17928.483-17928.569=-0.086
mean7600.000
σ0.000
min7600.000
max7600.000
mean2738.000-2700.000=38.000
σ0.000
min2738.000-2700.000=38.000
max2738.000-2700.000=38.000
mean28.374-28.225=0.149
σ0.033-0.204=-0.171
min28.344-27.980=0.364
max28.421-28.424=-0.003