Compare commits

Home / Compare c6ff42a6 .. 7faf2e6a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean1449.378-1449.380=-0.002
σ0.406-0.409=-0.003
min1449.211-1449.201=0.010
max1450.520-1450.528=-0.008
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean2.254-2.273=-0.020
σ0.021-0.032=-0.011
min2.221-2.232=-0.011
max2.278-2.350=-0.071
cache=y
dps=1
iters=10
policies=100
mean1438.545-1438.541=0.004
σ0.018-0.015=0.004
min1438.510-1438.519=-0.008
max1438.565-1438.572=-0.007
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean2.279-2.236=0.043
σ0.052-0.034=0.018
min2.206-2.159=0.047
max2.354-2.271=0.083

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1032.000-1031.999=0.001
σ1.112-1.113=-0.001
min1031.483-1031.482=0.001
max1036.666-1036.671=-0.005
mean1060.500-1056.700=3.800
σ309.833-309.173=0.660
min617.000-614.000=3.000
max1623.000-1618.000=5.000
mean1.551-1.557=-0.006
σ0.090-0.083=0.007
min1.396-1.482=-0.086
max1.755-1.759=-0.003

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean399.365-399.351=0.014
σ0.081-0.088=-0.007
min399.227-399.224=0.003
max399.418-399.421=-0.003
mean1623.000-1618.000=5.000
σ0.000
min1623.000-1618.000=5.000
max1623.000-1618.000=5.000
mean0.502-0.497=0.006
σ0.012-0.011=0.001
min0.489-0.489=0.000
max0.516-0.516=0.000
iters=5
new-facts=1
prior-facts=6402
mean1400.832-1400.843=-0.011
σ0.008-0.023=-0.016
min1400.822-1400.832=-0.010
max1400.840-1400.885=-0.045
mean1623.000-1618.000=5.000
σ0.000
min1623.000-1618.000=5.000
max1623.000-1618.000=5.000
mean1.985-2.035=-0.050
σ0.057-0.096=-0.040
min1.917-1.964=-0.046
max2.039-2.201=-0.162
iters=5
new-facts=6402
prior-facts=1
mean1923.099-1923.085=0.014
σ7.048-7.090=-0.042
min1919.827-1919.804=0.023
max1935.703-1935.765=-0.062
mean1623.000-1618.000=5.000
σ0.000
min1623.000-1618.000=5.000
max1623.000-1618.000=5.000
mean4.355-4.470=-0.115
σ0.109-0.326=-0.217
min4.209-4.016=0.193
max4.473-4.887=-0.415
iters=5
new-facts=6402
prior-facts=6402
mean2185.756-2185.759=-0.003
σ0.015-0.015=-0.000
min2185.743-2185.747=-0.004
max2185.782-2185.782=-0.000
mean1827.600-1823.600=4.000
σ170.923-171.363=-0.440
min1623.000-1618.000=5.000
max2064.000-2060.000=4.000
mean4.692-4.676=0.016
σ0.060-0.107=-0.047
min4.612-4.565=0.047
max4.761-4.840=-0.079

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.179-1.189=-0.010
σ0.357-0.373=-0.016
min0.909-0.911=-0.003
max1.776-1.814=-0.038

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean458.942-458.942=-0.000
σ572.889-572.889=-0.000
min172.490-172.489=0.000
max1318.276-1318.276=-0.000
mean98.250
σ8.500
min94.000
max111.000
mean1623.000-1618.000=5.000
σ0.000
min1623.000-1618.000=5.000
max1623.000-1618.000=5.000
mean0.584-0.560=0.024
σ0.594-0.529=0.065
min0.285-0.294=-0.009
max1.475-1.353=0.122
policies=20
mean1725.194-1725.194=0.001
σ0.405-0.400=0.005
min1724.905-1724.906=-0.001
max1725.785-1725.776=0.009
mean940.000
σ0.000
min940.000
max940.000
mean1623.000-1618.000=5.000
σ0.000
min1623.000-1618.000=5.000
max1623.000-1618.000=5.000
mean2.834-2.832=0.002
σ0.008-0.019=-0.010
min2.825-2.813=0.012
max2.845-2.854=-0.008
policies=200
mean17259.558-17259.578=-0.020
σ0.157-0.129=0.028
min17259.404-17259.426=-0.022
max17259.778-17259.742=0.036
mean9400.000
σ0.000
min9400.000
max9400.000
mean1623.000-1618.000=5.000
σ0.000
min1623.000-1618.000=5.000
max1623.000-1618.000=5.000
mean28.655-28.639=0.016
σ0.182-0.086=0.096
min28.478-28.574=-0.095
max28.833-28.765=0.068