Compare commits

Home / Compare 433475c3 .. 8b20c1bb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-31.040=-0.000
σ0.050-0.049=0.001
min31.001-31.001=-0.000
max31.179-31.177=0.002
mean415.000-412.200=2.800
σ0.000-0.422=-0.422
min415.000-412.000=3.000
max415.000-413.000=2.000
mean0.079-0.078=0.000
σ0.003-0.003=0.001
min0.076-0.077=-0.001
max0.085-0.086=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.142-21.143=-0.001
σ0.002-0.003=-0.001
min21.140-21.140=0.000
max21.146-21.149=-0.003
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.065-0.064=0.000
σ0.003-0.002=0.001
min0.062-0.063=-0.001
max0.071-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.411-1751.413=-0.002
σ0.361-0.361=-0.000
min1750.850-1750.850=-0.000
max1751.979-1751.995=-0.017
mean1656.050-1654.650=1.400
σ646.910-648.384=-1.474
min651.000-649.000=2.000
max2850.000-2849.000=1.000
mean2.823-2.869=-0.046
σ0.193-0.129=0.064
min2.355-2.526=-0.171
max3.228-3.202=0.026

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.070-279.070=-0.000
σ0.006-0.006=-0.000
min279.061-279.060=0.002
max279.076-279.074=0.001
mean2850.000-2849.000=1.000
σ0.000
min2850.000-2849.000=1.000
max2850.000-2849.000=1.000
mean0.392-0.390=0.002
σ0.005-0.006=-0.001
min0.385-0.385=-0.000
max0.397-0.398=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1939.514-1939.511=0.004
σ0.011-0.009=0.002
min1939.504-1939.502=0.003
max1939.531-1939.524=0.008
mean2850.000-2849.000=1.000
σ0.000
min2850.000-2849.000=1.000
max2850.000-2849.000=1.000
mean3.014-3.027=-0.012
σ0.070-0.144=-0.073
min2.944-2.790=0.155
max3.133-3.146=-0.013
iters=5
new-facts=6402
prior-facts=1
mean4760.049-4759.950=0.099
σ0.853-0.960=-0.107
min4759.581-4759.030=0.551
max4761.567-4761.575=-0.008
mean2850.000-2849.000=1.000
σ0.000
min2850.000-2849.000=1.000
max2850.000-2849.000=1.000
mean8.203-8.161=0.042
σ0.537-0.539=-0.002
min7.592-7.761=-0.169
max9.026-9.062=-0.035
iters=5
new-facts=6402
prior-facts=6402
mean4950.460-4950.472=-0.012
σ0.077-0.079=-0.002
min4950.390-4950.410=-0.020
max4950.550-4950.562=-0.013
mean3073.000
σ301.276-297.765=3.511
min2850.000-2849.000=1.000
max3540.000-3533.000=7.000
mean8.448-8.365=0.083
σ0.117-0.068=0.049
min8.333-8.297=0.036
max8.646-8.447=0.199

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.104-1.102=0.002
σ0.081-0.085=-0.004
min1.064-1.056=0.008
max1.249-1.254=-0.005

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.336-463.346=-0.011
σ572.198-572.203=-0.005
min177.234-177.233=0.001
max1321.633-1321.651=-0.018
mean79.750
σ7.500
min76.000
max91.000
mean2850.000-2849.000=1.000
σ0.000
min2850.000-2849.000=1.000
max2850.000-2849.000=1.000
mean0.439-0.438=0.001
σ0.299-0.299=-0.000
min0.288-0.284=0.004
max0.887-0.886=0.001
policies=20
mean1772.605-1772.624=-0.019
σ0.337-0.330=0.007
min1772.371-1772.378=-0.007
max1773.101-1773.106=-0.005
mean760.000
σ0.000
min760.000
max760.000
mean2850.000-2849.000=1.000
σ0.000
min2850.000-2849.000=1.000
max2850.000-2849.000=1.000
mean2.844-2.832=0.012
σ0.008-0.008=-0.000
min2.833-2.822=0.011
max2.852-2.842=0.010
policies=200
mean17732.481-17732.564=-0.082
σ0.459-0.474=-0.014
min17732.219-17732.195=0.023
max17733.169-17733.258=-0.088
mean7600.000
σ0.000
min7600.000
max7600.000
mean2850.000-2849.000=1.000
σ0.000
min2850.000-2849.000=1.000
max2850.000-2849.000=1.000
mean28.196-28.101=0.095
σ0.489-0.491=-0.002
min27.699-27.573=0.126
max28.675-28.588=0.088