Compare commits

Home / Compare 51405db3 .. da2709a1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.711-53.707=0.004
σ0.364-0.364=0.000
min53.582-53.576=0.005
max54.746-54.742=0.004
mean413.600-416.000=-2.400
σ0.516-0.000=0.516
min413.000-416.000=-3.000
max414.000-416.000=-2.000
mean0.140-0.146=-0.006
σ0.004-0.010=-0.006
min0.136-0.135=0.001
max0.146-0.161=-0.015
cache=y
dps=1
iters=10
policies=100
mean42.979-42.984=-0.005
σ0.006-0.004=0.001
min42.970-42.975=-0.005
max42.989-42.991=-0.003
mean414.000-416.200=-2.200
σ0.000-0.632=-0.632
min414.000-416.000=-2.000
max414.000-418.000=-4.000
mean0.119-0.142=-0.024
σ0.005-0.004=0.001
min0.114-0.138=-0.024
max0.127-0.148=-0.021

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean995.219-994.903=0.316
σ1.195-1.200=-0.005
min994.686-994.363=0.323
max1000.227-999.938=0.289
mean1066.350-1060.150=6.200
σ315.371-316.667=-1.297
min603.000-599.000=4.000
max1612.000-1620.000=-8.000
mean1.485-1.457=0.029
σ0.075-0.069=0.006
min1.375-1.407=-0.032
max1.662-1.709=-0.048

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.316-297.311=0.004
σ0.006-0.012=-0.006
min297.308-297.294=0.014
max297.323-297.326=-0.003
mean1612.000-1620.000=-8.000
σ0.000
min1612.000-1620.000=-8.000
max1612.000-1620.000=-8.000
mean0.386-0.390=-0.004
σ0.001-0.006=-0.006
min0.385-0.383=0.002
max0.387-0.398=-0.011
iters=5
new-facts=1
prior-facts=6402
mean1298.985-1298.694=0.291
σ0.084-0.036=0.049
min1298.837-1298.633=0.204
max1299.048-1298.725=0.323
mean1612.000-1620.000=-8.000
σ0.000
min1612.000-1620.000=-8.000
max1612.000-1620.000=-8.000
mean1.941-1.960=-0.019
σ0.058-0.155=-0.097
min1.863-1.820=0.043
max2.017-2.162=-0.145
iters=5
new-facts=6402
prior-facts=1
mean1719.180-1718.876=0.304
σ6.879-6.893=-0.014
min1715.995-1715.678=0.317
max1731.482-1731.204=0.278
mean1612.000-1620.000=-8.000
σ0.000
min1612.000-1620.000=-8.000
max1612.000-1620.000=-8.000
mean2.911-2.841=0.070
σ0.263-0.296=-0.033
min2.604-2.511=0.093
max3.271-3.321=-0.049
iters=5
new-facts=6402
prior-facts=6402
mean1981.931-1981.589=0.342
σ0.025-0.030=-0.006
min1981.887-1981.537=0.350
max1981.945-1981.609=0.336
mean1820.600-1810.600=10.000
σ154.975-208.070=-53.095
min1612.000-1620.000=-8.000
max1957.000-2113.000=-156.000
mean3.143-3.349=-0.206
σ0.129-0.396=-0.267
min2.941-3.100=-0.159
max3.253-4.052=-0.799

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.213-1.300=-0.086
σ0.275-0.436=-0.161
min0.917-0.935=-0.018
max1.622-1.790=-0.168

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.460-440.374=0.086
σ573.035-572.881=0.154
min153.937-153.931=0.006
max1300.012-1299.695=0.317
mean94.250
σ8.500
min90.000
max107.000
mean1612.000-1620.000=-8.000
σ0.000
min1612.000-1620.000=-8.000
max1612.000-1620.000=-8.000
mean0.548-0.515=0.033
σ0.557-0.511=0.046
min0.265-0.257=0.007
max1.384-1.282=0.102
policies=20
mean1539.576-1539.514=0.062
σ0.301-0.304=-0.003
min1539.385-1539.319=0.066
max1540.025-1539.966=0.058
mean900.000
σ0.000
min900.000
max900.000
mean1612.000-1620.000=-8.000
σ0.000
min1612.000-1620.000=-8.000
max1612.000-1620.000=-8.000
mean2.568-2.570=-0.001
σ0.031-0.021=0.010
min2.537-2.544=-0.007
max2.612-2.595=0.016
policies=200
mean15403.726-15403.189=0.537
σ0.092-0.024=0.068
min15403.606-15403.165=0.441
max15403.804-15403.221=0.583
mean9000.000
σ0.000
min9000.000
max9000.000
mean1612.000-1620.000=-8.000
σ0.000
min1612.000-1620.000=-8.000
max1612.000-1620.000=-8.000
mean25.912-26.136=-0.224
σ0.174-0.179=-0.005
min25.745-25.888=-0.143
max26.106-26.299=-0.193