Compare commits

Home / Compare 02657dc2 .. bf7f6431

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.041-31.041=0.000
σ0.050-0.050=0.000
min31.003-30.997=0.006
max31.181-31.179=0.002
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.080-0.079=0.001
σ0.004-0.004=0.000
min0.077-0.072=0.004
max0.089-0.084=0.004
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=0.000
σ0.002-0.002=0.000
min21.141-21.140=0.001
max21.147-21.146=0.001
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.062-0.062=-0.000
σ0.004-0.004=0.001
min0.058-0.058=-0.001
max0.072-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.414-1751.413=0.002
σ0.361-0.359=0.002
min1750.842-1750.847=-0.005
max1751.991-1751.994=-0.004
mean1637.650-1661.700=-24.050
σ616.786-640.421=-23.635
min627.000-621.000=6.000
max2473.000-2834.000=-361.000
mean2.872-2.838=0.034
σ0.086-0.247=-0.161
min2.658-2.218=0.440
max3.047-3.142=-0.095

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.788-266.785=0.002
σ0.007-0.009=-0.002
min266.780-266.775=0.005
max266.796-266.796=0.001
mean2473.000-2834.000=-361.000
σ0.000
min2473.000-2834.000=-361.000
max2473.000-2834.000=-361.000
mean0.373-0.378=-0.004
σ0.004-0.010=-0.005
min0.370-0.371=-0.001
max0.380-0.394=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1927.199-1927.210=-0.011
σ0.011-0.008=0.003
min1927.188-1927.201=-0.014
max1927.216-1927.223=-0.007
mean2473.000-2834.000=-361.000
σ0.000
min2473.000-2834.000=-361.000
max2473.000-2834.000=-361.000
mean3.014-3.088=-0.074
σ0.135-0.132=0.003
min2.894-2.984=-0.090
max3.236-3.294=-0.057
iters=5
new-facts=6402
prior-facts=1
mean4747.658-4747.593=0.064
σ0.898-0.949=-0.051
min4747.144-4746.791=0.353
max4749.253-4749.240=0.013
mean2473.000-2834.000=-361.000
σ0.000
min2473.000-2834.000=-361.000
max2473.000-2834.000=-361.000
mean8.786-8.525=0.261
σ0.500-0.653=-0.154
min8.056-7.596=0.459
max9.360-9.287=0.073
iters=5
new-facts=6402
prior-facts=6402
mean4938.025-4938.169=-0.144
σ0.270-0.087=0.182
min4937.559-4938.101=-0.542
max4938.265-4938.271=-0.006
mean2955.000-3072.800=-117.800
σ265.966-224.318=41.648
min2597.000-2834.000=-237.000
max3305.000-3402.000=-97.000
mean8.440-8.556=-0.115
σ0.100-0.188=-0.088
min8.321-8.384=-0.064
max8.526-8.764=-0.238

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.823-1.030=0.793
σ0.125-0.143=-0.018
min1.630-0.933=0.697
max1.959-1.260=0.699

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.115-465.121=-0.006
σ575.754-575.757=-0.003
min177.234-177.240=-0.007
max1328.745-1328.757=-0.011
mean79.750
σ7.500
min76.000
max91.000
mean2473.000-2834.000=-361.000
σ0.000
min2473.000-2834.000=-361.000
max2473.000-2834.000=-361.000
mean0.564-0.440=0.124
σ0.575-0.310=0.265
min0.269-0.284=-0.015
max1.426-0.905=0.521
policies=20
mean1772.594-1772.648=-0.053
σ0.321-0.326=-0.006
min1772.386-1772.410=-0.024
max1773.072-1773.125=-0.053
mean760.000
σ0.000
min760.000
max760.000
mean2473.000-2834.000=-361.000
σ0.000
min2473.000-2834.000=-361.000
max2473.000-2834.000=-361.000
mean2.758-2.836=-0.078
σ0.027-0.008=0.019
min2.736-2.827=-0.091
max2.794-2.843=-0.049
policies=200
mean17732.597-17732.606=-0.009
σ0.559-0.529=0.030
min17732.216-17732.218=-0.002
max17733.414-17733.379=0.035
mean7600.000
σ0.000
min7600.000
max7600.000
mean2473.000-2834.000=-361.000
σ0.000
min2473.000-2834.000=-361.000
max2473.000-2834.000=-361.000
mean27.629-27.881=-0.252
σ0.071-0.160=-0.089
min27.553-27.672=-0.119
max27.721-28.024=-0.303