Compare commits

Home / Compare 6323ff38 .. 0f6dde54

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.046-31.046=0.000
σ0.049-0.049=0.000
min31.003-31.008=-0.005
max31.181-31.182=-0.001
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.078-0.080=-0.002
σ0.004-0.004=0.000
min0.071-0.077=-0.006
max0.086-0.087=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.146-21.146=-0.000
σ0.002-0.003=-0.002
min21.143-21.139=0.005
max21.148-21.149=-0.002
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.060-0.065=-0.006
σ0.003-0.004=-0.000
min0.058-0.061=-0.003
max0.068-0.074=-0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.407-1751.411=-0.004
σ0.360-0.362=-0.001
min1750.840-1750.837=0.003
max1751.973-1751.992=-0.018
mean1641.150-1641.450=-0.300
σ615.184-618.321=-3.136
min630.000-628.000=2.000
max2475.000-2480.000=-5.000
mean2.752-2.799=-0.047
σ0.185-0.110=0.075
min2.492-2.496=-0.004
max3.031-2.962=0.069

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.778-266.779=-0.001
σ0.005-0.010=-0.005
min266.771-266.765=0.006
max266.782-266.788=-0.006
mean2475.000-2480.000=-5.000
σ0.000
min2475.000-2480.000=-5.000
max2475.000-2480.000=-5.000
mean0.365-0.369=-0.004
σ0.003-0.010=-0.006
min0.361-0.363=-0.002
max0.370-0.387=-0.017
iters=5
new-facts=1
prior-facts=6402
mean1927.212-1927.209=0.003
σ0.010-0.009=0.001
min1927.202-1927.200=0.003
max1927.223-1927.219=0.005
mean2475.000-2480.000=-5.000
σ0.000
min2475.000-2480.000=-5.000
max2475.000-2480.000=-5.000
mean2.924-2.973=-0.048
σ0.275-0.084=0.191
min2.460-2.879=-0.419
max3.170-3.092=0.078
iters=5
new-facts=6402
prior-facts=1
mean4747.684-4747.768=-0.084
σ0.953-0.846=0.107
min4746.927-4747.259=-0.332
max4749.336-4749.268=0.068
mean2475.000-2480.000=-5.000
σ0.000
min2475.000-2480.000=-5.000
max2475.000-2480.000=-5.000
mean8.213-8.346=-0.133
σ0.441-0.283=0.158
min7.692-8.068=-0.375
max8.907-8.702=0.205
iters=5
new-facts=6402
prior-facts=6402
mean4938.196-4938.199=-0.003
σ0.087-0.092=-0.004
min4938.094-4938.091=0.003
max4938.279-4938.274=0.004
mean2969.200-2957.600=11.600
σ434.536-417.961=16.575
min2475.000-2480.000=-5.000
max3556.000-3522.000=34.000
mean8.598-8.546=0.052
σ0.419-0.267=0.152
min8.299-8.289=0.010
max9.315-8.969=0.346

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.747-1.786=-0.039
σ0.136-0.126=0.010
min1.512-1.566=-0.054
max1.865-1.866=-0.000

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.108-465.110=-0.002
σ575.755-575.754=0.001
min177.227-177.229=-0.002
max1328.741-1328.741=0.001
mean79.750
σ7.500
min76.000
max91.000
mean2475.000-2480.000=-5.000
σ0.000
min2475.000-2480.000=-5.000
max2475.000-2480.000=-5.000
mean0.564-0.551=0.013
σ0.561-0.538=0.023
min0.281-0.278=0.003
max1.406-1.359=0.047
policies=20
mean1772.554-1772.555=-0.002
σ0.333-0.334=-0.001
min1772.334-1772.335=-0.001
max1773.048-1773.052=-0.004
mean760.000
σ0.000
min760.000
max760.000
mean2475.000-2480.000=-5.000
σ0.000
min2475.000-2480.000=-5.000
max2475.000-2480.000=-5.000
mean2.736-2.745=-0.009
σ0.003-0.013=-0.010
min2.731-2.733=-0.002
max2.739-2.757=-0.018
policies=200
mean17732.345-17732.203=0.142
σ0.463-0.452=0.011
min17732.050-17731.891=0.159
max17733.037-17732.860=0.177
mean7600.000
σ0.000
min7600.000
max7600.000
mean2475.000-2480.000=-5.000
σ0.000
min2475.000-2480.000=-5.000
max2475.000-2480.000=-5.000
mean27.601-27.681=-0.080
σ0.137-0.089=0.048
min27.522-27.599=-0.076
max27.806-27.797=0.009