Compare commits

Home / Compare d3760426 .. a10e4fca

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-31.040=0.000
σ0.048-0.049=-0.001
min30.998-30.998=0.001
max31.173-31.176=-0.002
mean414.000-412.900=1.100
σ0.000-0.316=-0.316
min414.000-412.000=2.000
max414.000-413.000=1.000
mean0.079-0.079=0.000
σ0.002-0.003=-0.000
min0.077-0.077=-0.000
max0.086-0.085=0.000
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=-0.001
σ0.003-0.003=0.000
min21.139-21.137=0.002
max21.147-21.148=-0.001
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.063-0.064=-0.001
σ0.003-0.003=0.001
min0.059-0.060=-0.001
max0.069-0.071=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.412-1751.411=0.001
σ0.359-0.361=-0.002
min1750.842-1750.846=-0.004
max1751.975-1751.977=-0.002
mean1637.900-1656.100=-18.200
σ614.663-646.658=-31.995
min628.000-633.000=-5.000
max2469.000-2859.000=-390.000
mean2.829-2.763=0.066
σ0.098-0.177=-0.079
min2.669-2.304=0.365
max3.015-3.028=-0.013

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.781-266.781=0.000
σ0.005-0.009=-0.004
min266.775-266.771=0.004
max266.787-266.793=-0.005
mean2469.000-2859.000=-390.000
σ0.000
min2469.000-2859.000=-390.000
max2469.000-2859.000=-390.000
mean0.368-0.365=0.002
σ0.004-0.001=0.003
min0.363-0.364=-0.001
max0.374-0.367=0.006
iters=5
new-facts=1
prior-facts=6402
mean1927.203-1927.208=-0.005
σ0.011-0.011=-0.001
min1927.186-1927.193=-0.007
max1927.215-1927.222=-0.008
mean2469.000-2859.000=-390.000
σ0.000
min2469.000-2859.000=-390.000
max2469.000-2859.000=-390.000
mean3.041-3.015=0.025
σ0.093-0.097=-0.004
min2.915-2.924=-0.009
max3.165-3.163=0.002
iters=5
new-facts=6402
prior-facts=1
mean4747.625-4747.722=-0.097
σ0.506-0.807=-0.301
min4747.295-4747.295=-0.000
max4748.519-4749.161=-0.643
mean2469.000-2859.000=-390.000
σ0.000
min2469.000-2859.000=-390.000
max2469.000-2859.000=-390.000
mean8.304-8.363=-0.059
σ0.587-0.663=-0.076
min7.749-7.693=0.056
max9.203-9.194=0.009
iters=5
new-facts=6402
prior-facts=6402
mean4938.158-4938.162=-0.004
σ0.080-0.081=-0.001
min4938.085-4938.094=-0.008
max4938.247-4938.252=-0.005
mean2939.600-3088.600=-149.000
σ400.013-308.840=91.173
min2494.000-2859.000=-365.000
max3465.000-3570.000=-105.000
mean8.402-8.366=0.036
σ0.094-0.139=-0.045
min8.324-8.211=0.112
max8.560-8.592=-0.031

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.844-1.046=0.798
σ0.156-0.189=-0.033
min1.718-0.931=0.787
max2.114-1.369=0.745

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.112-465.120=-0.008
σ575.753-575.753=-0.001
min177.230-177.236=-0.006
max1328.741-1328.750=-0.009
mean79.750
σ7.500
min76.000
max91.000
mean2469.000-2859.000=-390.000
σ0.000
min2469.000-2859.000=-390.000
max2469.000-2859.000=-390.000
mean0.553-0.438=0.115
σ0.547-0.305=0.242
min0.274-0.285=-0.010
max1.374-0.896=0.478
policies=20
mean1772.578-1772.626=-0.048
σ0.319-0.328=-0.010
min1772.367-1772.399=-0.032
max1773.050-1773.110=-0.059
mean760.000
σ0.000
min760.000
max760.000
mean2469.000-2859.000=-390.000
σ0.000
min2469.000-2859.000=-390.000
max2469.000-2859.000=-390.000
mean2.740-2.831=-0.091
σ0.023-0.011=0.012
min2.706-2.823=-0.117
max2.754-2.845=-0.091
policies=200
mean17732.328-17732.535=-0.207
σ0.621-0.476=0.145
min17731.790-17732.159=-0.369
max17733.211-17733.227=-0.016
mean7600.000
σ0.000
min7600.000
max7600.000
mean2469.000-2859.000=-390.000
σ0.000
min2469.000-2859.000=-390.000
max2469.000-2859.000=-390.000
mean27.702-28.156=-0.454
σ0.140-0.410=-0.270
min27.569-27.773=-0.204
max27.870-28.665=-0.795