Compare commits

Home / Compare 2a77f566 .. 53569e00

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.974-35.951=0.024
σ0.107-0.103=0.004
min35.922-35.904=0.018
max36.277-36.242=0.035
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.076-0.074=0.002
σ0.004-0.005=-0.001
min0.070-0.070=0.001
max0.085-0.084=0.001
cache=y
dps=1
iters=10
policies=100
mean26.208-26.200=0.008
σ0.003-0.004=-0.001
min26.205-26.195=0.010
max26.214-26.207=0.007
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.061-0.059=0.002
σ0.002-0.003=-0.001
min0.059-0.056=0.003
max0.067-0.066=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.364-1756.298=2.066
σ0.372-0.368=0.004
min1757.787-1755.723=2.064
max1758.964-1756.894=2.070
mean1657.800-1660.600=-2.800
σ624.076-631.177=-7.101
min686.000-621.000=65.000
max2771.000-2729.000=42.000
mean2.386-2.368=0.018
σ0.122-0.128=-0.006
min2.126-2.256=-0.130
max2.604-2.787=-0.183

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.507-278.820=0.687
σ0.003-0.008=-0.005
min279.504-278.811=0.693
max279.512-278.831=0.681
mean2771.000-2729.000=42.000
σ0.000
min2771.000-2729.000=42.000
max2771.000-2729.000=42.000
mean0.413-0.416=-0.003
σ0.007-0.010=-0.002
min0.407-0.407=0.000
max0.423-0.431=-0.008
iters=5
new-facts=1
prior-facts=6402
mean2178.426-2268.883=-90.457
σ0.041-0.013=0.028
min2178.353-2268.872=-90.520
max2178.452-2268.905=-90.453
mean2771.000-2729.000=42.000
σ0.000
min2771.000-2729.000=42.000
max2771.000-2729.000=42.000
mean3.343-3.015=0.327
σ0.066-0.194=-0.127
min3.245-2.728=0.516
max3.405-3.233=0.172
iters=5
new-facts=6402
prior-facts=1
mean5056.383-4954.252=102.131
σ0.982-0.860=0.122
min5055.760-4953.819=101.941
max5058.124-4955.786=102.339
mean2771.000-2729.000=42.000
σ0.000
min2771.000-2729.000=42.000
max2771.000-2729.000=42.000
mean9.224-8.048=1.175
σ0.534-0.386=0.148
min8.279-7.700=0.580
max9.575-8.702=0.873
iters=5
new-facts=6402
prior-facts=6402
mean5193.758-5168.717=25.041
σ0.094-0.201=-0.107
min5193.685-5168.379=25.306
max5193.871-5168.874=24.997
mean3287.600-3395.400=-107.800
σ448.120-493.039=-44.919
min2771.000-2820.000=-49.000
max3911.000-4129.000=-218.000
mean8.949-9.282=-0.333
σ0.066-0.233=-0.167
min8.859-8.937=-0.079
max9.043-9.540=-0.497

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.999-0.977=0.022
σ0.062-0.057=0.005
min0.944-0.942=0.002
max1.076-1.078=-0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.477-459.807=5.670
σ572.655-571.584=1.072
min179.145-174.007=5.138
max1324.460-1317.183=7.277
mean79.500
σ7.000
min76.000
max90.000
mean2771.000-2729.000=42.000
σ0.000
min2771.000-2729.000=42.000
max2771.000-2729.000=42.000
mean0.480-0.560=-0.080
σ0.284-0.582=-0.298
min0.279-0.268=0.011
max0.887-1.433=-0.546
policies=20
mean1791.702-1740.312=51.390
σ0.316-0.314=0.003
min1791.459-1740.116=51.343
max1792.165-1740.780=51.385
mean760.000
σ0.000
min760.000
max760.000
mean2771.000-2729.000=42.000
σ0.000
min2771.000-2729.000=42.000
max2771.000-2729.000=42.000
mean2.800-2.688=0.112
σ0.014-0.020=-0.007
min2.787-2.661=0.126
max2.817-2.709=0.108
policies=200
mean17923.394-17410.205=513.189
σ0.371-0.481=-0.111
min17923.195-17409.950=513.245
max17923.949-17410.926=513.023
mean7600.000
σ0.000
min7600.000
max7600.000
mean2771.000-2729.000=42.000
σ0.000
min2771.000-2729.000=42.000
max2771.000-2729.000=42.000
mean28.278-27.085=1.193
σ0.105-0.049=0.056
min28.153-27.018=1.135
max28.399-27.127=1.272