Compare commits

Home / Compare eb8f9945 .. 6c8e6676

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.967-35.957=0.010
σ0.102-0.101=0.001
min35.926-35.911=0.016
max36.258-36.243=0.015
mean412.000-413.900=-1.900
σ0.000-0.316=-0.316
min412.000-413.000=-1.000
max412.000-414.000=-2.000
mean0.075-0.078=-0.003
σ0.004-0.004=0.000
min0.069-0.075=-0.006
max0.084-0.084=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.208-26.203=0.005
σ0.003-0.003=-0.000
min26.204-26.198=0.006
max26.212-26.208=0.004
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.059-0.061=-0.002
σ0.004-0.003=0.001
min0.056-0.059=-0.003
max0.068-0.069=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.759-1756.305=1.454
σ0.369-0.369=0.000
min1757.182-1755.730=1.452
max1758.354-1756.899=1.455
mean1653.250-1678.850=-25.600
σ629.113-638.420=-9.307
min621.000-679.000=-58.000
max2752.000-2697.000=55.000
mean2.408-2.330=0.078
σ0.168-0.065=0.103
min2.285-2.248=0.037
max2.921-2.442=0.479

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.940-278.824=0.115
σ0.010-0.004=0.006
min278.929-278.822=0.107
max278.953-278.832=0.121
mean2752.000-2697.000=55.000
σ0.000
min2752.000-2697.000=55.000
max2752.000-2697.000=55.000
mean0.411-0.412=-0.001
σ0.004-0.006=-0.002
min0.406-0.407=-0.001
max0.414-0.419=-0.005
iters=5
new-facts=1
prior-facts=6402
mean2177.844-2268.882=-91.039
σ0.047-0.018=0.029
min2177.768-2268.868=-91.100
max2177.885-2268.914=-91.029
mean2752.000-2697.000=55.000
σ0.000
min2752.000-2697.000=55.000
max2752.000-2697.000=55.000
mean3.265-3.134=0.132
σ0.267-0.205=0.062
min3.001-2.913=0.088
max3.683-3.392=0.291
iters=5
new-facts=6402
prior-facts=1
mean5055.452-4954.170=101.283
σ1.207-1.022=0.185
min5054.428-4953.353=101.075
max5057.506-4955.945=101.561
mean2752.000-2697.000=55.000
σ0.000
min2752.000-2697.000=55.000
max2752.000-2697.000=55.000
mean8.676-8.068=0.608
σ0.577-0.420=0.157
min8.124-7.665=0.459
max9.338-8.708=0.630
iters=5
new-facts=6402
prior-facts=6402
mean5193.116-5168.826=24.290
σ0.120-0.088=0.031
min5192.939-5168.729=24.210
max5193.275-5168.903=24.373
mean3240.200-3341.200=-101.000
σ449.864-396.533=53.330
min2752.000-2947.000=-195.000
max3860.000-3740.000=120.000
mean8.748-9.223=-0.475
σ0.195-0.216=-0.021
min8.549-8.976=-0.427
max9.065-9.537=-0.472

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.019-0.993=0.026
σ0.142-0.093=0.050
min0.953-0.941=0.012
max1.274-1.157=0.116

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.314-460.351=3.963
σ572.662-572.653=0.009
min177.975-174.022=3.953
max1323.307-1319.331=3.976
mean81.500-79.500=2.000
σ7.000
min78.000-76.000=2.000
max92.000-90.000=2.000
mean2752.000-2697.000=55.000
σ0.000
min2752.000-2697.000=55.000
max2752.000-2697.000=55.000
mean0.430-0.539=-0.109
σ0.280-0.548=-0.268
min0.283-0.263=0.020
max0.850-1.361=-0.511
policies=20
mean1779.965-1740.436=39.529
σ0.328-0.313=0.015
min1779.722-1740.251=39.471
max1780.447-1740.904=39.543
mean780.000-760.000=20.000
σ0.000
min780.000-760.000=20.000
max780.000-760.000=20.000
mean2752.000-2697.000=55.000
σ0.000
min2752.000-2697.000=55.000
max2752.000-2697.000=55.000
mean2.826-2.690=0.136
σ0.102-0.027=0.075
min2.757-2.657=0.099
max2.974-2.716=0.259
policies=200
mean17805.930-17411.261=394.668
σ0.544-0.424=0.120
min17805.601-17411.004=394.597
max17806.743-17411.896=394.848
mean7800.000-7600.000=200.000
σ0.000
min7800.000-7600.000=200.000
max7800.000-7600.000=200.000
mean2752.000-2697.000=55.000
σ0.000
min2752.000-2697.000=55.000
max2752.000-2697.000=55.000
mean28.010-26.988=1.022
σ0.108-0.112=-0.004
min27.887-26.874=1.013
max28.122-27.118=1.004