Compare commits

Home / Compare 685ddd20 .. b97b4d65

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.969-35.970=-0.001
σ0.105-0.104=0.001
min35.920-35.927=-0.007
max36.266-36.266=-0.000
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.072-0.077=-0.005
σ0.004-0.004=-0.000
min0.070-0.075=-0.005
max0.080-0.085=-0.006
cache=y
dps=1
iters=10
policies=100
mean26.208-26.207=0.000
σ0.005-0.004=0.001
min26.202-26.203=-0.001
max26.218-26.214=0.004
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.059-0.059=-0.000
σ0.003-0.003=-0.000
min0.056-0.056=-0.000
max0.065-0.066=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.760-1757.760=0.001
σ0.369-0.369=-0.000
min1757.184-1757.182=0.002
max1758.358-1758.342=0.016
mean1652.750-1652.800=-0.050
σ633.272-626.233=7.039
min618.000-672.000=-54.000
max2779.000-2683.000=96.000
mean2.377-2.371=0.007
σ0.124-0.114=0.010
min2.242-2.226=0.016
max2.822-2.690=0.132

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean280.286-280.290=-0.004
σ0.010-0.003=0.007
min280.273-280.286=-0.013
max280.300-280.295=0.006
mean2779.000-2683.000=96.000
σ0.000
min2779.000-2683.000=96.000
max2779.000-2683.000=96.000
mean0.410-0.412=-0.001
σ0.002-0.001=0.000
min0.408-0.410=-0.002
max0.412-0.414=-0.002
iters=5
new-facts=1
prior-facts=6402
mean2270.319-2270.294=0.025
σ0.025-0.026=-0.001
min2270.287-2270.263=0.024
max2270.355-2270.323=0.032
mean2779.000-2683.000=96.000
σ0.000
min2779.000-2683.000=96.000
max2779.000-2683.000=96.000
mean3.210-2.986=0.224
σ0.320-0.114=0.205
min2.861-2.826=0.035
max3.643-3.118=0.525
iters=5
new-facts=6402
prior-facts=1
mean5147.357-5147.582=-0.225
σ1.169-1.012=0.157
min5146.539-5146.996=-0.457
max5149.381-5149.382=-0.001
mean2779.000-2683.000=96.000
σ0.000
min2779.000-2683.000=96.000
max2779.000-2683.000=96.000
mean8.759-8.990=-0.231
σ0.626-0.585=0.042
min8.157-8.287=-0.130
max9.629-9.689=-0.060
iters=5
new-facts=6402
prior-facts=6402
mean5285.582-5285.572=0.010
σ0.220-0.136=0.084
min5285.224-5285.367=-0.143
max5285.765-5285.748=0.017
mean3448.200-3487.600=-39.400
σ414.639-541.401=-126.762
min2836.000-2770.000=66.000
max3918.000-4004.000=-86.000
mean10.083-9.949=0.134
σ0.326-0.511=-0.184
min9.617-9.185=0.432
max10.508-10.445=0.063

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.034-1.026=0.008
σ0.065-0.112=-0.047
min0.954-0.939=0.015
max1.084-1.203=-0.119

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.303-464.298=0.005
σ572.662-572.656=0.005
min177.963-177.963=0.000
max1323.296-1323.283=0.013
mean81.500
σ7.000
min78.000
max92.000
mean2779.000-2683.000=96.000
σ0.000
min2779.000-2683.000=96.000
max2779.000-2683.000=96.000
mean0.442-0.560=-0.118
σ0.308-0.559=-0.251
min0.282-0.278=0.004
max0.903-1.398=-0.495
policies=20
mean1779.957-1779.915=0.042
σ0.365-0.376=-0.011
min1779.714-1779.689=0.025
max1780.489-1780.477=0.012
mean780.000
σ0.000
min780.000
max780.000
mean2779.000-2683.000=96.000
σ0.000
min2779.000-2683.000=96.000
max2779.000-2683.000=96.000
mean2.853-2.791=0.062
σ0.070-0.024=0.046
min2.798-2.756=0.042
max2.952-2.812=0.140
policies=200
mean17805.993-17805.992=0.001
σ0.532-0.471=0.061
min17805.659-17805.739=-0.080
max17806.781-17806.698=0.083
mean7800.000
σ0.000
min7800.000
max7800.000
mean2779.000-2683.000=96.000
σ0.000
min2779.000-2683.000=96.000
max2779.000-2683.000=96.000
mean28.007-28.055=-0.048
σ0.120-0.131=-0.011
min27.893-27.896=-0.004
max28.143-28.186=-0.043