Compare commits

Home / Compare 9a8d6118 .. e8f41c51

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.700-70.702=-0.002
σ0.046-0.047=-0.001
min70.672-70.668=0.004
max70.828-70.833=-0.005
mean412.800-415.000=-2.200
σ0.422-0.000=0.422
min412.000-415.000=-3.000
max413.000-415.000=-2.000
mean0.161-0.160=0.000
σ0.004-0.002=0.002
min0.157-0.157=-0.000
max0.167-0.164=0.002
cache=y
dps=1
iters=10
policies=100
mean21.409-21.408=0.001
σ0.002-0.003=-0.001
min21.407-21.405=0.001
max21.412-21.415=-0.003
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.066-0.066=-0.000
σ0.003-0.003=0.000
min0.064-0.063=0.001
max0.075-0.072=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.930-1754.930=-0.000
σ0.361-0.362=-0.001
min1754.356-1754.363=-0.006
max1755.519-1755.514=0.005
mean1655.500-1645.250=10.250
σ620.093-632.234=-12.141
min680.000-622.000=58.000
max2771.000-2770.000=1.000
mean2.821-2.799=0.022
σ0.180-0.213=-0.033
min2.319-2.336=-0.017
max3.053-3.124=-0.071

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean3.819
σ0.000
min3.819
max3.819
mean2770.000
σ0.000
min2770.000
max2770.000
mean0.817
σ0.000
min0.817
max0.817
name=error_case.art
mean10.998
σ0.000
min10.998
max10.998
mean2770.000
σ0.000
min2770.000
max2770.000
mean4.383
σ0.000
min4.383
max4.383
name=heavy_item.art
mean7.432
σ0.000
min7.432
max7.432
mean2770.000
σ0.000
min2770.000
max2770.000
mean2.441
σ0.000
min2.441
max2.441
name=nested_use.art
mean11.073
σ0.000
min11.073
max11.073
mean2770.000
σ0.000
min2770.000
max2770.000
mean4.378
σ0.000
min4.378
max4.378

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean4668.614
σ0.000
min4668.614
max4668.614
mean2770.000
σ0.000
min2770.000
max2770.000
mean2.282
σ0.000
min2.282
max2.282
name=cdr_enhanced_4k_loc.art
mean4303.813
σ0.000
min4303.813
max4303.813
mean2770.000
σ0.000
min2770.000
max2770.000
mean2.105
σ0.000
min2.105
max2.105

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean752.155
σ0.000
min752.155
max752.155
mean2770.000
σ0.000
min2770.000
max2770.000
mean344.811
σ0.000
min344.811
max344.811
name=record_render_large_syntax_err.art
mean747.274
σ0.000
min747.274
max747.274
mean2770.000
σ0.000
min2770.000
max2770.000
mean342.802
σ0.000
min342.802
max342.802
name=record_render_success.art
mean222.487
σ0.000
min222.487
max222.487
mean2770.000
σ0.000
min2770.000
max2770.000
mean99.762
σ0.000
min99.762
max99.762
name=record_render_syntax_err.art
mean210.255
σ0.000
min210.255
max210.255
mean2770.000
σ0.000
min2770.000
max2770.000
mean91.778
σ0.000
min91.778
max91.778

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.795-272.791=0.004
σ0.007-0.007=0.000
min272.786-272.781=0.005
max272.803-272.800=0.003
mean2771.000-2770.000=1.000
σ0.000
min2771.000-2770.000=1.000
max2771.000-2770.000=1.000
mean0.382-0.377=0.005
σ0.005-0.001=0.004
min0.378-0.376=0.002
max0.389-0.379=0.010
iters=5
new-facts=1
prior-facts=6402
mean1933.227-1933.219=0.008
σ0.011-0.013=-0.002
min1933.211-1933.198=0.013
max1933.239-1933.234=0.005
mean2771.000-2770.000=1.000
σ0.000
min2771.000-2770.000=1.000
max2771.000-2770.000=1.000
mean3.199-3.084=0.115
σ0.058-0.086=-0.028
min3.121-3.020=0.102
max3.278-3.233=0.045
iters=5
new-facts=6402
prior-facts=1
mean4757.049-4756.957=0.092
σ7.545-7.623=-0.078
min4753.554-4753.473=0.081
max4770.545-4770.593=-0.047
mean2771.000-2770.000=1.000
σ0.000
min2771.000-2770.000=1.000
max2771.000-2770.000=1.000
mean7.931-8.572=-0.640
σ0.414-0.370=0.044
min7.616-7.966=-0.350
max8.627-8.891=-0.264
iters=5
new-facts=6402
prior-facts=6402
mean4944.394-4944.457=-0.063
σ0.162-0.024=0.138
min4944.105-4944.427=-0.322
max4944.479-4944.484=-0.005
mean2969.200-3033.200=-64.000
σ259.429-289.247=-29.818
min2771.000-2770.000=1.000
max3347.000-3430.000=-83.000
mean8.626-8.485=0.141
σ0.264-0.123=0.141
min8.349-8.376=-0.027
max8.999-8.695=0.305

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.008-1.029=-0.020
σ0.145-0.125=0.019
min0.913-0.916=-0.003
max1.246-1.225=0.020

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.311-468.303=0.008
σ574.233-574.236=-0.002
min181.184-181.183=0.001
max1329.660-1329.657=0.004
mean88.250
σ8.500
min84.000
max101.000
mean2771.000-2770.000=1.000
σ0.000
min2771.000-2770.000=1.000
max2771.000-2770.000=1.000
mean0.439-0.566=-0.127
σ0.291-0.560=-0.268
min0.290-0.282=0.008
max0.876-1.405=-0.530
policies=20
mean1812.203-1812.151=0.052
σ0.394-0.396=-0.002
min1811.935-1811.883=0.052
max1812.784-1812.736=0.048
mean840.000
σ0.000
min840.000
max840.000
mean2771.000-2770.000=1.000
σ0.000
min2771.000-2770.000=1.000
max2771.000-2770.000=1.000
mean2.883-2.812=0.070
σ0.013-0.011=0.002
min2.864-2.803=0.061
max2.892-2.823=0.069
policies=200
mean18129.075-18128.977=0.098
σ0.482-0.551=-0.070
min18128.740-18128.499=0.242
max18129.789-18129.767=0.023
mean8400.000
σ0.000
min8400.000
max8400.000
mean2771.000-2770.000=1.000
σ0.000
min2771.000-2770.000=1.000
max2771.000-2770.000=1.000
mean28.366-28.432=-0.066
σ0.211-0.095=0.117
min28.207-28.323=-0.115
max28.673-28.536=0.136