Compare commits

Home / Compare f1d6b70c .. 3fbe49fa

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.056=-0.001
σ0.367-0.367=-0.001
min53.909-53.908=0.001
max55.099-55.101=-0.002
mean415.000-414.700=0.300
σ0.000-0.483=-0.483
min415.000-414.000=1.000
max415.000
mean0.140-0.139=0.000
σ0.004-0.004=-0.000
min0.136-0.136=-0.000
max0.146-0.147=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.395-43.395=-0.000
σ0.007-0.007=-0.001
min43.384-43.385=-0.001
max43.404-43.406=-0.002
mean415.000
σ0.000
min415.000
max415.000
mean0.123-0.122=0.001
σ0.004-0.004=-0.000
min0.119-0.118=0.001
max0.128-0.129=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.959-1006.961=-0.001
σ0.882-0.875=0.007
min1006.492-1006.462=0.030
max1010.620-1010.585=0.035
mean1036.350-1047.250=-10.900
σ301.221-308.257=-7.036
min546.000-551.000=-5.000
max1583.000-1646.000=-63.000
mean1.523-1.535=-0.012
σ0.094-0.078=0.016
min1.351-1.436=-0.085
max1.758-1.775=-0.016

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1583.000-1646.000=-63.000
σ0.000
min1583.000-1646.000=-63.000
max1583.000-1646.000=-63.000
mean0.442-0.421=0.021
σ0.186-0.135=0.052
min0.331-0.346=-0.014
max0.773-0.661=0.112
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1583.000-1646.000=-63.000
σ0.000
min1583.000-1646.000=-63.000
max1583.000-1646.000=-63.000
mean0.903-0.894=0.009
σ0.167-0.099=0.068
min0.808-0.825=-0.018
max1.198-1.067=0.131
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1583.000-1646.000=-63.000
σ0.000
min1583.000-1646.000=-63.000
max1583.000-1646.000=-63.000
mean0.528-0.537=-0.009
σ0.054-0.048=0.006
min0.484-0.502=-0.018
max0.619-0.621=-0.002
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1583.000-1646.000=-63.000
σ0.000
min1583.000-1646.000=-63.000
max1583.000-1646.000=-63.000
mean0.840-0.851=-0.010
σ0.034-0.031=0.003
min0.805-0.828=-0.023
max0.897-0.905=-0.008

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.839=-0.001
σ0.032-0.034=-0.002
min964.815-964.809=0.005
max964.895-964.895=0.000
mean1583.000-1646.000=-63.000
σ0.000
min1583.000-1646.000=-63.000
max1583.000-1646.000=-63.000
mean0.807-0.828=-0.021
σ0.055-0.030=0.024
min0.747-0.795=-0.047
max0.867-0.860=0.007
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.000
σ0.006-0.007=-0.001
min885.504
max885.520-885.521=-0.001
mean1583.000-1646.000=-63.000
σ0.000
min1583.000-1646.000=-63.000
max1583.000-1646.000=-63.000
mean0.719-0.739=-0.020
σ0.035-0.003=0.032
min0.669-0.734=-0.065
max0.745-0.742=0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.722-7.721=0.001
mean1583.000-1646.000=-63.000
σ0.000
min1583.000-1646.000=-63.000
max1583.000-1646.000=-63.000
mean4.257-4.232=0.025
σ0.072-0.097=-0.025
min4.120-4.060=0.061
max4.491-4.719=-0.228
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1583.000-1646.000=-63.000
σ0.000
min1583.000-1646.000=-63.000
max1583.000-1646.000=-63.000
mean4.250-4.222=0.028
σ0.065-0.076=-0.010
min4.131-4.091=0.040
max4.473-4.529=-0.056
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1583.000-1646.000=-63.000
σ0.000
min1583.000-1646.000=-63.000
max1583.000-1646.000=-63.000
mean0.754-0.741=0.014
σ0.019-0.018=0.001
min0.716-0.706=0.010
max0.873-0.852=0.021
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1583.000-1646.000=-63.000
σ0.000
min1583.000-1646.000=-63.000
max1583.000-1646.000=-63.000
mean0.712-0.711=0.001
σ0.015-0.026=-0.012
min0.681-0.518=0.163
max0.795-0.790=0.005

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.541-295.652=-0.111
σ0.251-0.194=0.057
min295.316-295.527=-0.210
max296.229-296.183=0.046
mean1922.000-1909.000=13.000
σ0.000
min1922.000-1909.000=13.000
max1922.000-1909.000=13.000
mean0.577-0.565=0.012
σ0.053-0.046=0.007
min0.508-0.502=0.006
max0.689-0.636=0.053

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.394-285.395=-0.001
σ0.037-0.041=-0.004
min285.349-285.344=0.004
max285.430-285.438=-0.008
mean1583.000-1646.000=-63.000
σ0.000
min1583.000-1646.000=-63.000
max1583.000-1646.000=-63.000
mean0.388-0.391=-0.003
σ0.005-0.008=-0.003
min0.384-0.381=0.003
max0.396-0.399=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1295.748-1295.776=-0.029
σ0.110-0.107=0.003
min1295.663-1295.660=0.003
max1295.930-1295.909=0.021
mean1583.000-1646.000=-63.000
σ0.000
min1583.000-1646.000=-63.000
max1583.000-1646.000=-63.000
mean1.965-1.910=0.055
σ0.218-0.079=0.139
min1.707-1.807=-0.100
max2.263-1.993=0.270
iters=5
new-facts=6402
prior-facts=1
mean1539.945-1539.903=0.043
σ6.826-6.873=-0.047
min1536.743-1536.576=0.168
max1552.153-1552.191=-0.038
mean1583.000-1646.000=-63.000
σ0.000
min1583.000-1646.000=-63.000
max1583.000-1646.000=-63.000
mean2.272-2.284=-0.013
σ0.211-0.252=-0.041
min2.091-1.972=0.120
max2.619-2.559=0.060
iters=5
new-facts=6402
prior-facts=6402
mean1857.690-1857.687=0.003
σ0.056-0.061=-0.005
min1857.641-1857.606=0.034
max1857.772-1857.762=0.010
mean1770.200-1778.000=-7.800
σ156.066-130.037=26.030
min1583.000-1646.000=-63.000
max1922.000-1909.000=13.000
mean3.072-3.065=0.007
σ0.305-0.277=0.028
min2.823-2.858=-0.035
max3.592-3.542=0.050

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.282-1.204=0.078
σ0.290-0.368=-0.078
min1.022-0.941=0.081
max1.758-1.821=-0.064

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.708-445.707=0.000
σ580.933-580.934=-0.001
min155.239-155.238=0.001
max1317.108-1317.109=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1583.000-1646.000=-63.000
σ0.000
min1583.000-1646.000=-63.000
max1583.000-1646.000=-63.000
mean0.544-0.550=-0.007
σ0.566-0.582=-0.016
min0.260-0.258=0.002
max1.392-1.423=-0.031
policies=20
mean1552.662-1552.658=0.004
σ0.334-0.332=0.002
min1552.434-1552.431=0.003
max1553.158-1553.151=0.007
mean920.000
σ0.000
min920.000
max920.000
mean1583.000-1646.000=-63.000
σ0.000
min1583.000-1646.000=-63.000
max1583.000-1646.000=-63.000
mean2.599-2.602=-0.004
σ0.011-0.005=0.005
min2.588-2.595=-0.006
max2.613-2.607=0.006
policies=200
mean15534.684-15534.735=-0.051
σ0.051-0.109=-0.058
min15534.619-15534.669=-0.050
max15534.736-15534.898=-0.162
mean9200.000
σ0.000
min9200.000
max9200.000
mean1583.000-1646.000=-63.000
σ0.000
min1583.000-1646.000=-63.000
max1583.000-1646.000=-63.000
mean26.237-26.181=0.056
σ0.094-0.033=0.062
min26.145-26.141=0.003
max26.369-26.220=0.149