Compare commits

Home / Compare 87adedc7 .. c0a68aa7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.045-54.046=-0.000
σ0.368-0.369=-0.000
min53.901-53.902=-0.001
max55.092-55.094=-0.002
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.139-0.138=0.001
σ0.004-0.004=0.000
min0.133-0.132=0.001
max0.145-0.143=0.002
cache=y
dps=1
iters=10
policies=100
mean43.385-43.382=0.003
σ0.006-0.007=-0.001
min43.376-43.370=0.006
max43.395-43.393=0.001
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.124-0.121=0.003
σ0.004-0.005=-0.000
min0.118-0.113=0.005
max0.129-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.980-1006.980=-0.000
σ0.871-0.867=0.004
min1006.509-1006.506=0.002
max1010.582-1010.566=0.016
mean1052.600-1045.550=7.050
σ319.974-314.582=5.392
min576.000
max1619.000-1643.000=-24.000
mean1.560-1.563=-0.003
σ0.124-0.094=0.030
min1.468-1.495=-0.027
max2.047-1.896=0.151

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1619.000-1643.000=-24.000
σ0.000
min1619.000-1643.000=-24.000
max1619.000-1643.000=-24.000
mean0.428-0.417=0.012
σ0.139-0.134=0.005
min0.330-0.336=-0.006
max0.663-0.652=0.011
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1619.000-1643.000=-24.000
σ0.000
min1619.000-1643.000=-24.000
max1619.000-1643.000=-24.000
mean0.858-0.867=-0.010
σ0.085-0.089=-0.004
min0.800-0.803=-0.003
max1.003-1.022=-0.018
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1619.000-1643.000=-24.000
σ0.000
min1619.000-1643.000=-24.000
max1619.000-1643.000=-24.000
mean0.531-0.531=-0.000
σ0.046-0.049=-0.003
min0.499-0.491=0.008
max0.610-0.616=-0.006
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1619.000-1643.000=-24.000
σ0.000
min1619.000-1643.000=-24.000
max1619.000-1643.000=-24.000
mean0.831-0.833=-0.002
σ0.048-0.043=0.006
min0.793-0.794=-0.000
max0.909-0.905=0.004

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.836-964.833=0.003
σ0.035-0.027=0.009
min964.811-964.812=-0.001
max964.897-964.877=0.020
mean1619.000-1643.000=-24.000
σ0.000
min1619.000-1643.000=-24.000
max1619.000-1643.000=-24.000
mean0.826-0.829=-0.003
σ0.019-0.022=-0.003
min0.801-0.804=-0.004
max0.845-0.853=-0.009
name=cdr_enhanced_4k_loc.art
mean885.512-885.511=0.001
σ0.005-0.005=-0.000
min885.504-885.505=-0.001
max885.517-885.515=0.001
mean1619.000-1643.000=-24.000
σ0.000
min1619.000-1643.000=-24.000
max1619.000-1643.000=-24.000
mean0.704-0.675=0.029
σ0.051-0.054=-0.003
min0.615-0.599=0.016
max0.735-0.742=-0.006

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.720-7.721=-0.000
mean1619.000-1643.000=-24.000
σ0.000
min1619.000-1643.000=-24.000
max1619.000-1643.000=-24.000
mean4.230-4.208=0.022
σ0.091-0.096=-0.005
min4.098-4.064=0.034
max4.579-4.560=0.019
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668
mean1619.000-1643.000=-24.000
σ0.000
min1619.000-1643.000=-24.000
max1619.000-1643.000=-24.000
mean4.195-4.204=-0.009
σ0.084-0.074=0.010
min4.054-4.049=0.005
max4.508-4.520=-0.013
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1619.000-1643.000=-24.000
σ0.000
min1619.000-1643.000=-24.000
max1619.000-1643.000=-24.000
mean0.729-0.741=-0.012
σ0.035-0.016=0.018
min0.520-0.710=-0.190
max0.841-0.844=-0.003
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1619.000-1643.000=-24.000
σ0.000
min1619.000-1643.000=-24.000
max1619.000-1643.000=-24.000
mean0.694-0.703=-0.009
σ0.029-0.019=0.009
min0.659-0.658=0.001
max0.894-0.805=0.089

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.619-295.712=-0.092
σ0.229-0.213=0.016
min295.361-295.519=-0.158
max296.200-296.287=-0.087
mean1921.000-1909.000=12.000
σ0.000
min1921.000-1909.000=12.000
max1921.000-1909.000=12.000
mean0.591-0.577=0.014
σ0.022-0.049=-0.027
min0.573-0.510=0.064
max0.645-0.680=-0.035

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.406-285.413=-0.007
σ0.038-0.036=0.002
min285.351-285.373=-0.022
max285.442-285.451=-0.009
mean1619.000-1643.000=-24.000
σ0.000
min1619.000-1643.000=-24.000
max1619.000-1643.000=-24.000
mean0.383-0.397=-0.014
σ0.005-0.014=-0.009
min0.379-0.381=-0.002
max0.392-0.411=-0.019
iters=5
new-facts=1
prior-facts=6402
mean1295.796-1295.790=0.006
σ0.122-0.101=0.022
min1295.638-1295.670=-0.033
max1295.981-1295.899=0.082
mean1619.000-1643.000=-24.000
σ0.000
min1619.000-1643.000=-24.000
max1619.000-1643.000=-24.000
mean2.033-1.938=0.094
σ0.262-0.144=0.118
min1.788-1.812=-0.024
max2.313-2.170=0.143
iters=5
new-facts=6402
prior-facts=1
mean1539.915-1539.924=-0.009
σ6.838-6.890=-0.051
min1536.657-1536.613=0.044
max1552.144-1552.244=-0.100
mean1619.000-1643.000=-24.000
σ0.000
min1619.000-1643.000=-24.000
max1619.000-1643.000=-24.000
mean2.173-2.309=-0.137
σ0.096-0.275=-0.179
min2.087-2.036=0.050
max2.311-2.673=-0.362
iters=5
new-facts=6402
prior-facts=6402
mean1857.706-1857.709=-0.003
σ0.056-0.048=0.008
min1857.646-1857.660=-0.014
max1857.769-1857.777=-0.008
mean1770.800-1777.400=-6.600
σ147.493-130.571=16.922
min1619.000-1643.000=-24.000
max1921.000-1909.000=12.000
mean2.997-3.114=-0.117
σ0.092-0.370=-0.279
min2.884-2.884=-0.000
max3.093-3.772=-0.679

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.289-1.440=-0.151
σ0.284-0.206=0.079
min0.991-1.263=-0.273
max1.732-1.780=-0.048

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.741-445.741=-0.000
σ580.934-580.934=-0.000
min155.272-155.273=-0.000
max1317.142-1317.143=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1619.000-1643.000=-24.000
σ0.000
min1619.000-1643.000=-24.000
max1619.000-1643.000=-24.000
mean0.553-0.544=0.009
σ0.589-0.560=0.029
min0.257-0.263=-0.006
max1.435-1.383=0.052
policies=20
mean1552.986-1552.987=-0.001
σ0.340-0.326=0.015
min1552.756-1552.764=-0.008
max1553.492-1553.471=0.021
mean920.000
σ0.000
min920.000
max920.000
mean1619.000-1643.000=-24.000
σ0.000
min1619.000-1643.000=-24.000
max1619.000-1643.000=-24.000
mean2.620-2.589=0.031
σ0.078-0.007=0.070
min2.571-2.581=-0.010
max2.734-2.597=0.138
policies=200
mean15537.989-15538.051=-0.061
σ0.116-0.071=0.045
min15537.839-15537.986=-0.147
max15538.096-15538.124=-0.028
mean9200.000
σ0.000
min9200.000
max9200.000
mean1619.000-1643.000=-24.000
σ0.000
min1619.000-1643.000=-24.000
max1619.000-1643.000=-24.000
mean26.066-26.186=-0.119
σ0.189-0.105=0.083
min25.929-26.109=-0.180
max26.337-26.340=-0.004