Compare commits

Home / Compare 09f3ea81 .. 724e48ae

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.055=-0.001
σ0.368-0.367=0.001
min53.908-53.919=-0.012
max55.102-55.100=0.002
mean414.000-414.700=-0.700
σ0.000-0.483=-0.483
min414.000
max414.000-415.000=-1.000
mean0.135-0.141=-0.006
σ0.004-0.005=-0.001
min0.132-0.136=-0.004
max0.143-0.150=-0.006
cache=y
dps=1
iters=10
policies=100
mean43.394-43.393=0.001
σ0.008-0.006=0.002
min43.385-43.387=-0.002
max43.411-43.405=0.005
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.123-0.121=0.002
σ0.004-0.004=0.000
min0.117-0.115=0.002
max0.130-0.126=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.001-1007.003=-0.002
σ1.213-1.207=0.006
min1006.458-1006.459=-0.001
max1012.090-1012.068=0.022
mean1049.250-1037.250=12.000
σ306.136-298.355=7.782
min574.000-580.000=-6.000
max1647.000-1581.000=66.000
mean1.583-1.575=0.008
σ0.069-0.118=-0.049
min1.519-1.375=0.144
max1.747-1.878=-0.131

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.884=-0.000
σ0.003-0.003=-0.001
min0.882
max0.887-0.888=-0.001
mean1647.000-1581.000=66.000
σ0.000
min1647.000-1581.000=66.000
max1647.000-1581.000=66.000
mean0.414-0.415=-0.002
σ0.136-0.144=-0.008
min0.328-0.327=0.001
max0.654-0.670=-0.016
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1647.000-1581.000=66.000
σ0.000
min1647.000-1581.000=66.000
max1647.000-1581.000=66.000
mean0.888-0.891=-0.003
σ0.103-0.111=-0.008
min0.824-0.793=0.030
max1.070-1.081=-0.011
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1647.000-1581.000=66.000
σ0.000
min1647.000-1581.000=66.000
max1647.000-1581.000=66.000
mean0.534-0.533=0.000
σ0.060-0.045=0.014
min0.491-0.491=0.000
max0.635-0.609=0.026
name=nested_use.art
mean2.361-2.362=-0.001
σ0.002-0.002=-0.000
min2.360
max2.364-2.365=-0.001
mean1647.000-1581.000=66.000
σ0.000
min1647.000-1581.000=66.000
max1647.000-1581.000=66.000
mean0.843-0.846=-0.002
σ0.047-0.041=0.005
min0.797-0.805=-0.008
max0.921-0.913=0.008

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.831=0.009
σ0.036-0.025=0.011
min964.811-964.807=0.003
max964.898-964.864=0.035
mean1647.000-1581.000=66.000
σ0.000
min1647.000-1581.000=66.000
max1647.000-1581.000=66.000
mean0.815-0.821=-0.006
σ0.047-0.059=-0.012
min0.751-0.723=0.029
max0.860-0.868=-0.008
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.008-0.005=0.003
min885.504
max885.523-885.516=0.007
mean1647.000-1581.000=66.000
σ0.000
min1647.000-1581.000=66.000
max1647.000-1581.000=66.000
mean0.706-0.716=-0.009
σ0.039-0.027=0.012
min0.657-0.677=-0.020
max0.741-0.742=-0.001

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.719
mean1647.000-1581.000=66.000
σ0.000
min1647.000-1581.000=66.000
max1647.000-1581.000=66.000
mean4.258-4.260=-0.002
σ0.101-0.108=-0.007
min4.074-4.110=-0.036
max4.674-4.955=-0.281
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668-7.669=-0.001
mean1647.000-1581.000=66.000
σ0.000
min1647.000-1581.000=66.000
max1647.000-1581.000=66.000
mean4.263-4.226=0.037
σ0.084-0.071=0.013
min4.109-4.091=0.018
max4.539-4.473=0.067
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1647.000-1581.000=66.000
σ0.000
min1647.000-1581.000=66.000
max1647.000-1581.000=66.000
mean0.744-0.731=0.012
σ0.017-0.042=-0.026
min0.717-0.531=0.186
max0.842-0.937=-0.095
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1647.000-1581.000=66.000
σ0.000
min1647.000-1581.000=66.000
max1647.000-1581.000=66.000
mean0.701-0.696=0.004
σ0.017-0.017=0.001
min0.627-0.668=-0.042
max0.770-0.773=-0.004

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.860-297.076=-0.216
σ0.230-0.195=0.034
min296.685-296.923=-0.238
max297.478-297.569=-0.091
mean1938.000-1944.000=-6.000
σ0.000
min1938.000-1944.000=-6.000
max1938.000-1944.000=-6.000
mean0.588-0.585=0.003
σ0.023-0.057=-0.034
min0.532-0.502=0.030
max0.611-0.708=-0.096

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.821-286.823=-0.002
σ0.039-0.036=0.003
min286.776-286.773=0.002
max286.870-286.857=0.013
mean1647.000-1581.000=66.000
σ0.000
min1647.000-1581.000=66.000
max1647.000-1581.000=66.000
mean0.404-0.395=0.009
σ0.012-0.007=0.006
min0.392-0.389=0.003
max0.422-0.402=0.020
iters=5
new-facts=1
prior-facts=6402
mean1297.264-1297.272=-0.008
σ0.108-0.109=-0.001
min1297.110-1297.113=-0.002
max1297.402-1297.408=-0.005
mean1647.000-1581.000=66.000
σ0.000
min1647.000-1581.000=66.000
max1647.000-1581.000=66.000
mean2.204-2.252=-0.047
σ0.025-0.065=-0.040
min2.179-2.144=0.034
max2.237-2.312=-0.075
iters=5
new-facts=6402
prior-facts=1
mean1541.375-1541.365=0.010
σ6.826-6.797=0.029
min1538.205-1538.205=0.001
max1553.584-1553.523=0.061
mean1647.000-1581.000=66.000
σ0.000
min1647.000-1581.000=66.000
max1647.000-1581.000=66.000
mean2.311-2.293=0.018
σ0.185-0.257=-0.072
min2.166-2.064=0.102
max2.610-2.720=-0.110
iters=5
new-facts=6402
prior-facts=6402
mean1859.118-1859.115=0.003
σ0.066-0.064=0.002
min1859.036-1859.033=0.003
max1859.184-1859.176=0.008
mean1786.200-1769.800=16.400
σ146.180-173.223=-27.043
min1647.000-1581.000=66.000
max1938.000-1944.000=-6.000
mean2.979-3.059=-0.080
σ0.189-0.399=-0.210
min2.825-2.702=0.123
max3.268-3.737=-0.469

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.182-1.298=-0.117
σ0.358-0.388=-0.030
min0.941-0.928=0.012
max1.795-1.810=-0.015

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.820-448.822=-0.001
σ581.372-581.372=0.000
min158.131-158.134=-0.003
max1320.879-1320.880=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1647.000-1581.000=66.000
σ0.000
min1647.000-1581.000=66.000
max1647.000-1581.000=66.000
mean0.543-0.554=-0.010
σ0.557-0.583=-0.026
min0.261-0.254=0.007
max1.379-1.428=-0.050
policies=20
mean1581.620-1581.606=0.014
σ0.362-0.369=-0.007
min1581.377-1581.373=0.005
max1582.159-1582.157=0.002
mean920.000
σ0.000
min920.000
max920.000
mean1647.000-1581.000=66.000
σ0.000
min1647.000-1581.000=66.000
max1647.000-1581.000=66.000
mean2.647-2.652=-0.005
σ0.014-0.008=0.006
min2.634-2.642=-0.008
max2.663-2.659=0.004
policies=200
mean15824.029-15824.170=-0.141
σ0.144-0.186=-0.042
min15823.906-15823.970=-0.065
max15824.230-15824.419=-0.189
mean9200.000
σ0.000
min9200.000
max9200.000
mean1647.000-1581.000=66.000
σ0.000
min1647.000-1581.000=66.000
max1647.000-1581.000=66.000
mean26.865-26.710=0.155
σ0.036-0.046=-0.010
min26.830-26.646=0.184
max26.896-26.752=0.144