Compare commits

Home / Compare 4add429a .. 5f73d022

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.054=-0.000
σ0.368-0.370=-0.002
min53.911-53.909=0.002
max55.101-55.108=-0.007
mean415.000
σ0.000
min415.000
max415.000
mean0.141-0.140=0.001
σ0.003-0.005=-0.002
min0.138-0.132=0.006
max0.146-0.147=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.393-43.393=0.001
σ0.006-0.007=-0.001
min43.387-43.384=0.003
max43.405-43.407=-0.002
mean415.000
σ0.000
min415.000
max415.000
mean0.122-0.121=0.000
σ0.005-0.004=0.001
min0.115-0.115=-0.001
max0.129-0.130=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.004-1007.005=-0.001
σ1.198-1.200=-0.003
min1006.460-1006.443=0.018
max1012.026-1012.039=-0.013
mean1038.650-1050.200=-11.550
σ298.683-309.011=-10.328
min580.000-574.000=6.000
max1584.000-1647.000=-63.000
mean1.556-1.557=-0.001
σ0.091-0.080=0.011
min1.484-1.481=0.002
max1.807-1.777=0.029

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1584.000-1647.000=-63.000
σ0.000
min1584.000-1647.000=-63.000
max1584.000-1647.000=-63.000
mean0.414-0.419=-0.005
σ0.129-0.137=-0.008
min0.338-0.332=0.005
max0.642-0.661=-0.020
name=error_case.art
mean2.339-2.339=-0.001
σ0.003-0.002=0.000
min2.337
max2.342
mean1584.000-1647.000=-63.000
σ0.000
min1584.000-1647.000=-63.000
max1584.000-1647.000=-63.000
mean0.887-0.865=0.022
σ0.095-0.099=-0.004
min0.828-0.802=0.025
max1.054-1.039=0.014
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1584.000-1647.000=-63.000
σ0.000
min1584.000-1647.000=-63.000
max1584.000-1647.000=-63.000
mean0.536-0.522=0.014
σ0.052-0.050=0.002
min0.497-0.486=0.011
max0.626-0.607=0.019
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1584.000-1647.000=-63.000
σ0.000
min1584.000-1647.000=-63.000
max1584.000-1647.000=-63.000
mean0.835-0.838=-0.003
σ0.041-0.040=0.002
min0.798-0.795=0.003
max0.904-0.901=0.003

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.839=-0.008
σ0.026-0.035=-0.009
min964.803-964.811=-0.008
max964.862-964.897=-0.035
mean1584.000-1647.000=-63.000
σ0.000
min1584.000-1647.000=-63.000
max1584.000-1647.000=-63.000
mean0.842-0.842=0.000
σ0.021-0.031=-0.010
min0.805-0.788=0.017
max0.859-0.865=-0.006
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.000
σ0.008-0.007=0.001
min885.504
max885.523-885.523=0.001
mean1584.000-1647.000=-63.000
σ0.000
min1584.000-1647.000=-63.000
max1584.000-1647.000=-63.000
mean0.721-0.726=-0.005
σ0.026-0.030=-0.004
min0.688-0.675=0.012
max0.744-0.753=-0.009

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.720=0.000
mean1584.000-1647.000=-63.000
σ0.000
min1584.000-1647.000=-63.000
max1584.000-1647.000=-63.000
mean4.184-4.208=-0.024
σ0.069-0.090=-0.021
min4.061-4.046=0.015
max4.480-4.575=-0.096
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1584.000-1647.000=-63.000
σ0.000
min1584.000-1647.000=-63.000
max1584.000-1647.000=-63.000
mean4.204-4.215=-0.011
σ0.075-0.092=-0.017
min4.076-4.030=0.046
max4.492-4.599=-0.106
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1584.000-1647.000=-63.000
σ0.000
min1584.000-1647.000=-63.000
max1584.000-1647.000=-63.000
mean0.738-0.739=-0.001
σ0.018-0.018=0.000
min0.708-0.700=0.007
max0.838-0.848=-0.009
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1584.000-1647.000=-63.000
σ0.000
min1584.000-1647.000=-63.000
max1584.000-1647.000=-63.000
mean0.697-0.694=0.003
σ0.016-0.016=-0.001
min0.668-0.665=0.003
max0.791-0.785=0.006

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.854-296.833=0.021
σ0.221-0.221=0.000
min296.664-296.701=-0.037
max297.457-297.428=0.029
mean1923.000-1902.000=21.000
σ0.000
min1923.000-1902.000=21.000
max1923.000-1902.000=21.000
mean0.582-0.587=-0.005
σ0.043-0.054=-0.011
min0.510-0.509=0.001
max0.653-0.702=-0.050

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.826-286.820=0.006
σ0.036-0.037=-0.001
min286.778-286.770=0.008
max286.862-286.857=0.005
mean1584.000-1647.000=-63.000
σ0.000
min1584.000-1647.000=-63.000
max1584.000-1647.000=-63.000
mean0.395-0.393=0.002
σ0.013-0.006=0.007
min0.386-0.386=0.000
max0.419-0.400=0.019
iters=5
new-facts=1
prior-facts=6402
mean1297.275-1297.271=0.004
σ0.088-0.091=-0.003
min1297.170-1297.158=0.011
max1297.403-1297.397=0.005
mean1584.000-1647.000=-63.000
σ0.000
min1584.000-1647.000=-63.000
max1584.000-1647.000=-63.000
mean2.242-2.269=-0.027
σ0.051-0.159=-0.108
min2.175-2.139=0.036
max2.299-2.544=-0.245
iters=5
new-facts=6402
prior-facts=1
mean1541.341-1541.344=-0.003
σ6.827-6.841=-0.014
min1538.127-1538.091=0.036
max1553.551-1553.578=-0.027
mean1584.000-1647.000=-63.000
σ0.000
min1584.000-1647.000=-63.000
max1584.000-1647.000=-63.000
mean2.248-2.242=0.006
σ0.153-0.170=-0.017
min2.111-2.130=-0.020
max2.452-2.544=-0.091
iters=5
new-facts=6402
prior-facts=6402
mean1859.109-1859.119=-0.010
σ0.071-0.066=0.005
min1859.023-1859.030=-0.007
max1859.192-1859.196=-0.004
mean1759.400-1777.400=-18.000
σ161.757-125.801=35.956
min1584.000-1647.000=-63.000
max1923.000-1902.000=21.000
mean2.995-3.123=-0.128
σ0.185-0.285=-0.100
min2.836-2.833=0.003
max3.305-3.550=-0.245

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.387-1.194=0.193
σ0.427-0.318=0.109
min0.931-0.930=0.001
max1.857-1.612=0.245

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-448.822=-0.000
σ581.372-581.372=-0.000
min158.134-158.134=0.000
max1320.879-1320.879=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1584.000-1647.000=-63.000
σ0.000
min1584.000-1647.000=-63.000
max1584.000-1647.000=-63.000
mean0.561-0.562=-0.002
σ0.586-0.598=-0.011
min0.263-0.261=0.002
max1.440-1.459=-0.019
policies=20
mean1581.626-1581.629=-0.003
σ0.362-0.360=0.002
min1581.384-1581.386=-0.001
max1582.164-1582.163=0.000
mean920.000
σ0.000
min920.000
max920.000
mean1584.000-1647.000=-63.000
σ0.000
min1584.000-1647.000=-63.000
max1584.000-1647.000=-63.000
mean2.642-2.638=0.004
σ0.012-0.014=-0.002
min2.629-2.630=-0.001
max2.655-2.659=-0.004
policies=200
mean15824.145-15824.126=0.019
σ0.141-0.166=-0.025
min15824.012-15824.024=-0.012
max15824.344-15824.373=-0.029
mean9200.000
σ0.000
min9200.000
max9200.000
mean1584.000-1647.000=-63.000
σ0.000
min1584.000-1647.000=-63.000
max1584.000-1647.000=-63.000
mean26.618-26.630=-0.012
σ0.098-0.038=0.060
min26.522-26.603=-0.081
max26.755-26.686=0.068