Compare commits

Home / Compare 03dd8fd4 .. 14d932c4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.056=-0.002
σ0.370-0.369=0.001
min53.904-53.913=-0.009
max55.106-55.105=0.000
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.138-0.141=-0.003
σ0.005-0.004=0.002
min0.132-0.137=-0.005
max0.149-0.146=0.003
cache=y
dps=1
iters=10
policies=100
mean43.393-43.394=-0.001
σ0.007-0.007=-0.000
min43.384-43.385=-0.001
max43.407-43.408=-0.001
mean416.000-413.000=3.000
σ0.000
min416.000-413.000=3.000
max416.000-413.000=3.000
mean0.123-0.122=0.000
σ0.004-0.004=0.000
min0.118-0.119=-0.001
max0.129-0.129=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.002-1007.004=-0.002
σ1.185-1.188=-0.003
min1006.433-1006.433=-0.000
max1011.971-1011.984=-0.013
mean1043.700-1049.600=-5.900
σ305.592-308.793=-3.201
min589.000-574.000=15.000
max1630.000-1646.000=-16.000
mean1.549-1.520=0.029
σ0.096-0.085=0.011
min1.454-1.341=0.112
max1.797-1.755=0.042

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1630.000-1646.000=-16.000
σ0.000
min1630.000-1646.000=-16.000
max1630.000-1646.000=-16.000
mean0.417-0.421=-0.004
σ0.128-0.139=-0.011
min0.350-0.339=0.011
max0.645-0.667=-0.023
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1630.000-1646.000=-16.000
σ0.000
min1630.000-1646.000=-16.000
max1630.000-1646.000=-16.000
mean0.884-0.884=-0.000
σ0.093-0.091=0.002
min0.822-0.820=0.002
max1.048-1.042=0.006
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1630.000-1646.000=-16.000
σ0.000
min1630.000-1646.000=-16.000
max1630.000-1646.000=-16.000
mean0.561-0.534=0.027
σ0.066-0.044=0.022
min0.495-0.494=0.000
max0.640-0.604=0.036
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1630.000-1646.000=-16.000
σ0.000
min1630.000-1646.000=-16.000
max1630.000-1646.000=-16.000
mean0.852-0.849=0.003
σ0.045-0.048=-0.003
min0.814-0.811=0.003
max0.926-0.931=-0.005

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.839=0.000
σ0.033-0.028=0.004
min964.812-964.819=-0.006
max964.894-964.886=0.009
mean1630.000-1646.000=-16.000
σ0.000
min1630.000-1646.000=-16.000
max1630.000-1646.000=-16.000
mean0.823-0.831=-0.008
σ0.033-0.036=-0.002
min0.783-0.776=0.006
max0.855-0.864=-0.009
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.000
σ0.007-0.007=0.000
min885.504-885.505=-0.001
max885.522-885.522=-0.000
mean1630.000-1646.000=-16.000
σ0.000
min1630.000-1646.000=-16.000
max1630.000-1646.000=-16.000
mean0.733-0.727=0.005
σ0.010-0.022=-0.012
min0.718-0.694=0.024
max0.743-0.747=-0.004

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.721-7.722=-0.001
mean1630.000-1646.000=-16.000
σ0.000
min1630.000-1646.000=-16.000
max1630.000-1646.000=-16.000
mean4.182-3.551=0.631
σ0.068-0.079=-0.011
min4.063-3.321=0.741
max4.409-3.822=0.587
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1630.000-1646.000=-16.000
σ0.000
min1630.000-1646.000=-16.000
max1630.000-1646.000=-16.000
mean4.178-3.523=0.656
σ0.123-0.075=0.048
min3.296-3.355=-0.059
max4.552-3.771=0.781
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1630.000-1646.000=-16.000
σ0.000
min1630.000-1646.000=-16.000
max1630.000-1646.000=-16.000
mean0.751-0.752=-0.001
σ0.028-0.021=0.007
min0.711-0.712=-0.002
max0.935-0.862=0.073
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1630.000-1646.000=-16.000
σ0.000
min1630.000-1646.000=-16.000
max1630.000-1646.000=-16.000
mean0.710-0.707=0.004
σ0.028-0.015=0.013
min0.507-0.676=-0.170
max0.800-0.786=0.014

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.744-296.928=-0.184
σ0.206-0.205=0.002
min296.614-296.726=-0.112
max297.317-297.472=-0.155
mean1956.000-1930.000=26.000
σ0.000
min1956.000-1930.000=26.000
max1956.000-1930.000=26.000
mean0.582-0.592=-0.011
σ0.038-0.048=-0.010
min0.510-0.506=0.004
max0.636-0.691=-0.055

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.819-286.820=-0.001
σ0.036-0.040=-0.004
min286.769-286.764=0.005
max286.855-286.861=-0.006
mean1630.000-1646.000=-16.000
σ0.000
min1630.000-1646.000=-16.000
max1630.000-1646.000=-16.000
mean0.395-0.400=-0.005
σ0.006-0.007=-0.000
min0.388-0.389=-0.001
max0.403-0.407=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1297.253-1297.254=-0.001
σ0.079-0.080=-0.001
min1297.166-1297.168=-0.002
max1297.343-1297.343=0.000
mean1630.000-1646.000=-16.000
σ0.000
min1630.000-1646.000=-16.000
max1630.000-1646.000=-16.000
mean2.102-2.103=-0.001
σ0.077-0.078=-0.000
min2.004-2.014=-0.010
max2.195-2.207=-0.012
iters=5
new-facts=6402
prior-facts=1
mean1541.306-1541.309=-0.003
σ6.832-6.838=-0.006
min1538.072-1538.049=0.023
max1553.523-1553.536=-0.014
mean1630.000-1646.000=-16.000
σ0.000
min1630.000-1646.000=-16.000
max1630.000-1646.000=-16.000
mean2.162-2.177=-0.015
σ0.071-0.085=-0.014
min2.062-2.121=-0.059
max2.248-2.327=-0.079
iters=5
new-facts=6402
prior-facts=6402
mean1859.111-1859.122=-0.012
σ0.081-0.064=0.018
min1858.989-1859.040=-0.051
max1859.185-1859.192=-0.007
mean1789.400-1781.400=8.000
σ163.199-142.765=20.434
min1630.000-1646.000=-16.000
max1956.000-1930.000=26.000
mean2.996-3.001=-0.005
σ0.113-0.074=0.039
min2.858-2.883=-0.024
max3.150-3.086=0.064

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.251-1.178=0.073
σ0.309-0.319=-0.011
min1.060-0.942=0.118
max1.785-1.702=0.083

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-448.822=-0.001
σ581.372-581.372=0.000
min158.133-158.134=-0.001
max1320.879-1320.880=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1630.000-1646.000=-16.000
σ0.000
min1630.000-1646.000=-16.000
max1630.000-1646.000=-16.000
mean0.556-0.550=0.006
σ0.584-0.565=0.019
min0.261-0.263=-0.003
max1.432-1.397=0.035
policies=20
mean1581.615-1581.613=0.002
σ0.355-0.352=0.003
min1581.374-1581.389=-0.015
max1582.143-1582.138=0.005
mean920.000
σ0.000
min920.000
max920.000
mean1630.000-1646.000=-16.000
σ0.000
min1630.000-1646.000=-16.000
max1630.000-1646.000=-16.000
mean2.635-2.641=-0.006
σ0.014-0.012=0.002
min2.621-2.632=-0.012
max2.653-2.659=-0.006
policies=200
mean15824.040-15824.177=-0.137
σ0.174-0.156=0.018
min15823.871-15824.031=-0.160
max15824.283-15824.394=-0.111
mean9200.000
σ0.000
min9200.000
max9200.000
mean1630.000-1646.000=-16.000
σ0.000
min1630.000-1646.000=-16.000
max1630.000-1646.000=-16.000
mean26.609-26.646=-0.038
σ0.057-0.044=0.013
min26.554-26.598=-0.044
max26.658-26.705=-0.047