Compare commits

Home / Compare 065d580b .. 199fc5e4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.208-54.207=0.001
σ0.370-0.369=0.001
min54.063-54.060=0.003
max55.260-55.256=0.004
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.140-0.137=0.003
σ0.004-0.005=-0.001
min0.136-0.130=0.005
max0.146-0.145=0.001
cache=y
dps=1
iters=10
policies=100
mean43.494-43.493=0.001
σ0.006-0.007=-0.000
min43.484-43.483=0.002
max43.505-43.503=0.002
mean417.000-418.000=-1.000
σ0.000
min417.000-418.000=-1.000
max417.000-418.000=-1.000
mean0.124-0.122=0.001
σ0.004-0.004=-0.000
min0.120-0.116=0.004
max0.130-0.128=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.638-1007.634=0.004
σ0.866-0.879=-0.013
min1007.140-1007.145=-0.005
max1011.215-1011.274=-0.058
mean1048.250-1046.050=2.200
σ317.894-316.045=1.849
min576.000
max1657.000-1652.000=5.000
mean1.551-1.560=-0.008
σ0.071-0.068=0.003
min1.457-1.467=-0.010
max1.749-1.744=0.005

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1657.000-1652.000=5.000
σ0.000
min1657.000-1652.000=5.000
max1657.000-1652.000=5.000
mean0.419-0.419=0.000
σ0.142-0.119=0.022
min0.330-0.350=-0.020
max0.671-0.630=0.042
name=error_case.art
mean2.339-2.339=-0.000
σ0.003-0.003=-0.000
min2.337
max2.342
mean1657.000-1652.000=5.000
σ0.000
min1657.000-1652.000=5.000
max1657.000-1652.000=5.000
mean0.876-0.871=0.005
σ0.084-0.085=-0.002
min0.826-0.811=0.015
max1.024-1.017=0.007
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1657.000-1652.000=5.000
σ0.000
min1657.000-1652.000=5.000
max1657.000-1652.000=5.000
mean0.534-0.538=-0.005
σ0.048-0.053=-0.005
min0.501-0.495=0.006
max0.614-0.623=-0.009
name=nested_use.art
mean2.361-2.361=-0.000
σ0.002-0.002=-0.001
min2.360
max2.364-2.365=-0.001
mean1657.000-1652.000=5.000
σ0.000
min1657.000-1652.000=5.000
max1657.000-1652.000=5.000
mean0.845-0.838=0.007
σ0.046-0.036=0.010
min0.804-0.797=0.007
max0.920-0.895=0.026

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.830-964.832=-0.002
σ0.022-0.027=-0.005
min964.813-964.802=0.011
max964.867-964.869=-0.002
mean1657.000-1652.000=5.000
σ0.000
min1657.000-1652.000=5.000
max1657.000-1652.000=5.000
mean0.810-0.821=-0.011
σ0.030-0.039=-0.009
min0.772-0.788=-0.016
max0.848-0.867=-0.019
name=cdr_enhanced_4k_loc.art
mean885.511-885.514=-0.003
σ0.006-0.006=-0.000
min885.504
max885.517-885.519=-0.002
mean1657.000-1652.000=5.000
σ0.000
min1657.000-1652.000=5.000
max1657.000-1652.000=5.000
mean0.701-0.726=-0.024
σ0.037-0.028=0.009
min0.660-0.677=-0.017
max0.752-0.743=0.009

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.719
mean1657.000-1652.000=5.000
σ0.000
min1657.000-1652.000=5.000
max1657.000-1652.000=5.000
mean4.234-4.226=0.008
σ0.078-0.088=-0.010
min4.092-3.955=0.137
max4.475-4.486=-0.012
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1657.000-1652.000=5.000
σ0.000
min1657.000-1652.000=5.000
max1657.000-1652.000=5.000
mean4.229-4.244=-0.015
σ0.092-0.083=0.009
min4.052-4.094=-0.043
max4.512-4.543=-0.032
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1657.000-1652.000=5.000
σ0.000
min1657.000-1652.000=5.000
max1657.000-1652.000=5.000
mean0.742-0.743=-0.001
σ0.017-0.033=-0.016
min0.703-0.704=-0.001
max0.841-0.917=-0.076
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1657.000-1652.000=5.000
σ0.000
min1657.000-1652.000=5.000
max1657.000-1652.000=5.000
mean0.534-0.704=-0.170
σ0.079-0.064=0.015
min0.479-0.661=-0.182
max0.773-1.308=-0.535

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.183-296.189=-0.006
σ0.267-0.246=0.021
min295.938-296.047=-0.109
max296.907-296.871=0.035
mean1972.000-1967.000=5.000
σ0.000
min1972.000-1967.000=5.000
max1972.000-1967.000=5.000
mean0.570-0.563=0.007
σ0.064-0.036=0.028
min0.505-0.516=-0.011
max0.713-0.634=0.079

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.981-286.985=-0.004
σ0.040-0.038=0.002
min286.925-286.937=-0.012
max287.025-287.033=-0.008
mean1657.000-1652.000=5.000
σ0.000
min1657.000-1652.000=5.000
max1657.000-1652.000=5.000
mean0.398-0.397=0.000
σ0.010-0.007=0.003
min0.390-0.391=-0.001
max0.414-0.408=0.006
iters=5
new-facts=1
prior-facts=6402
mean1297.357-1297.357=0.000
σ0.110-0.108=0.002
min1297.230-1297.231=-0.001
max1297.491-1297.488=0.002
mean1657.000-1652.000=5.000
σ0.000
min1657.000-1652.000=5.000
max1657.000-1652.000=5.000
mean1.952-1.948=0.004
σ0.052-0.048=0.004
min1.867-1.874=-0.006
max1.995-1.986=0.010
iters=5
new-facts=6402
prior-facts=1
mean1541.496-1541.497=-0.001
σ6.889-6.874=0.015
min1538.137-1538.137=-0.000
max1553.814-1553.787=0.027
mean1657.000-1652.000=5.000
σ0.000
min1657.000-1652.000=5.000
max1657.000-1652.000=5.000
mean2.290-2.303=-0.012
σ0.250-0.249=0.002
min1.986-2.034=-0.048
max2.524-2.631=-0.107
iters=5
new-facts=6402
prior-facts=6402
mean1859.294-1859.301=-0.007
σ0.067-0.061=0.006
min1859.216-1859.236=-0.019
max1859.358-1859.359=-0.001
mean1809.000-1804.600=4.400
σ157.979-157.881=0.099
min1657.000-1652.000=5.000
max1972.000-1967.000=5.000
mean3.206-3.252=-0.046
σ0.323-0.390=-0.067
min2.863-2.874=-0.010
max3.682-3.845=-0.163

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.472-1.352=0.120
σ0.286-0.278=0.009
min1.092-1.114=-0.023
max1.848-1.831=0.017

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean446.570-446.571=-0.002
σ580.936-580.935=0.000
min156.100-156.102=-0.002
max1317.973-1317.974=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1657.000-1652.000=5.000
σ0.000
min1657.000-1652.000=5.000
max1657.000-1652.000=5.000
mean0.553-0.544=0.008
σ0.575-0.565=0.010
min0.256-0.261=-0.004
max1.415-1.392=0.023
policies=20
mean1561.306-1561.307=-0.001
σ0.331-0.333=-0.002
min1561.078-1561.078=-0.000
max1561.798-1561.801=-0.003
mean920.000
σ0.000
min920.000
max920.000
mean1657.000-1652.000=5.000
σ0.000
min1657.000-1652.000=5.000
max1657.000-1652.000=5.000
mean2.598-2.603=-0.005
σ0.006-0.036=-0.030
min2.592-2.571=0.022
max2.606-2.641=-0.036
policies=200
mean15621.265-15621.148=0.116
σ0.065-0.185=-0.119
min15621.200-15620.999=0.201
max15621.354-15621.417=-0.063
mean9200.000
σ0.000
min9200.000
max9200.000
mean1657.000-1652.000=5.000
σ0.000
min1657.000-1652.000=5.000
max1657.000-1652.000=5.000
mean26.212-26.244=-0.032
σ0.048-0.053=-0.004
min26.174-26.180=-0.006
max26.283-26.302=-0.019