Avoid converting meta-schemas altogether for now - #1087
Conversation
Signed-off-by: Juan Cruz Viotti <jv@jviotti.com>
🤖 Augment PR SummarySummary: This PR disables conversion of meta-schemas and non-official dialects.
🤖 Was this summary useful? React with 👍 or 👎 |
| auto assert_convertible_dialects(const core::JSON &schema, | ||
| const core::SchemaFrame &frame, | ||
| const std::string_view default_id) -> void { | ||
| if (describes_itself(schema, default_id)) { |
There was a problem hiding this comment.
describes_itself only recognizes Draft 3/4 through the exact HTTP-with-# ladder strings. A self-describing schema using an accepted alias such as https://json-schema.org/draft-04/schema# (or the HTTP spelling without #) therefore passes this check and names_ladder_dialect, then is converted despite meta-schemas being unsupported.
Severity: high
🤖 Was this useful? React with 👍 or 👎, or 🚀 if it prevented an incident/outage.
| /// is. For example: | ||
| /// is. Meta-schemas are not supported, so a document that declares a dialect | ||
| /// outside the official ones, embeds the meta-schema it declares, or describes | ||
| /// itself raises `ConvertUnsupportedMetaschemaError`. For example: |
There was a problem hiding this comment.
This says a non-official dialect raises ConvertUnsupportedMetaschemaError, but assert_convertible_dialects raises ConvertUnsupportedDialectError for that case. This public API documentation would cause consumers to handle the wrong exception type.
Severity: low
🤖 Was this useful? React with 👍 or 👎, or 🚀 if it prevented an incident/outage.
There was a problem hiding this comment.
Review completed against the latest diff
Reply with feedback, questions, or to request a fix.
Re-trigger cubic
There was a problem hiding this comment.
2 issues found across 116 files
Prompt for AI agents (unresolved issues)
Check if these issues are valid — if so, understand the root cause of each and fix them. If appropriate, use sub-agents to investigate and fix each issue separately.
<file name="src/convert/include/sourcemeta/blaze/convert.h">
<violation number="1" location="src/convert/include/sourcemeta/blaze/convert.h:49">
P3: The phrase “meta-schema something in it declares” is unclear; state that the document contains a meta-schema declared by a subschema.</violation>
</file>
<file name="src/convert/helpers.h">
<violation number="1" location="src/convert/helpers.h:208">
P2: The updated `describes_itself` documentation claims aliases of ladder dialects (e.g. https spellings) are detected, but `names_the_same_uri` never equates `https` with `http`: string equality is checked after stripping only the empty fragment, and the fallback URI canonicalisation preserves the scheme. So a self-descriptive metaschema that spells `$schema` and `id` differently — for example `$schema: https://json-schema.org/draft-04/schema#` with `id: http://json-schema.org/draft-04/schema#` — fails `describes_itself`, the root is not refused, and the conversion mutates a metaschema the PR intends to refuse. The new https-alias fixtures only pair identical spellings (`$schema`/`$id` or `$schema`/`id` share the exact same string), so this mixed-spelling path is unexercised.</violation>
</file>
Reply with feedback, questions, or to request a fix.
Re-trigger cubic
| // dialect the ladder does not name leaves the question open | ||
| // names after them in `$id`, so the other keyword is ordinary data there. | ||
| // Anything the ladder does not name outright, which includes every alias of | ||
| // a dialect it does name, has to be asked of both |
There was a problem hiding this comment.
P2: The updated describes_itself documentation claims aliases of ladder dialects (e.g. https spellings) are detected, but names_the_same_uri never equates https with http: string equality is checked after stripping only the empty fragment, and the fallback URI canonicalisation preserves the scheme. So a self-descriptive metaschema that spells $schema and id differently — for example $schema: https://json-schema.org/draft-04/schema# with id: http://json-schema.org/draft-04/schema# — fails describes_itself, the root is not refused, and the conversion mutates a metaschema the PR intends to refuse. The new https-alias fixtures only pair identical spellings ($schema/$id or $schema/id share the exact same string), so this mixed-spelling path is unexercised.
Prompt for AI agents
Check if this issue is valid — if so, understand the root cause and fix it. At src/convert/helpers.h, line 208:
<comment>The updated `describes_itself` documentation claims aliases of ladder dialects (e.g. https spellings) are detected, but `names_the_same_uri` never equates `https` with `http`: string equality is checked after stripping only the empty fragment, and the fallback URI canonicalisation preserves the scheme. So a self-descriptive metaschema that spells `$schema` and `id` differently — for example `$schema: https://json-schema.org/draft-04/schema#` with `id: http://json-schema.org/draft-04/schema#` — fails `describes_itself`, the root is not refused, and the conversion mutates a metaschema the PR intends to refuse. The new https-alias fixtures only pair identical spellings (`$schema`/`$id` or `$schema`/`id` share the exact same string), so this mixed-spelling path is unexercised.</comment>
<file context>
@@ -253,8 +203,9 @@ inline auto describes_itself(const sourcemeta::core::JSON &schema,
- // dialect the ladder does not name leaves the question open
+ // names after them in `$id`, so the other keyword is ordinary data there.
+ // Anything the ladder does not name outright, which includes every alias of
+ // a dialect it does name, has to be asked of both
const auto position{dialect_position(dialect->to_string())};
const auto &value{dialect->to_string()};
</file context>
| /// is. A document that describes itself or that carries the meta-schema | ||
| /// something in it declares raises `ConvertUnsupportedMetaschemaError`, and one |
There was a problem hiding this comment.
P3: The phrase “meta-schema something in it declares” is unclear; state that the document contains a meta-schema declared by a subschema.
Prompt for AI agents
Check if this issue is valid — if so, understand the root cause and fix it. At src/convert/include/sourcemeta/blaze/convert.h, line 49:
<comment>The phrase “meta-schema something in it declares” is unclear; state that the document contains a meta-schema declared by a subschema.</comment>
<file context>
@@ -46,7 +46,10 @@ enum class ConvertTarget : std::uint8_t {
/// Convert the given schema, in place, to the given dialect. Only upgrades are
/// supported, so a schema already on that dialect or a newer one is left as
-/// is. For example:
+/// is. A document that describes itself or that carries the meta-schema
+/// something in it declares raises `ConvertUnsupportedMetaschemaError`, and one
+/// that sits on a dialect outside the official ladder raises
</file context>
| /// is. A document that describes itself or that carries the meta-schema | |
| /// something in it declares raises `ConvertUnsupportedMetaschemaError`, and one | |
| /// is. A document that is itself a meta-schema or contains a meta-schema | |
| /// that a subschema declares raises `ConvertUnsupportedMetaschemaError`, and one |
There was a problem hiding this comment.
Benchmark (macos/llvm)
Details
| Benchmark suite | Current: 4481260 | Previous: 22f5a83 | Ratio |
|---|---|---|---|
E2E_Compiler_adaptivecard |
65300972.333333336 ns |
31297118 ns |
2.09 |
E2E_Compiler_ansible_meta |
19111775.615384616 ns |
10195280.782608695 ns |
1.87 |
E2E_Compiler_aws_cdk |
253421.1426056338 ns |
144350.66049739733 ns |
1.76 |
E2E_Compiler_babelrc |
1489602.92 ns |
906798.3271375465 ns |
1.64 |
E2E_Compiler_clang_format |
12399450.307692308 ns |
6922379.073170732 ns |
1.79 |
E2E_Compiler_cmake_presets |
21645888.888888888 ns |
17845529.785714287 ns |
1.21 |
E2E_Compiler_code_climate |
1087250.9382022473 ns |
776079.5152838428 ns |
1.40 |
E2E_Compiler_cql2 |
9597750 ns |
5848811.5 ns |
1.64 |
E2E_Compiler_cspell |
17278985.07142857 ns |
9725920.454545455 ns |
1.78 |
E2E_Compiler_cypress |
3647293.269230769 ns |
1619479.0078740157 ns |
2.25 |
E2E_Compiler_deno |
4622339.285714285 ns |
4651173.6 ns |
0.99 |
E2E_Compiler_dependabot |
5352096.218181818 ns |
1357520.8333333333 ns |
3.94 |
E2E_Compiler_draft_04 |
2207925.9850746267 ns |
1079553.9333333333 ns |
2.05 |
E2E_Compiler_fabric_mod |
3186368.6440677964 ns |
2011968.142857143 ns |
1.58 |
E2E_Compiler_geojson |
16873788.866666667 ns |
11922525.80952381 ns |
1.42 |
E2E_Compiler_gitpod_configuration |
3852741.9126213593 ns |
1888469.7024793387 ns |
2.04 |
E2E_Compiler_helm_chart_lock |
607549.5303370786 ns |
281441.05125148984 ns |
2.16 |
E2E_Compiler_importmap |
245614.52184179457 ns |
148032.50323415265 ns |
1.66 |
E2E_Compiler_jasmine |
852612.012145749 ns |
425981.2324324324 ns |
2.00 |
E2E_Compiler_jshintrc |
2317992.09 ns |
1497766.8944444444 ns |
1.55 |
E2E_Compiler_jsconfig |
14322033.333333334 ns |
7871302.419354838 ns |
1.82 |
E2E_Compiler_krakend |
91287500 ns |
58750895.75 ns |
1.55 |
E2E_Compiler_lazygit |
25854359.375 ns |
14266660.05263158 ns |
1.81 |
E2E_Compiler_lerna |
1170763.1578947369 ns |
634598.6328358209 ns |
1.84 |
E2E_Compiler_nest_cli |
4035646.3414634145 ns |
3576071.734177215 ns |
1.13 |
E2E_Compiler_omc |
188369000 ns |
95150014 ns |
1.98 |
E2E_Compiler_omnisharp |
5261940.625 ns |
2779400.641025641 ns |
1.89 |
E2E_Compiler_openapi |
22597993.083333332 ns |
13227085.4 ns |
1.71 |
E2E_Compiler_pre_commit_hooks |
1846530.9 ns |
1576251.461988304 ns |
1.17 |
E2E_Compiler_pulumi |
2050988.2921348314 ns |
1462373.1751824818 ns |
1.40 |
E2E_Compiler_semantic_release |
858573.5506072874 ns |
570627.428904429 ns |
1.50 |
E2E_Compiler_stale |
724952.9177718833 ns |
477104.1169451074 ns |
1.52 |
E2E_Compiler_stylecop |
3184420.578125 ns |
2264590.8076923075 ns |
1.41 |
E2E_Compiler_tmuxinator |
839629.4351851852 ns |
739814.4171779141 ns |
1.13 |
E2E_Compiler_ui5 |
39940767.85714286 ns |
29404807.375 ns |
1.36 |
E2E_Compiler_ui5_manifest |
232630000 ns |
173639084 ns |
1.34 |
E2E_Compiler_unreal_engine_uproject |
2538076.301204819 ns |
1606872.7034482758 ns |
1.58 |
E2E_Compiler_users_array |
447953.4691629956 ns |
328252.71181938914 ns |
1.36 |
E2E_Compiler_vercel |
8253448.692307692 ns |
6295274 ns |
1.31 |
E2E_Compiler_yamllint |
98533.54519774011 ns |
90475.96053215077 ns |
1.09 |
E2E_Evaluator_adaptivecard |
27332.026703411575 ns |
22792.042306904325 ns |
1.20 |
E2E_Evaluator_ansible_meta |
314010.58390804596 ns |
191256.0501022495 ns |
1.64 |
E2E_Evaluator_aws_cdk |
59809.0214858918 ns |
44877.6510425949 ns |
1.33 |
E2E_Evaluator_babelrc |
140643.0541619156 ns |
96772.8554472234 ns |
1.45 |
E2E_Evaluator_cerebrum_criminal_case |
1382312.384180791 ns |
1048025.606870229 ns |
1.32 |
E2E_Evaluator_clang_format |
102739.69253208868 ns |
97053.02531645569 ns |
1.06 |
E2E_Evaluator_cmake_presets |
4785076.508196721 ns |
3893604.4923076923 ns |
1.23 |
E2E_Evaluator_code_climate |
212902.8022355976 ns |
165742.1261889664 ns |
1.28 |
E2E_Evaluator_cql2 |
273012.598820059 ns |
170855.23407202217 ns |
1.60 |
E2E_Evaluator_cspell |
716348.2053872054 ns |
528762.7296703297 ns |
1.35 |
E2E_Evaluator_cypress |
206432.54680534918 ns |
154315.1803948264 ns |
1.34 |
E2E_Evaluator_deno |
400014.7831800263 ns |
288824.5204872647 ns |
1.38 |
E2E_Evaluator_dependabot |
432502.9411764706 ns |
283990.8810325477 ns |
1.52 |
E2E_Evaluator_draft_04 |
8313521.68 ns |
5846944.444444444 ns |
1.42 |
E2E_Evaluator_fabric_mod |
730656.779661017 ns |
556388.0269541779 ns |
1.31 |
E2E_Evaluator_geojson |
15706329.545454545 ns |
8809758.32 ns |
1.78 |
E2E_Evaluator_gitpod_configuration |
329203.75722543354 ns |
193403.02878289475 ns |
1.70 |
E2E_Evaluator_helm_chart_lock |
515300.48076923075 ns |
262476.28657921293 ns |
1.96 |
E2E_Evaluator_importmap |
74524.2674462467 ns |
44383.0961576747 ns |
1.68 |
E2E_Evaluator_jasmine |
121878.31539782484 ns |
108431.78689956332 ns |
1.12 |
E2E_Evaluator_jshintrc |
1670702.0263157894 ns |
1072062.6242424243 ns |
1.56 |
E2E_Evaluator_jsconfig |
485405.2631578947 ns |
407476.6092814371 ns |
1.19 |
E2E_Evaluator_krakend |
217967.98917944095 ns |
160385.75 ns |
1.36 |
E2E_Evaluator_lazygit |
214902.60891590678 ns |
117497.96270161291 ns |
1.83 |
E2E_Evaluator_lerna |
267651.3199588477 ns |
145863.08466548254 ns |
1.83 |
E2E_Evaluator_nest_cli |
298004.15936952713 ns |
153055.68970283345 ns |
1.95 |
E2E_Evaluator_omc |
24764.58463786266 ns |
16844.133476856834 ns |
1.47 |
E2E_Evaluator_omnisharp |
870884.0996168583 ns |
489652.5767634855 ns |
1.78 |
E2E_Evaluator_openapi |
14453660.4 ns |
8333301.269230769 ns |
1.73 |
E2E_Evaluator_pre_commit_hooks |
728897.9700854701 ns |
442238.4338235294 ns |
1.65 |
E2E_Evaluator_pulumi |
1083442.118226601 ns |
567554.5192802057 ns |
1.91 |
E2E_Evaluator_semantic_release |
128057.98779743747 ns |
83274.54370692783 ns |
1.54 |
E2E_Evaluator_stale |
211587.24340175954 ns |
133610.431763285 ns |
1.58 |
E2E_Evaluator_stylecop |
398729.54173486086 ns |
222011.89961013646 ns |
1.80 |
E2E_Evaluator_tmuxinator |
115033.41889117043 ns |
75364.80597484276 ns |
1.53 |
E2E_Evaluator_ui5 |
716344.1546961326 ns |
417629.7690763052 ns |
1.72 |
E2E_Evaluator_ui5_manifest |
3634161.169811321 ns |
2591122.743243243 ns |
1.40 |
E2E_Evaluator_unreal_engine_uproject |
527156.0693641618 ns |
388754.7223796034 ns |
1.36 |
E2E_Evaluator_users_array |
702285.7919463087 ns |
468879.2277432712 ns |
1.50 |
E2E_Evaluator_vercel |
425789.86862745095 ns |
251737.93284365162 ns |
1.69 |
E2E_Evaluator_yamllint |
15051.523351073372 ns |
9158.120108945834 ns |
1.64 |
JSONLD_Catalog_Simple |
33358250 ns |
18025500 ns |
1.85 |
JSONLD_Catalog_Override_Agreeing |
30950365.666666668 ns |
19497100.666666668 ns |
1.59 |
JSONLD_Catalog_Override_Shadowing |
44183423.666666664 ns |
26822912.111111112 ns |
1.65 |
Micro_Draft4_Meta_1_No_Callback |
208.6386472639268 ns |
161.6960093111893 ns |
1.29 |
Micro_Draft4_Required_Properties |
1200.463974308976 ns |
737.9028566557965 ns |
1.63 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
20.842392778153933 ns |
18.852528223283826 ns |
1.11 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
16.128427690789206 ns |
11.495589388671464 ns |
1.40 |
Micro_Draft4_Items_Schema |
432.3032292892151 ns |
314.5011858309282 ns |
1.37 |
Micro_Draft4_Nested_Object |
2.585639321284358 ns |
2.1092368217478237 ns |
1.23 |
Micro_Draft4_Properties_Triad_Optional |
409.07437309933135 ns |
253.3463632147353 ns |
1.61 |
Micro_Draft4_Properties_Triad_Required |
465.6583025092472 ns |
272.8269339615686 ns |
1.71 |
Micro_Draft4_Properties_Triad_Closed |
282.86203523389514 ns |
211.99207110567258 ns |
1.33 |
Micro_Draft4_Properties_Closed |
73.13938244472496 ns |
52.51276932352268 ns |
1.39 |
Micro_Draft4_Non_Recursive_Ref |
17.087557088337224 ns |
13.085285779044204 ns |
1.31 |
Micro_Draft4_Pattern_Properties_Empty |
215.0188173444068 ns |
162.30942158032073 ns |
1.32 |
Micro_Draft4_Ref_To_Single_Property |
21.001225 ns |
11.216287815606037 ns |
1.87 |
Micro_Draft4_Additional_Properties_Type |
37.665219917173104 ns |
28.984503681078873 ns |
1.30 |
Micro_Draft4_Nested_Oneof |
50.68128651586411 ns |
45.05780581325646 ns |
1.12 |
Micro_Draft4_Short_Enum |
8.333701256074995 ns |
6.862223882589019 ns |
1.21 |
Micro_Draft4_Long_Enum |
13.581535917570228 ns |
11.784972525952758 ns |
1.15 |
Micro_Draft4_Long_Enum_Short_Strings |
8.786354849193314 ns |
8.762053459974435 ns |
1.00 |
Micro_Draft4_Type_Object |
3.897356684820609 ns |
4.08777172709557 ns |
0.95 |
Micro_Draft4_Ref_Single_100 |
1239243.25433526 ns |
1452938.6690140846 ns |
0.85 |
Micro_Draft4_Compile_Ref_Many_Nested |
1033683.2717391305 ns |
796829.1050724637 ns |
1.30 |
Micro_Draft4_Compile_Wrap |
1243130.005464481 ns |
948558.1983805668 ns |
1.31 |
Micro_Draft6_Property_Names |
139.57386795773024 ns |
109.6611467613388 ns |
1.27 |
Micro_Draft6_Compile_FHIR |
9048192709 ns |
6008231125 ns |
1.51 |
Micro_Draft7_If_Then_Else |
27.679053232978546 ns |
19.026367684101636 ns |
1.45 |
Micro_2019_09_Unevaluated_Properties |
51.93936052713381 ns |
33.56142438579747 ns |
1.55 |
Micro_2019_09_Compile_Wrap |
98760062.5 ns |
80453194.33333333 ns |
1.23 |
Micro_2020_12_Dynamic_Ref |
868.264432345231 ns |
609.3416455434276 ns |
1.42 |
Micro_2020_12_Dynamic_Ref_Single |
5.100443663246359 ns |
3.452267177713751 ns |
1.48 |
Micro_2020_12_Simple_Output_Mask |
1151.5338014021245 ns |
853.1489867360375 ns |
1.35 |
Micro_2020_12_Simple_Output_Annotations |
76985.27497559389 ns |
51805.19942516029 ns |
1.49 |
Micro_2020_12_Simple_Output_Annotation_Dropping |
2063905.83 ns |
1202555.2642487048 ns |
1.72 |
Micro_2020_12_Compile_NonCircular_Shared_Refs |
626457.9439252337 ns |
426471.1895910781 ns |
1.47 |
Micro_2020_12_Exhaustive_Deep_Numeric |
7164.103800630127 ns |
5054.298615771812 ns |
1.42 |
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput |
37904.94516431925 ns |
30758.86220028209 ns |
1.23 |
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput |
16486.842251897397 ns |
13086.309215578716 ns |
1.26 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail |
97.63745328277169 ns |
84.32082068527578 ns |
1.16 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput |
3186.100740459013 ns |
2358.074327070837 ns |
1.35 |
TestSuite_Parse_WoT |
16513939.777777778 ns |
11351941.176470589 ns |
1.45 |
Alterschema_Check_Readibility_ISO_Language_Set_3 |
212214875 ns |
154002750 ns |
1.38 |
Alterschema_Check_Readibility_OMC |
51777525 ns |
31978303.57142857 ns |
1.62 |
Alterschema_Check_Readibility_KrakenD |
616676291 ns |
387366000 ns |
1.59 |
Alterschema_Apply_Readibility_KrakenD |
63306269125 ns |
41860532167 ns |
1.51 |
Alterschema_Check_Invalid_External_Refs |
230508375 ns |
135566437.5 ns |
1.70 |
Alterschema_Check_Resolvable_External_Refs |
238003.99760191847 ns |
124552.71512052593 ns |
1.91 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
JavaScript (macos/llvm)
Details
| Benchmark suite | Current: 4481260 | Previous: 22f5a83 | Ratio |
|---|---|---|---|
E2E_Evaluator_adaptivecard |
183032 ns |
91917 ns |
1.99 |
E2E_Evaluator_ansible-meta |
563323 ns |
318614 ns |
1.77 |
E2E_Evaluator_aws-cdk |
155819 ns |
106736 ns |
1.46 |
E2E_Evaluator_babelrc |
368754 ns |
241783 ns |
1.53 |
E2E_Evaluator_cerebrum-criminal-case |
2291494 ns |
1486531 ns |
1.54 |
E2E_Evaluator_clang-format |
249026 ns |
157649 ns |
1.58 |
E2E_Evaluator_cmake-presets |
19416457 ns |
11796013 ns |
1.65 |
E2E_Evaluator_code-climate |
480803 ns |
365980 ns |
1.31 |
E2E_Evaluator_cql2 |
1049121 ns |
956879 ns |
1.10 |
E2E_Evaluator_cspell |
1387894 ns |
1016805 ns |
1.36 |
E2E_Evaluator_cypress |
616953 ns |
529313 ns |
1.17 |
E2E_Evaluator_deno |
737474 ns |
664555 ns |
1.11 |
E2E_Evaluator_dependabot |
827502 ns |
744374 ns |
1.11 |
E2E_Evaluator_draft-04 |
15950111 ns |
15287344 ns |
1.04 |
E2E_Evaluator_fabric-mod |
2058331 ns |
1477770 ns |
1.39 |
E2E_Evaluator_geojson |
19348124 ns |
17320628 ns |
1.12 |
E2E_Evaluator_gitpod-configuration |
541814 ns |
489007 ns |
1.11 |
E2E_Evaluator_helm-chart-lock |
898950 ns |
856982 ns |
1.05 |
E2E_Evaluator_importmap |
299735 ns |
212699 ns |
1.41 |
E2E_Evaluator_jasmine |
304929 ns |
211552 ns |
1.44 |
E2E_Evaluator_jsconfig |
1191114 ns |
887980 ns |
1.34 |
E2E_Evaluator_jshintrc |
2534275 ns |
2071295 ns |
1.22 |
E2E_Evaluator_krakend |
655529 ns |
435200 ns |
1.51 |
E2E_Evaluator_lazygit |
381040 ns |
292100 ns |
1.30 |
E2E_Evaluator_lerna |
389961 ns |
320178 ns |
1.22 |
E2E_Evaluator_nest-cli |
467620 ns |
415712 ns |
1.12 |
E2E_Evaluator_omc |
112966 ns |
95560 ns |
1.18 |
E2E_Evaluator_omnisharp |
1061624 ns |
998186 ns |
1.06 |
E2E_Evaluator_openapi |
32040082 ns |
28681006 ns |
1.12 |
E2E_Evaluator_pre-commit-hooks |
1584269 ns |
1356129 ns |
1.17 |
E2E_Evaluator_pulumi |
2286854 ns |
1567943 ns |
1.46 |
E2E_Evaluator_semantic-release |
207521 ns |
179063 ns |
1.16 |
E2E_Evaluator_stale |
334963 ns |
279361 ns |
1.20 |
E2E_Evaluator_stylecop |
891579 ns |
712868 ns |
1.25 |
E2E_Evaluator_tmuxinator |
177610 ns |
167751 ns |
1.06 |
E2E_Evaluator_ui5 |
1747404 ns |
1574223 ns |
1.11 |
E2E_Evaluator_ui5-manifest |
9326875 ns |
7663299 ns |
1.22 |
E2E_Evaluator_unreal-engine-uproject |
1556962 ns |
1276196 ns |
1.22 |
E2E_Evaluator_users-array |
3508839 ns |
2216164 ns |
1.58 |
E2E_Evaluator_vercel |
1203117 ns |
768341 ns |
1.57 |
E2E_Evaluator_yamllint |
30127 ns |
23730 ns |
1.27 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Benchmark (linux/llvm)
Details
| Benchmark suite | Current: 4481260 | Previous: 22f5a83 | Ratio |
|---|---|---|---|
E2E_Compiler_adaptivecard |
34619669.8 ns |
32222193.42857143 ns |
1.07 |
E2E_Compiler_ansible_meta |
10630870.217391305 ns |
10696262.136363637 ns |
0.99 |
E2E_Compiler_aws_cdk |
181312.8623076923 ns |
182536.95249042145 ns |
0.99 |
E2E_Compiler_babelrc |
1053458.1233480177 ns |
1053273.5777777778 ns |
1.00 |
E2E_Compiler_clang_format |
7191686 ns |
7153382.636363637 ns |
1.01 |
E2E_Compiler_cmake_presets |
15348810.42857143 ns |
15039307 ns |
1.02 |
E2E_Compiler_code_climate |
769171.4077669902 ns |
771044.569579288 ns |
1.00 |
E2E_Compiler_cql2 |
7086208.575757576 ns |
7014917.705882353 ns |
1.01 |
E2E_Compiler_cspell |
11729770.75 ns |
11426216.19047619 ns |
1.03 |
E2E_Compiler_cypress |
1823318.724409449 ns |
1842403.3643410853 ns |
0.99 |
E2E_Compiler_deno |
3549191.1764705884 ns |
3540068.149253731 ns |
1.00 |
E2E_Compiler_dependabot |
1442685.5521472392 ns |
1447855.3536585367 ns |
1.00 |
E2E_Compiler_draft_04 |
1266941.0802139037 ns |
1266760.9839572192 ns |
1.00 |
E2E_Compiler_fabric_mod |
2204413.886792453 ns |
2201024.0560747664 ns |
1.00 |
E2E_Compiler_geojson |
10628089.227272727 ns |
10604363.954545455 ns |
1.00 |
E2E_Compiler_gitpod_configuration |
2168375.018348624 ns |
2177534.2935779816 ns |
1.00 |
E2E_Compiler_helm_chart_lock |
328245.39364640886 ns |
327879.44751381216 ns |
1.00 |
E2E_Compiler_importmap |
144080.95686794957 ns |
145486.11145320197 ns |
0.99 |
E2E_Compiler_jasmine |
555080.1966824644 ns |
556613.1643192489 ns |
1.00 |
E2E_Compiler_jshintrc |
1753494.8074074073 ns |
1764978.485074627 ns |
0.99 |
E2E_Compiler_jsconfig |
10052055.043478262 ns |
10003825.75 ns |
1.00 |
E2E_Compiler_krakend |
67399362.25 ns |
61680104.75 ns |
1.09 |
E2E_Compiler_lazygit |
14268279.5 ns |
13928139.11764706 ns |
1.02 |
E2E_Compiler_lerna |
690343.4811594203 ns |
689149.4664723033 ns |
1.00 |
E2E_Compiler_nest_cli |
3306787.5142857144 ns |
3314987.888888889 ns |
1.00 |
E2E_Compiler_omc |
86208323.66666667 ns |
79278129.66666667 ns |
1.09 |
E2E_Compiler_omnisharp |
2978237.7875 ns |
2965822.325 ns |
1.00 |
E2E_Compiler_openapi |
13486076.823529411 ns |
13114157.944444444 ns |
1.03 |
E2E_Compiler_pre_commit_hooks |
1466258.490797546 ns |
1454321.3803680982 ns |
1.01 |
E2E_Compiler_pulumi |
1782117.8615384616 ns |
1767447.2706766918 ns |
1.01 |
E2E_Compiler_semantic_release |
645237.3369565217 ns |
648356.629427793 ns |
1.00 |
E2E_Compiler_stale |
563907.7923627686 ns |
567370.6330935252 ns |
0.99 |
E2E_Compiler_stylecop |
2557224.153846154 ns |
2582131.5054945056 ns |
0.99 |
E2E_Compiler_tmuxinator |
881729.5634328359 ns |
877835.1555555556 ns |
1.00 |
E2E_Compiler_ui5 |
28665065.57142857 ns |
27567975.875 ns |
1.04 |
E2E_Compiler_ui5_manifest |
165882618 ns |
155270778 ns |
1.07 |
E2E_Compiler_unreal_engine_uproject |
1890632.0495867769 ns |
1888538.9512195121 ns |
1.00 |
E2E_Compiler_users_array |
371058.57007874013 ns |
371700.60876369325 ns |
1.00 |
E2E_Compiler_vercel |
6497171.25 ns |
6491352.918918919 ns |
1.00 |
E2E_Compiler_yamllint |
121864.53586278587 ns |
123617.86375455018 ns |
0.99 |
E2E_Evaluator_adaptivecard |
26228.427404007612 ns |
26084.35781730347 ns |
1.01 |
E2E_Evaluator_ansible_meta |
244665.77971311475 ns |
245188.6905737705 ns |
1.00 |
E2E_Evaluator_aws_cdk |
50733.886094674555 ns |
50717.67504332756 ns |
1.00 |
E2E_Evaluator_babelrc |
115049.03167641326 ns |
115249.759697733 ns |
1.00 |
E2E_Evaluator_cerebrum_criminal_case |
1084065.2119815669 ns |
1079048.3288288289 ns |
1.00 |
E2E_Evaluator_clang_format |
114412.52426717924 ns |
113516.75428571428 ns |
1.01 |
E2E_Evaluator_cmake_presets |
4953067.274509804 ns |
4320664.5 ns |
1.15 |
E2E_Evaluator_code_climate |
192848.56503728253 ns |
192552.95331695332 ns |
1.00 |
E2E_Evaluator_cql2 |
225001.5420207743 ns |
223446.69763033176 ns |
1.01 |
E2E_Evaluator_cspell |
653759.9668508287 ns |
654040.5757575758 ns |
1.00 |
E2E_Evaluator_cypress |
200323.77692960136 ns |
198999.0373514431 ns |
1.01 |
E2E_Evaluator_deno |
336950.0760401722 ns |
340165.22953216376 ns |
0.99 |
E2E_Evaluator_dependabot |
349394.93934911245 ns |
344741.9798850575 ns |
1.01 |
E2E_Evaluator_draft_04 |
9128222.76 ns |
7136848.133333334 ns |
1.28 |
E2E_Evaluator_fabric_mod |
686758.2666666667 ns |
693856.5676470589 ns |
0.99 |
E2E_Evaluator_geojson |
11484458.142857144 ns |
11331717.590909092 ns |
1.01 |
E2E_Evaluator_gitpod_configuration |
249310.17883597885 ns |
249943.06210526315 ns |
1.00 |
E2E_Evaluator_helm_chart_lock |
358370.92438271607 ns |
366620.14961832063 ns |
0.98 |
E2E_Evaluator_importmap |
50162.24108695652 ns |
51590.0355671221 ns |
0.97 |
E2E_Evaluator_jasmine |
113652.98918664786 ns |
113096.25381679389 ns |
1.00 |
E2E_Evaluator_jshintrc |
1216513.5282051282 ns |
1213593.9846938776 ns |
1.00 |
E2E_Evaluator_jsconfig |
443327.3965517241 ns |
446062.8330206379 ns |
0.99 |
E2E_Evaluator_krakend |
211392.63445761168 ns |
212196.44354110208 ns |
1.00 |
E2E_Evaluator_lazygit |
156805.38822751323 ns |
157224.5617078052 ns |
1.00 |
E2E_Evaluator_lerna |
149908.84382871535 ns |
150349.18977635782 ns |
1.00 |
E2E_Evaluator_nest_cli |
196478.53580246912 ns |
198533.5107615894 ns |
0.99 |
E2E_Evaluator_omc |
21842.68466722053 ns |
21786.290040063355 ns |
1.00 |
E2E_Evaluator_omnisharp |
637004.6989247312 ns |
638487.8682795699 ns |
1.00 |
E2E_Evaluator_openapi |
16423258.642857144 ns |
11911687.35 ns |
1.38 |
E2E_Evaluator_pre_commit_hooks |
516344.5606407323 ns |
511791.25701943843 ns |
1.01 |
E2E_Evaluator_pulumi |
688288.1988304093 ns |
682864.7449275362 ns |
1.01 |
E2E_Evaluator_semantic_release |
102834.59353146853 ns |
102222.57557384149 ns |
1.01 |
E2E_Evaluator_stale |
156539.2465300727 ns |
157029.72733289213 ns |
1.00 |
E2E_Evaluator_stylecop |
301677.725388601 ns |
300339.8665819568 ns |
1.00 |
E2E_Evaluator_tmuxinator |
97723.08829568789 ns |
97507.42951907132 ns |
1.00 |
E2E_Evaluator_ui5 |
552655.4595842956 ns |
540908.3257403189 ns |
1.02 |
E2E_Evaluator_ui5_manifest |
2675506.1445783135 ns |
2651657.6704545454 ns |
1.01 |
E2E_Evaluator_unreal_engine_uproject |
466005.9921875 ns |
475517.5261044177 ns |
0.98 |
E2E_Evaluator_users_array |
591782.769035533 ns |
589189.2456575682 ns |
1.00 |
E2E_Evaluator_vercel |
338335.35077793495 ns |
334603.338028169 ns |
1.01 |
E2E_Evaluator_yamllint |
9279.648862125596 ns |
9186.988910074322 ns |
1.01 |
JSONLD_Catalog_Simple |
21758318.222222224 ns |
19605683 ns |
1.11 |
JSONLD_Catalog_Override_Agreeing |
21759093.7 ns |
20071868.416666668 ns |
1.08 |
JSONLD_Catalog_Override_Shadowing |
35370823 ns |
30219230.875 ns |
1.17 |
Micro_Draft4_Meta_1_No_Callback |
199.17601966853755 ns |
197.9637121896125 ns |
1.01 |
Micro_Draft4_Required_Properties |
825.9704226871947 ns |
812.0029058557814 ns |
1.02 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
25.74380994278211 ns |
25.695874944036593 ns |
1.00 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
13.179607527298815 ns |
13.167480327749251 ns |
1.00 |
Micro_Draft4_Items_Schema |
294.37748390507886 ns |
293.68657449619474 ns |
1.00 |
Micro_Draft4_Nested_Object |
3.114018200706272 ns |
3.1128695997234184 ns |
1.00 |
Micro_Draft4_Properties_Triad_Optional |
335.48640555078424 ns |
333.6412679860022 ns |
1.01 |
Micro_Draft4_Properties_Triad_Required |
351.39109605634803 ns |
351.69648053084785 ns |
1.00 |
Micro_Draft4_Properties_Triad_Closed |
277.663449454582 ns |
276.28973994733667 ns |
1.00 |
Micro_Draft4_Properties_Closed |
64.08721939329227 ns |
64.01933031099931 ns |
1.00 |
Micro_Draft4_Non_Recursive_Ref |
16.498745095403855 ns |
16.43452658987652 ns |
1.00 |
Micro_Draft4_Pattern_Properties_Empty |
163.37571075474048 ns |
163.49072664440575 ns |
1.00 |
Micro_Draft4_Ref_To_Single_Property |
13.161023025770154 ns |
13.16620050153704 ns |
1.00 |
Micro_Draft4_Additional_Properties_Type |
35.251640004415194 ns |
35.18440327272733 ns |
1.00 |
Micro_Draft4_Nested_Oneof |
61.96904271544364 ns |
61.91922176398393 ns |
1.00 |
Micro_Draft4_Short_Enum |
10.635817381438896 ns |
12.765100514919704 ns |
0.83 |
Micro_Draft4_Long_Enum |
15.579417739007308 ns |
15.573647351184094 ns |
1.00 |
Micro_Draft4_Long_Enum_Short_Strings |
10.616709017363046 ns |
12.7683207 ns |
0.83 |
Micro_Draft4_Type_Object |
4.981355159509466 ns |
5.289856456275931 ns |
0.94 |
Micro_Draft4_Ref_Single_100 |
1365142.7660818712 ns |
1359933.9425287356 ns |
1.00 |
Micro_Draft4_Compile_Ref_Many_Nested |
882710.3791821562 ns |
885926.2696629213 ns |
1.00 |
Micro_Draft4_Compile_Wrap |
1054054.0442477877 ns |
1051656.6415929203 ns |
1.00 |
Micro_Draft6_Property_Names |
111.71322413490499 ns |
111.74485061849087 ns |
1.00 |
Micro_Draft6_Compile_FHIR |
5179513573 ns |
5003239038 ns |
1.04 |
Micro_Draft7_If_Then_Else |
24.012971250386258 ns |
23.999680790821262 ns |
1.00 |
Micro_2019_09_Unevaluated_Properties |
28.691085899279432 ns |
28.670843907615303 ns |
1.00 |
Micro_2019_09_Compile_Wrap |
85960451.33333333 ns |
79954070 ns |
1.08 |
Micro_2020_12_Dynamic_Ref |
703.3256371742887 ns |
706.5046247619499 ns |
1.00 |
Micro_2020_12_Dynamic_Ref_Single |
5.292476291331836 ns |
5.2900204365844585 ns |
1.00 |
Micro_2020_12_Simple_Output_Mask |
1050.330978381007 ns |
1047.0163232621885 ns |
1.00 |
Micro_2020_12_Simple_Output_Annotations |
48779.179708359006 ns |
48149.08109201214 ns |
1.01 |
Micro_2020_12_Simple_Output_Annotation_Dropping |
1278061.027027027 ns |
1286523.902173913 ns |
0.99 |
Micro_2020_12_Compile_NonCircular_Shared_Refs |
503254.7195652174 ns |
505009.03624733473 ns |
1.00 |
Micro_2020_12_Exhaustive_Deep_Numeric |
8446.965474283681 ns |
8497.80012887982 ns |
0.99 |
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput |
36240.684868822456 ns |
36840.00352112676 ns |
0.98 |
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput |
19732.53846153846 ns |
19648.06947890819 ns |
1.00 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail |
154.69910937918394 ns |
151.72992485374053 ns |
1.02 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput |
2347.226547865645 ns |
2352.0716878310645 ns |
1.00 |
TestSuite_Parse_WoT |
12635355 ns |
12357103.684210526 ns |
1.02 |
Alterschema_Check_Readibility_ISO_Language_Set_3 |
269161312 ns |
268770043 ns |
1.00 |
Alterschema_Check_Readibility_OMC |
48199783.4 ns |
47281819.2 ns |
1.02 |
Alterschema_Check_Readibility_KrakenD |
529582515 ns |
524737265 ns |
1.01 |
Alterschema_Apply_Readibility_KrakenD |
56015540944 ns |
54736893689 ns |
1.02 |
Alterschema_Check_Invalid_External_Refs |
231800115 ns |
220455563 ns |
1.05 |
Alterschema_Check_Resolvable_External_Refs |
194020.73382473382 ns |
196213.04962779157 ns |
0.99 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
JavaScript (linux/llvm)
Details
| Benchmark suite | Current: 4481260 | Previous: 22f5a83 | Ratio |
|---|---|---|---|
E2E_Evaluator_adaptivecard |
120219 ns |
121312 ns |
0.99 |
E2E_Evaluator_ansible-meta |
526794 ns |
532804 ns |
0.99 |
E2E_Evaluator_aws-cdk |
143620 ns |
146165 ns |
0.98 |
E2E_Evaluator_babelrc |
358643 ns |
346236 ns |
1.04 |
E2E_Evaluator_cerebrum-criminal-case |
2568465 ns |
2508405 ns |
1.02 |
E2E_Evaluator_clang-format |
261833 ns |
262272 ns |
1.00 |
E2E_Evaluator_cmake-presets |
18100973 ns |
16261241 ns |
1.11 |
E2E_Evaluator_code-climate |
534980 ns |
511963 ns |
1.04 |
E2E_Evaluator_cql2 |
1221235 ns |
1220583 ns |
1.00 |
E2E_Evaluator_cspell |
1477812 ns |
1474584 ns |
1.00 |
E2E_Evaluator_cypress |
763359 ns |
760652 ns |
1.00 |
E2E_Evaluator_deno |
1039268 ns |
1014216 ns |
1.02 |
E2E_Evaluator_dependabot |
1127518 ns |
1107769 ns |
1.02 |
E2E_Evaluator_draft-04 |
22842044 ns |
19809308 ns |
1.15 |
E2E_Evaluator_fabric-mod |
2379656 ns |
2325080 ns |
1.02 |
E2E_Evaluator_geojson |
24280137 ns |
24562414 ns |
0.99 |
E2E_Evaluator_gitpod-configuration |
711151 ns |
721538 ns |
0.99 |
E2E_Evaluator_helm-chart-lock |
991153 ns |
994190 ns |
1.00 |
E2E_Evaluator_importmap |
264811 ns |
260403 ns |
1.02 |
E2E_Evaluator_jasmine |
305971 ns |
291648 ns |
1.05 |
E2E_Evaluator_jsconfig |
1239376 ns |
1243220 ns |
1.00 |
E2E_Evaluator_jshintrc |
2771231 ns |
2703060 ns |
1.03 |
E2E_Evaluator_krakend |
658854 ns |
668491 ns |
0.99 |
E2E_Evaluator_lazygit |
521349 ns |
502299 ns |
1.04 |
E2E_Evaluator_lerna |
464178 ns |
472339 ns |
0.98 |
E2E_Evaluator_nest-cli |
605203 ns |
603875 ns |
1.00 |
E2E_Evaluator_omc |
118402 ns |
118272 ns |
1.00 |
E2E_Evaluator_omnisharp |
1412894 ns |
1393445 ns |
1.01 |
E2E_Evaluator_openapi |
46437834 ns |
45376040 ns |
1.02 |
E2E_Evaluator_pre-commit-hooks |
2021999 ns |
1963598 ns |
1.03 |
E2E_Evaluator_pulumi |
1964195 ns |
1947255 ns |
1.01 |
E2E_Evaluator_semantic-release |
262590 ns |
257238 ns |
1.02 |
E2E_Evaluator_stale |
406755 ns |
409343 ns |
0.99 |
E2E_Evaluator_stylecop |
1204767 ns |
1213539 ns |
0.99 |
E2E_Evaluator_tmuxinator |
229682 ns |
231153 ns |
0.99 |
E2E_Evaluator_ui5 |
2287495 ns |
2199315 ns |
1.04 |
E2E_Evaluator_ui5-manifest |
10622347 ns |
10907334 ns |
0.97 |
E2E_Evaluator_unreal-engine-uproject |
1503931 ns |
1534294 ns |
0.98 |
E2E_Evaluator_users-array |
2878257 ns |
3093622 ns |
0.93 |
E2E_Evaluator_vercel |
1018968 ns |
980803 ns |
1.04 |
E2E_Evaluator_yamllint |
25822 ns |
25630 ns |
1.01 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
Benchmark (linux/gcc)
Details
| Benchmark suite | Current: 4481260 | Previous: bfe658e | Ratio |
|---|---|---|---|
Alterschema_Check_Readibility_ISO_Language_Set_3 |
262382339 ns |
152933818.5 ns |
1.72 |
Alterschema_Check_Readibility_OMC |
55263806.25 ns |
35994534.5 ns |
1.54 |
Alterschema_Check_Readibility_KrakenD |
616547103 ns |
474520074 ns |
1.30 |
Alterschema_Apply_Readibility_KrakenD |
63268455589 ns |
49612952868 ns |
1.28 |
Alterschema_Check_Invalid_External_Refs |
257553433 ns |
128526079.5 ns |
2.00 |
Alterschema_Check_Resolvable_External_Refs |
229607.33300685603 ns |
131107.2978488693 ns |
1.75 |
TestSuite_Parse_WoT |
13848596.3125 ns |
9048422.807692308 ns |
1.53 |
Micro_2020_12_Dynamic_Ref |
940.5686165678832 ns |
606.4076875009604 ns |
1.55 |
Micro_2020_12_Dynamic_Ref_Single |
4.681005024463135 ns |
3.1956097256335707 ns |
1.46 |
Micro_2020_12_Simple_Output_Mask |
1209.1697794248294 ns |
729.314993106036 ns |
1.66 |
Micro_2020_12_Simple_Output_Annotations |
54597.94784007353 ns |
31454.82330326778 ns |
1.74 |
Micro_2020_12_Simple_Output_Annotation_Dropping |
1490071.8734177216 ns |
919189.9343629343 ns |
1.62 |
Micro_2020_12_Compile_NonCircular_Shared_Refs |
566484.0239808153 ns |
342643.9479015919 ns |
1.65 |
Micro_2020_12_Exhaustive_Deep_Numeric |
9273.11361952665 ns |
5614.65134529148 ns |
1.65 |
Micro_2020_12_Exhaustive_Deep_Numeric_SimpleOutput |
43555.16246805403 ns |
26200.27797833935 ns |
1.66 |
Micro_2020_12_Exhaustive_Deep_Numeric_TraceOutput |
22376.538432625446 ns |
13761.293565683645 ns |
1.63 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail |
174.59227386268572 ns |
99.96838651928431 ns |
1.75 |
Micro_2020_12_Exhaustive_Deep_Numeric_Fail_SimpleOutput |
2792.879679804403 ns |
1492.3988013461224 ns |
1.87 |
Micro_2019_09_Unevaluated_Properties |
30.837727129364072 ns |
18.80304203256368 ns |
1.64 |
Micro_2019_09_Compile_Wrap |
88596383.5 ns |
56859269.666666664 ns |
1.56 |
Micro_Draft7_If_Then_Else |
25.21949862251636 ns |
15.10244622014098 ns |
1.67 |
Micro_Draft6_Property_Names |
149.33811925716157 ns |
99.33620142484877 ns |
1.50 |
Micro_Draft6_Compile_FHIR |
5589143883 ns |
4634718876 ns |
1.21 |
Micro_Draft4_Meta_1_No_Callback |
183.44892249174512 ns |
113.1311718168395 ns |
1.62 |
Micro_Draft4_Required_Properties |
890.1801427872276 ns |
646.9426663866624 ns |
1.38 |
Micro_Draft4_Many_Optional_Properties_Minimal_Match |
21.831490974557337 ns |
14.557564031389536 ns |
1.50 |
Micro_Draft4_Few_Optional_Properties_Minimal_Match |
15.580913132977292 ns |
8.949743755450534 ns |
1.74 |
Micro_Draft4_Items_Schema |
353.69511951867156 ns |
238.34493608069366 ns |
1.48 |
Micro_Draft4_Nested_Object |
1.555975502474745 ns |
0.8208847243253798 ns |
1.90 |
Micro_Draft4_Properties_Triad_Optional |
465.2215637549203 ns |
194.24327969346143 ns |
2.40 |
Micro_Draft4_Properties_Triad_Required |
502.5102806665966 ns |
215.23658405826237 ns |
2.33 |
Micro_Draft4_Properties_Triad_Closed |
378.35403071297276 ns |
160.96679209026675 ns |
2.35 |
Micro_Draft4_Properties_Closed |
66.11105043165857 ns |
43.41288429823736 ns |
1.52 |
Micro_Draft4_Non_Recursive_Ref |
8.71345656925304 ns |
5.849014308783264 ns |
1.49 |
Micro_Draft4_Pattern_Properties_Empty |
205.0183676803109 ns |
124.37617998289171 ns |
1.65 |
Micro_Draft4_Ref_To_Single_Property |
15.599189253996284 ns |
8.946710459169955 ns |
1.74 |
Micro_Draft4_Additional_Properties_Type |
14.006512853742212 ns |
9.612841216449755 ns |
1.46 |
Micro_Draft4_Nested_Oneof |
64.52231522346764 ns |
43.56633141867611 ns |
1.48 |
Micro_Draft4_Short_Enum |
14.628443256766607 ns |
8.455506917076324 ns |
1.73 |
Micro_Draft4_Long_Enum |
13.08187438097066 ns |
7.83997740011237 ns |
1.67 |
Micro_Draft4_Long_Enum_Short_Strings |
14.633768020269727 ns |
8.444252518783443 ns |
1.73 |
Micro_Draft4_Type_Object |
4.357011174630136 ns |
2.8474724472901825 ns |
1.53 |
Micro_Draft4_Ref_Single_100 |
1453528.530487805 ns |
874683.0295202952 ns |
1.66 |
Micro_Draft4_Compile_Ref_Many_Nested |
942616.5918367347 ns |
575273.3851674641 ns |
1.64 |
Micro_Draft4_Compile_Wrap |
1168692.565 ns |
698674.5950155763 ns |
1.67 |
JSONLD_Catalog_Simple |
23404321.25 ns |
13051049.944444444 ns |
1.79 |
JSONLD_Catalog_Override_Agreeing |
23673008.7 ns |
13212850.222222222 ns |
1.79 |
JSONLD_Catalog_Override_Shadowing |
36017125 ns |
19709069.454545453 ns |
1.83 |
E2E_Compiler_adaptivecard |
38996005.4 ns |
24871531.888888888 ns |
1.57 |
E2E_Compiler_ansible_meta |
11807725.05 ns |
7821881.580645162 ns |
1.51 |
E2E_Compiler_aws_cdk |
203835.54553264604 ns |
118922.28277886497 ns |
1.71 |
E2E_Compiler_babelrc |
1107356.2112676057 ns |
657490.976744186 ns |
1.68 |
E2E_Compiler_clang_format |
7955095.033333333 ns |
5053694 ns |
1.57 |
E2E_Compiler_cmake_presets |
16195942.785714285 ns |
10877528.666666666 ns |
1.49 |
E2E_Compiler_code_climate |
868290.8327272728 ns |
502510.7048832272 ns |
1.73 |
E2E_Compiler_cql2 |
8035020.1034482755 ns |
5370237.4772727275 ns |
1.50 |
E2E_Compiler_cspell |
11868238.157894736 ns |
7849868.166666667 ns |
1.51 |
E2E_Compiler_cypress |
1864780.546875 ns |
1109754.8558139536 ns |
1.68 |
E2E_Compiler_deno |
3850746.9677419355 ns |
2376251.1414141413 ns |
1.62 |
E2E_Compiler_dependabot |
1620661.4452054794 ns |
922772.8313725491 ns |
1.76 |
E2E_Compiler_draft_04 |
1430530.4939759036 ns |
905224.7164750958 ns |
1.58 |
E2E_Compiler_fabric_mod |
2529453.0212765955 ns |
1635998.0134228189 ns |
1.55 |
E2E_Compiler_geojson |
11601019.95 ns |
7579132 ns |
1.53 |
E2E_Compiler_gitpod_configuration |
2381627.82 ns |
1535640.6 ns |
1.55 |
E2E_Compiler_helm_chart_lock |
358054.20884146343 ns |
192294.58823529413 ns |
1.86 |
E2E_Compiler_importmap |
158629.42914707857 ns |
88711.59774859287 ns |
1.79 |
E2E_Compiler_jasmine |
589632.1729323309 ns |
343905.74558823527 ns |
1.71 |
E2E_Compiler_jshintrc |
1816880.6640625 ns |
1062100.92 ns |
1.71 |
E2E_Compiler_jsconfig |
10498187.217391305 ns |
6073438.41025641 ns |
1.73 |
E2E_Compiler_krakend |
68006252 ns |
40775274.6 ns |
1.67 |
E2E_Compiler_lazygit |
14803768.875 ns |
9438093.52 ns |
1.57 |
E2E_Compiler_lerna |
742209.6677115988 ns |
429978.9855334539 ns |
1.73 |
E2E_Compiler_nest_cli |
3551610.656716418 ns |
2200021.438095238 ns |
1.61 |
E2E_Compiler_omc |
95553180 ns |
57733309.5 ns |
1.66 |
E2E_Compiler_omnisharp |
3106446.6052631577 ns |
1901763.76 ns |
1.63 |
E2E_Compiler_openapi |
15668225 ns |
9891068.8 ns |
1.58 |
E2E_Compiler_pre_commit_hooks |
1595305.8150684931 ns |
908866.9351145038 ns |
1.76 |
E2E_Compiler_pulumi |
1916816.256198347 ns |
1236092.1510416667 ns |
1.55 |
E2E_Compiler_semantic_release |
738093.5969230769 ns |
432439.4744525548 ns |
1.71 |
E2E_Compiler_stale |
582447.637037037 ns |
367747.01739130437 ns |
1.58 |
E2E_Compiler_stylecop |
2683670.2386363638 ns |
1685878.9541984734 ns |
1.59 |
E2E_Compiler_tmuxinator |
1001717.7046413502 ns |
590618.5657568239 ns |
1.70 |
E2E_Compiler_ui5 |
31149104.714285713 ns |
20141581.9 ns |
1.55 |
E2E_Compiler_ui5_manifest |
185182321 ns |
111446701 ns |
1.66 |
E2E_Compiler_unreal_engine_uproject |
1997642.0683760685 ns |
1282258.311827957 ns |
1.56 |
E2E_Compiler_users_array |
422922.41740674956 ns |
234460.06739345886 ns |
1.80 |
E2E_Compiler_vercel |
6733137.2727272725 ns |
4406309.320754717 ns |
1.53 |
E2E_Compiler_yamllint |
132505.15 ns |
71093.67433209333 ns |
1.86 |
E2E_Evaluator_adaptivecard |
26222.59599777654 ns |
15617.414417937687 ns |
1.68 |
E2E_Evaluator_ansible_meta |
291707.73284313723 ns |
161194.72727272726 ns |
1.81 |
E2E_Evaluator_aws_cdk |
59062.85671567406 ns |
35654.36410102225 ns |
1.66 |
E2E_Evaluator_babelrc |
115461.57121807466 ns |
66963.83442576232 ns |
1.72 |
E2E_Evaluator_cerebrum_criminal_case |
1149572.4356435644 ns |
864850.0945454546 ns |
1.33 |
E2E_Evaluator_clang_format |
108030.01548974944 ns |
67991.34348950848 ns |
1.59 |
E2E_Evaluator_cmake_presets |
5191520.936170213 ns |
3769210.049180328 ns |
1.38 |
E2E_Evaluator_code_climate |
233751.7705882353 ns |
160885.2681281619 ns |
1.45 |
E2E_Evaluator_cql2 |
225944.518804243 ns |
141849.85868263472 ns |
1.59 |
E2E_Evaluator_cspell |
636860.6469002696 ns |
484196.5356415479 ns |
1.32 |
E2E_Evaluator_cypress |
191898.82171799027 ns |
132726.6349206349 ns |
1.45 |
E2E_Evaluator_deno |
375386.04448105436 ns |
262188.5360696517 ns |
1.43 |
E2E_Evaluator_dependabot |
398267.1644295302 ns |
264625.1284090909 ns |
1.51 |
E2E_Evaluator_draft_04 |
9214464.782608695 ns |
4734601.52 ns |
1.95 |
E2E_Evaluator_fabric_mod |
823064.0769230769 ns |
564736.7688564477 ns |
1.46 |
E2E_Evaluator_geojson |
14009975.294117646 ns |
10566095.818181818 ns |
1.33 |
E2E_Evaluator_gitpod_configuration |
279432.54415274464 ns |
193384.46456692912 ns |
1.44 |
E2E_Evaluator_helm_chart_lock |
368660.14417177916 ns |
350382.0663580247 ns |
1.05 |
E2E_Evaluator_importmap |
47115.66585067319 ns |
21688.088799475998 ns |
2.17 |
E2E_Evaluator_jasmine |
128392.09041980625 ns |
79993.5392123864 ns |
1.61 |
E2E_Evaluator_jshintrc |
1110998.7594339622 ns |
877998.5645756457 ns |
1.27 |
E2E_Evaluator_jsconfig |
454853.42034548946 ns |
271840.2376009227 ns |
1.67 |
E2E_Evaluator_krakend |
227171.36416184972 ns |
126284.17514729513 ns |
1.80 |
E2E_Evaluator_lazygit |
156172.38925729442 ns |
88173.28571428571 ns |
1.77 |
E2E_Evaluator_lerna |
179093.12898330804 ns |
130668.85272277228 ns |
1.37 |
E2E_Evaluator_nest_cli |
216090.713091922 ns |
133799.40813648293 ns |
1.62 |
E2E_Evaluator_omc |
24671.319783761304 ns |
14558.685522590176 ns |
1.69 |
E2E_Evaluator_omnisharp |
612359.6323907454 ns |
465527.60236220475 ns |
1.32 |
E2E_Evaluator_openapi |
19098466.333333332 ns |
8854924.291666666 ns |
2.16 |
E2E_Evaluator_pre_commit_hooks |
558051.858490566 ns |
396319.202020202 ns |
1.41 |
E2E_Evaluator_pulumi |
775394.8640776699 ns |
598204.8600508906 ns |
1.30 |
E2E_Evaluator_semantic_release |
107617.19429676172 ns |
62641.60345744681 ns |
1.72 |
E2E_Evaluator_stale |
178939.38531415595 ns |
110951.79272898962 ns |
1.61 |
E2E_Evaluator_stylecop |
327234.33518776076 ns |
193328.99661590526 ns |
1.69 |
E2E_Evaluator_tmuxinator |
109443.84881007933 ns |
65261.143287671235 ns |
1.68 |
E2E_Evaluator_ui5 |
623731.914893617 ns |
378895.264 ns |
1.65 |
E2E_Evaluator_ui5_manifest |
4646345.959183673 ns |
2141376.831775701 ns |
2.17 |
E2E_Evaluator_unreal_engine_uproject |
508668.39262472885 ns |
331752.1013888889 ns |
1.53 |
E2E_Evaluator_users_array |
707529.5498489426 ns |
512343.3405172414 ns |
1.38 |
E2E_Evaluator_vercel |
346577.4388807069 ns |
244327.02631578947 ns |
1.42 |
E2E_Evaluator_yamllint |
12893.917340131258 ns |
7466.40008122208 ns |
1.73 |
This comment was automatically generated by workflow using github-action-benchmark.
There was a problem hiding this comment.
JavaScript (linux/gcc)
Details
| Benchmark suite | Current: 4481260 | Previous: bfe658e | Ratio |
|---|---|---|---|
E2E_Evaluator_adaptivecard |
119792 ns |
74858 ns |
1.60 |
E2E_Evaluator_ansible-meta |
526792 ns |
338661 ns |
1.56 |
E2E_Evaluator_aws-cdk |
147013 ns |
95621 ns |
1.54 |
E2E_Evaluator_babelrc |
343411 ns |
249503 ns |
1.38 |
E2E_Evaluator_cerebrum-criminal-case |
2481939 ns |
1553876 ns |
1.60 |
E2E_Evaluator_clang-format |
261976 ns |
170277 ns |
1.54 |
E2E_Evaluator_cmake-presets |
17596124 ns |
12379940 ns |
1.42 |
E2E_Evaluator_code-climate |
519610 ns |
379372 ns |
1.37 |
E2E_Evaluator_cql2 |
1213293 ns |
737347 ns |
1.65 |
E2E_Evaluator_cspell |
1482999 ns |
1111797 ns |
1.33 |
E2E_Evaluator_cypress |
771279 ns |
615111 ns |
1.25 |
E2E_Evaluator_deno |
1070738 ns |
785153 ns |
1.36 |
E2E_Evaluator_dependabot |
1140984 ns |
729443 ns |
1.56 |
E2E_Evaluator_draft-04 |
21131479 ns |
13184849 ns |
1.60 |
E2E_Evaluator_fabric-mod |
2329159 ns |
1664219 ns |
1.40 |
E2E_Evaluator_geojson |
24814574 ns |
19506364 ns |
1.27 |
E2E_Evaluator_gitpod-configuration |
715962 ns |
538096 ns |
1.33 |
E2E_Evaluator_helm-chart-lock |
1047734 ns |
757671 ns |
1.38 |
E2E_Evaluator_importmap |
264510 ns |
219782 ns |
1.20 |
E2E_Evaluator_jasmine |
287332 ns |
195317 ns |
1.47 |
E2E_Evaluator_jsconfig |
1248823 ns |
920072 ns |
1.36 |
E2E_Evaluator_jshintrc |
2722389 ns |
2040486 ns |
1.33 |
E2E_Evaluator_krakend |
661010 ns |
402586 ns |
1.64 |
E2E_Evaluator_lazygit |
514496 ns |
292269 ns |
1.76 |
E2E_Evaluator_lerna |
469527 ns |
323695 ns |
1.45 |
E2E_Evaluator_nest-cli |
579222 ns |
399328 ns |
1.45 |
E2E_Evaluator_omc |
119186 ns |
75764 ns |
1.57 |
E2E_Evaluator_omnisharp |
1377896 ns |
1002602 ns |
1.37 |
E2E_Evaluator_openapi |
41770163 ns |
24939816 ns |
1.67 |
E2E_Evaluator_pre-commit-hooks |
1977206 ns |
1475743 ns |
1.34 |
E2E_Evaluator_pulumi |
1869914 ns |
1470116 ns |
1.27 |
E2E_Evaluator_semantic-release |
249903 ns |
184556 ns |
1.35 |
E2E_Evaluator_stale |
404987 ns |
260384 ns |
1.56 |
E2E_Evaluator_stylecop |
1126488 ns |
769161 ns |
1.46 |
E2E_Evaluator_tmuxinator |
233093 ns |
202542 ns |
1.15 |
E2E_Evaluator_ui5 |
2242361 ns |
1409670 ns |
1.59 |
E2E_Evaluator_ui5-manifest |
10201389 ns |
7010417 ns |
1.46 |
E2E_Evaluator_unreal-engine-uproject |
1506745 ns |
1097338 ns |
1.37 |
E2E_Evaluator_users-array |
2868866 ns |
2083156 ns |
1.38 |
E2E_Evaluator_vercel |
960576 ns |
706811 ns |
1.36 |
E2E_Evaluator_yamllint |
25888 ns |
16996 ns |
1.52 |
This comment was automatically generated by workflow using github-action-benchmark.
Signed-off-by: Juan Cruz Viotti jv@jviotti.com