←back to thread

Query Your Python Lists

(github.com)
84 points mkalioby | 2 comments | 15 Nov 24 06:18 UTC | HN request time: 0.429s | source
Show context
maweki ◴[20 Nov 24 11:11 UTC] No.42192775[source]▶
Embedding functionality into strings prevents any kind of static analysis. The same issue as embedding plain SQL, plain regexes, etc..

I am always in favor of declarative approaches where applicable. But whenever they are embedded in this way, you get this static analysis barrier and a possible mismatch between the imperative and declarative code, where you change a return type or field declaratively and it doesn't come up as an error in the surrounding code.

A positive example is VerbalExpressions in Java, which only allow expressing valid regular expressions and every invalid regular expression is inexpressible in valid java code. Jooq is another example, which makes incorrect (even incorrectly typed) SQL code inexpressible in Java.

I know python is a bit different, as there is no extensive static analysis in the compiler, but we do indeed have a lot of static analysis tools for python that could be valuable. A statically type-safe query is a wonderful thing for safety and maintainability and we do have good type-checkers for python.

replies(4): >>42193389 #>>42194000 #>>42194121 #>>42196401 #
eddd-ddde ◴[20 Nov 24 14:19 UTC] No.42194121[source]▶
I disagree. You'll be surprised to hear this, but source code... is just a very big string...

If you can run static analysis on that you can run static analysis on string literals. Much like how C will give you warnings for mismatched printf arguments.

replies(1): >>42194391 #
maweki ◴[20 Nov 24 14:52 UTC] No.42194391[source]▶
You might be surprised to hear that most compilers and static analysis tools in general do not inspect (string and other) literals, while they do indeed inspect all the other parts and structure of the abstract syntax tree.
replies(1): >>42195260 #
eddd-ddde ◴[20 Nov 24 16:07 UTC] No.42195260[source]▶
I know, but that's the point, if you can get a string into an AST you can just do the same thing with the string literals. It's not magic.
replies(3): >>42195362 #>>42196090 #>>42196502 #
1. saghm ◴[20 Nov 24 16:15 UTC] No.42195362[source]▶
You can't get an arbitrary string into an AST, only ones that can be at parsed correctly. Rejecting the invalid strings that wouldn't make sense to do analysis on is pretty much the same thing that the parent comment is saying to do with regexes, SQL, etc., just as part of the existing compilation that's happening via the type system rather than at runtime.
replies(1): >>42196082 #
2. skeledrew ◴[20 Nov 24 17:15 UTC] No.42196082[source]▶
Everything can be abstracted away using specialized objects, which can allow for better checking. The Python AST itself is just specialized objects, and it can be extended (but of course with much more work, esp in the analysis tools). There's also this very ingenious - IMO - monstrosity: https://pydong.org/posts/PythonsPreprocessor/. Pick your poison.