Staff Rust Developer
Dottxt, Remote - USA
The role
.txt https://dottxt.ai builds structured generation: we make language models produce output that follows a given format, by deciding at every decoding step which tokens are allowed. We compile a JSON Schema, a regex, a grammar, a list of function definitions or a policy into that decision, fast enough to run inside the decoding loop. This is how .txt builds reliable and safe agents. We're looking for a developer to work on the parsers and compilers at the center of it.
.txt builds structured generation: we make language models produce output that follows a given format, by deciding at every decoding step which tokens are allowed. We compile a JSON Schema, a regex, a grammar, a list of function definitions or a policy into that decision, fast enough to run inside the decoding loop. This is how .txt builds reliable and safe agents. We're looking for a Rust developer to own the part of it that has to be fast: the automata, indexes and parsers that run at every decoding step.
You'd turn what the rest of the team writes into production-ready Rust, with the Python bindings and C++/CUDA glue to put it inside an inference engine, and the benchmarks to prove it stays fast.