Evaluate visual models on your own images, JSON Schema, and production constraints with LangGraph, Pareto analysis, and a no-key Replay demo.
-
Updated
Sep 9, 2026 - Python
Evaluate visual models on your own images, JSON Schema, and production constraints with LangGraph, Pareto analysis, and a no-key Replay demo.
A minimal Pareto-optimal OpenRouter model router for pi, based on Jev
Benchmark how well any model performs real-world, long-horizon coding tasks across coding agents (harnesses) -- Claude Code and pi. Run models three ways -- Anthropic on Amazon Bedrock, open-weight on Bedrock via a LiteLLM proxy, or self-hosted on EC2 with vLLM -- score them with an LLM judge, and plot the cost/quality Pareto frontier.
Passenger Flow Optimisation in the Singapore MRT network through Linear Algebra, Monte Carlo Simulation, Dijkstra's Algorithm, Graph Theory and Pareto Frontier Optimisation
When Free Executors Cost More: The Free-Executor Paradox in Iterative LLM Code-Repair Loops (paper + reproducibility kit)
Token-level early-exit Transformer with Gumbel-Softmax routing and a latency-aware joint loss — skips redundant layers for "easy" tokens while going deep on hard ones.
Public Agent Benchmark Suite: 172 curated tasks across 6 families, stratified multi-objective scoring & Pareto frontier computation
Multi-objective Job Shop Scheduling with Pareto frontier for makespan vs. utilization. Includes solver tuning and ±20% sensitivity analysis.
Chinese LLM model selection benchmark for AI product teams — quality × cost × latency.
Comparative study of transformer and non-transformer encoder architectures for dense retrieval — mapping the latency × accuracy Pareto frontier on BEIR. Solo research, PES University CSE 2026.
Interactive Pareto frontier of 1,586 language models: intelligence vs cost, joined from LMArena, models.dev, OpenRouter and LiveBench
Reproducible cross-workload cost-efficiency analysis for agentic AI using public HAL leaderboard data
Rubric-driven LLM evaluation: multi-provider, judge panels, cost-aware Pareto reports for production model selection
Generate Pareto frontier graphs for Turing Complete levels
Decision-support artifact in which explanation gates prescriptive search: calibrated simulation, DP2 attribution gate, and Pareto frontier over a learned objective. Replication code and data.
Code for Beyond Scalar Leaderboards: Adaptive Sampling for Pareto Frontier Identification in Multi-Objective LLM Arenas, including both synthetic experiments and realistic Arena replay.
Python graph optimisation tool for discovering resource-efficient and high-throughput Legendary item production systems in Factorio: Space Age.
Automated GGUF quantization, imatrix calibration, and perplexity evaluation lab for local LLMs
Multi-objective RL for reservoir control: PPO agents trace a flood/supply/ecology Pareto frontier in a custom Gymnasium environment, compared against a rule-based operating policy.
Connect 4 strength-per-byte arena — play 20 agents, exact-solver analysis, and a strength-vs-cost Pareto leaderboard where a 0-byte search agent is champion. FastAPI + React.
To associate your repository with the pareto-frontier topic, visit your repo's landing page and select "manage topics."