Vendor Portal
Respond to patterns, track fix status across versions, and publicly demonstrate improvement. Vendors are participants in this database, not just subjects.
How Vendor Notification Works
Pattern Submitted
A community member or maintainer submits a new regression pattern with reproduction steps.
Initial Review
Database maintainers verify the pattern is reproducible (>= 3/10 attempts) and meets documentation standards.
Vendor Notification
Your team is notified 7 days before publication. You receive the full pattern, reproduction steps, and severity assessment.
Response Window
You have 7 days to file a response that will be published alongside the pattern. Responses are never edited.
Publication
The pattern goes live with your response attached. You can update status anytime as fixes ship.
What Vendors Can Do
Respond to Patterns
Submit official statements during the 7-day notification window. Responses are published verbatim alongside the pattern.
Mark Fixes
Update pattern status to "fix planned" or "fix shipped" with the version. The test harness verifies fixes weekly.
Track History
View complete testing history: reproduction rates over time, which patterns were fixed, and how your fix rate compares.
Tools Currently Tracked
19 AI coding tools monitored across the database
| Tool | Patterns | Open | Fixed | Avg Repro Rate | Last Tested |
|---|---|---|---|---|---|
| GitHub Copilot | 12 | 8 | 4 | 5/10 | 2026-04-14 |
| Cursor | 9 | 5 | 4 | 4/10 | 2026-04-14 |
| Claude Code | 7 | 4 | 3 | 4/10 | 2026-04-14 |
| Codeium | 5 | 3 | 2 | 4/10 | 2026-04-07 |
| Aider | 4 | 2 | 2 | 4/10 | 2026-04-07 |
| OpenAI Codex CLI | 3 | 2 | 1 | 4/10 | 2026-04-07 |
| Gemini Code Assist | 3 | 2 | 1 | 4/10 | 2026-04-07 |
| Windsurf | 4 | 3 | 1 | 5/10 | 2026-04-07 |
| Tabnine | 2 | 1 | 1 | 3/10 | 2026-03-31 |
| Devin | 2 | 1 | 1 | 4/10 | 2026-04-07 |
| OpenHands | 2 | 2 | 0 | 4/10 | 2026-04-07 |
| Amazon Q Developer | 2 | 1 | 1 | 3/10 | 2026-04-07 |
| JetBrains AI Assistant | 2 | 1 | 1 | 3/10 | 2026-03-31 |
| Sourcegraph Cody | 1 | 1 | 0 | 3/10 | 2026-03-31 |
| Replit AI | 1 | 1 | 0 | 4/10 | 2026-03-31 |
| Cline | 2 | 1 | 1 | 4/10 | 2026-04-07 |
| Continue | 1 | 1 | 0 | 3/10 | 2026-03-31 |
| GPT Engineer | 1 | 1 | 0 | 4/10 | 2026-03-31 |
| Bolt | 1 | 1 | 0 | 5/10 | 2026-03-31 |
Register as a Vendor
Registration requires a verified corporate email domain. We verify your identity before granting access to respond to patterns and update fix status.
Our Commitments to Vendors
Neutral Infrastructure
The database documents patterns, not rankings. We never frame results as "which AI is worst." Every tool has failure modes.
Public Recognition of Fixes
When your tool fixes a pattern, we publicly recognize the improvement. Fixed patterns remain as a record of your responsiveness.
Version Awareness
We test against your latest versions. Old patterns are not used to characterize current performance. The database tracks improvement.
Unedited Responses
Your official responses are published exactly as submitted. We never edit, summarize, or misrepresent vendor statements.
Frequently Asked Questions
Questions?
If you represent an AI tool vendor and have questions about the notification process, vendor portal, or any pattern filed against your tool, contact us directly.
maintainers@korext.com