Introducing Reg Affairs Bench

AI assistants answer regulatory questions well. The deliverables behind those questions are harder, such as classifying a change control against the guideline in force at submission, or checking that a Module 3 agrees with itself across a dozen documents. One wrong reporting category can mean a deviation or an agency query.
Related benchmarks test FDA drug label questions (FDARxBench1), life science research (LifeSciBench2) and legal agent work (Harvey's Legal Agent Benchmark3). We built Reg Affairs Bench around the work regulatory teams hand to each other, such as change classifications and dossier checks, and used it to compare Arca with the frontier model APIs it runs on. On the same models, Arca scores 88.5 against 74.5 for the plain Claude Opus 5 API, and 86.0 against 78.6 for GPT-6 Astra.
The tasks
Each task reads like a request to a senior colleague, with a scenario, its documents and the deliverable expected back. Answers are free text. A task-specific rubric awards points for the decisions, citations and open questions an expert expects. A fail line zeroes any answer that makes a disqualifying call, such as agreeing to a CBE-30 when the change needs prior approval.
| Task family | What the task asks |
|---|---|
| Reporting category | Classify a post-approval change, as an EU variation type and code under the guideline in force at submission or as a US reporting category. Credit for checking each condition against the facts and asking the questions that could change the outcome. |
| Dossier consistency | Audit Module 2 and 3 documents for conflicts. Real conflicts sit next to differences that are supposed to exist, and false alarms cost credit like misses. |
| Missing evidence | Draft a dossier section when a required report is not in the package. Credit for naming the missing document and what it blocks, and a fail line for inventing its results. |
| Submissions and correspondence | Agency correspondence, label reviews and clinical hold responses. |
| Device vigilance | Check a device adverse-event report in FDA's registry before a PSUR cites it, and decide whether the draft describes the event correctly. |
Construction
EU variation tasks start from published EMA procedural records. We rewrote each as a change control for a fictional company, wrote the dossier documents it needs, and kept EMA's published classification as the answer. Other task types are checked against their own primary sources.4
Consistency tasks hide real conflicts, such as a 36-month shelf life in the Quality Overall Summary against 24 months in the stability conclusion. They also hold differences an expert should not flag, such as release and shelf-life limits. A leak check confirms that no document contains the answer or the rubric's wording.
Regulatory affairs professionals wrote and reviewed the rubrics. Two of them wrote rubrics for the same tasks independently and scored the same answers almost identically.5
Models from three vendors grade every criterion. The full jury steps in whenever a verdict is partial or a fail line might fire. Judges see the source documents, so a fact from the library is never mistaken for an invented one.
Example task
A cell therapy site adds eight more instruments to bays it is already licensed for. Both systems recommend a prior approval supplement, so the gap between them is in the supporting work, namely which guidance row governs the change.
Arca pulls the FDA guidance rows for capacity and for duplicated process trains, sees that the row the change owner cites does not fit a cell therapy product at higher occupancy, and files the whole change as a PAS.
Task
Corvane Cell Therapeutics holds BLA 197388 for TESSACEL (tessagenlecleucel), an autologous anti-CD19 CAR-T product made one patient lot per AX-200 automated closed processing instrument in Suite 2B, Frederick, MD. Change control CC-2026-0512 adds eight more AX-200 instruments of the same model, software version, tubing set and locked recipe into the eight empty bays of the same licensed suite, doubling the lots that can be in process at once from 8 to 16. Process parameters, materials, specifications, room classification and HVAC are unchanged, and the suite was qualified for 16 bays. Write a US change assessment memo with the reporting category for each element and for the submission as a whole.
Documents
- 3.2.A.1 facilities and equipment
- 3.2.P.3.3 description of manufacturing process
- APS-2026-03 aseptic process simulation summary
- ER-2026-07 engineering run report
ResponseScore 100 · Steps 9 · Cost $1.26 · Time 8.3 min
1. Recommendation
Prior approval supplement (PAS) for the change as a whole. The proposed CBE-30 is not supportable, and the guidance line the change owner is relying on is the wrong row for a cellular therapy product.
The 2021 CMC changes guidance for certain biological products covers cellular and gene therapy products within its scope and contains two adjacent rows that resolve this directly:
- The CBE-30 row for "Addition of a duplicated cell culture process train with no change in process parameters specified in the approved BLA" carries the express note "This does not apply to cellular and gene therapy products."
- The matching row for this fact pattern is PAS: "Change in the production capacity for concurrent manufacturing processes by addition of identical unit processes (an increase in throughput)," with the note "This applies only to cellular and gene therapy products."
That second row is a near-verbatim description of CC-2026-0512: identical unit processes (same AX-200 model, software 4.2, tubing set TS-200-C, locked recipe TESS-R7) added to raise concurrent throughput from 8 to 16 lots — per BLA and equipment records. The generic EQUIPMENT row cited by the change owner ("Addition of duplicated process train or process step(s) ... with no change in the process parameters specified in the approved license," CBE-30) is displaced by the CGT-specific row; reading the EQUIPMENT row to cover a CGT throughput increase would make the CGT-only PAS row inoperative.
Statutory/regulatory basis: 21 CFR 601.12(a)(1)–(2) and 601.12(b)(1) (major change — substantial potential to adversely affect identity, strength, quality, purity or potency). Guidance basis: Chemistry, Manufacturing, and Controls Changes to an Approved Application: Certain Biological Products (June 2021), Appendix, 3.2.S.2.2 (Changes to the Upstream Steps of Drug Substance Manufacture through Harvesting) and Appendix, EQUIPMENT.
A secondary, independent PAS trigger exists on the sterility-assurance side (see element 3 below): 601.12(b)(2)(vi) lists as examples of major changes those "which may affect product sterility assurance, such as changes in product or component sterilization method(s), or an addition, deletion, or substitution of steps in an aseptic processing operation". On the present record — media fills run with no more than ten instruments in use, 16-lot concurrency assessed only by risk assessment RA-2B-2026-02 and never simulated, and an unchanged 6-operator cap — per aseptic records — the effect of doubled concurrency on interventions and operator traffic is unproven.
2. Element-by-element categorization
| # | Element of the change | Category standalone | Regulation / guidance section | Note |
|---|---|---|---|---|
| 1 | Increase in concurrent manufacturing capacity 8 → 16 lots by adding identical AX-200 unit processes (throughput increase) | PAS | 601.12(b)(1); 2021 guidance Appendix 3.2.S.2.2, upstream steps — "Change in the production capacity for concurrent manufacturing processes by addition of identical unit processes (an increase in throughput)," CGT-only | Controlling element |
| 2 | Addition of eight instruments of identical model/software/tubing set, no change to process parameters or the locked TESS-R7 recipe | CBE-30 if read on the generic EQUIPMENT row alone | 2021 guidance Appendix, EQUIPMENT — "Addition of duplicated process train or process step(s) ... with no change in the process parameters specified in the approved license" | Superseded by element 1 for a CGT product; do not file on this row |
| 3 | Aseptic/sterility-assurance impact of doubled concurrency in a shared ISO 7 suite (operator traffic, interventions, 6-operator cap unchanged, 16-lot concurrency never simulated) — per aseptic and qualification records | PAS | 601.12(b)(2)(vi) | Independent PAS trigger on current data; regulation-based |
| 4 | Use of bays 9–16 within Suite 2B (existing, already-qualified space; no construction, no renovation, no reclassification) — per change record | AR (minor) — guidance-based, to be confirmed against full Facilities appendix at filing | 2021 guidance Appendix, FACILITIES: changes within a location | Not an "addition/expansion/replacement of a suite/room"; no new or renovated aseptic area, so the PAS facility-transfer row does not apply on this record. Confirm no physical modification beyond panel removal. Subsumed into PAS in any event |
| 5 | HVAC — no change; AHU-2B already qualified at simulated 16-bay full occupancy (HVAC-2B-PQ-2022) — per change record | No report (documentation only) | — | Verify PQ was at full heat/particle load, not design calculation only |
| 6 | EM program EM-2B-01 rev. 5 — four new locations added for bays 9–16 — per EM records | AR (minor) — guidance-based, to be confirmed; subsumed into PAS | 2021 guidance Appendix, FACILITIES | An increase in sampling locations is a tightening with minimal adverse potential on its face. Note the arithmetic gap in item 6 of Open Questions |
| 7 | Process parameters, materials, specifications, release testing, container closure, shelf life, labeling | No change | — | Confirm and state affirmatively in the supplement |
Roll-up rule: for multiple related changes, the submission takes the highest-risk category of its elements. The guidance states the applicant should ensure that the highest risk change determines the reporting category for the submission. Elements 1 and 3 are PAS, so CC-2026-0512 is filed as a single PAS; elements 4 and 6 are subsumed into it rather than reported separately.
CBE-0 is not available. CBE-0 under 601.12(c)(5) depends either on FDA having determined that this change type is routinely complete on receipt or on validation under an approved 601.12(e) protocol. There is no approved comparability protocol for this change, so neither path is open.
Consequence of the category call: product from bays 9–16 may not be distributed until FDA approves the supplement (601.12(b)(3)). If the company files CBE-30 and FDA converts it to a PAS within the 30-day window under 601.12(c)(4)(i), distribution must stop until compliance is achieved — a worse commercial outcome than filing PAS at the outset, and for an autologous product that means patient-specific lots already in process on the new bays. Flag this to the change owner explicitly.
3. Data package for the PAS
Structured to 601.12(b)(3)(i)–(vii).
Available and adequate
- Detailed change description; product and BLA; site and area affected (Building 2, Suite 2B, bays 9–16) — per change record
- IQ/OQ/PQ for all eight new instruments, reports AX200-IOPQ-09 to -16 — per equipment records
- ER-2026-07: three healthy-donor engineering runs (bays 9, 12, 15); all attributes met release criteria and fell within the historical commercial range of 212 lots — per validation records
- APS-2026-03: three media fills on bays 10, 13, 16 replicating full TESS-R7 including all sterile connections, sampling and closed transfer, at maximum 10-day duration with worst-case interventions; 0 positive units; EM within Grade C action limits — per aseptic records
- HVAC-2B-PQ-2022 qualification at simulated full 16-bay occupancy — per change record
- EM-2B-01 rev. 5 with added locations for bays 9–16 — per EM records
- Statement that TESS-R7 is locked and not editable at instrument level — per BLA record
- Relevant SOP reference list; CC-2026-0512 change record
Gaps to close before filing
- Patient-lot comparability. ER-2026-07 states on its face that healthy donor cells typically expand better than patient cells and that the runs "demonstrate equipment performance, not patient-lot comparability" — per validation records. A PAS for a CGT throughput increase should not rest on donor runs alone. Propose a defined number of patient lots (or a prospective concurrent-lot comparability plan with pre-specified acceptance criteria against the n=212 commercial distribution) — TBD: number of patient lots and acceptance criteria.
- Full-concurrency aseptic qualification. The 16-lot condition is the whole point of the change and has never been run: APS ran at no more than 10 instruments in use — per aseptic records — and engineering runs at no more than 8 — per validation records. Either execute an APS or a staffing/traffic simulation at 16-bay occupancy, or propose a phased build-up with defined concurrency tiers.
- Operator capacity. The suite remains validated for a maximum of 6 operators — per change record — while lots in process double. Provide the time-and-motion or staffing analysis showing 16 lots can be run within the 6-operator cap without compressing critical interventions, or revalidate EM at a higher operator count.
- RA-2B-2026-02 in full, not by reference — it is currently the only evidence covering full concurrency — per aseptic records.
- Chain-of-identity / mix-up risk at doubled concurrency. Segregation relies on one lot per instrument plus patient-specific barcode labelling — per change record; provide the assessment specific to 16 simultaneous patient-specific lots.
- Instrument-level APS coverage strategy. Current program is per-instrument at qualification then twice yearly across a rotating subset — per change record; state the revised rotation for 16 instruments.
4. Impacted CTD sections
| Section | Change |
|---|---|
| 3.2.A.1 Facilities and Equipment | Suite 2B equipment list 8 → 16 AX-200; bay occupancy; EM program rev. 5 and location count; personnel limit statement; HVAC qualification cross-reference — per change record |
| 3.2.S.2.2 / 3.2.P.3.3 Description of Manufacturing Process and Process Controls | Section 4 Capacity statement: "eight AX-200 instruments ... up to eight lots ... at the same time" → sixteen — per BLA record |
| 3.2.S.2.5 / 3.2.P.3.5 Process Validation and/or Evaluation | New IQ/OQ/PQ, engineering runs, APS-2026-03, comparability data, concurrency assessment |
| 3.2.S.2.4 / 3.2.P.3.4 Controls of Critical Steps | Confirm no change (no new or modified IPCs) |
| 3.2.S.2.6 / 3.2.P.2 Development | Only if comparability rationale is placed here |
| 3.2.R / Module 1 establishment information | No new registered location; confirm whether Form FDA 356h establishment listing or facility information needs a consistency update for bay/capacity detail |
| Module 1 cover letter | 601.12(a)(5) list of all changes in the supplement |
| Labeling (Module 1.14) | No impact |
5. Documented facts, assumptions, open questions
Documented facts — per change, BLA, aseptic/EM, and equipment records as stated
- One lot = one patient's leukapheresis = one patient dose; DS and DP made continuously with no stored intermediate, entirely inside one closed AX-200; one lot per instrument
- All steps occur in a single closed system; no open manipulations in the suite
- Suite 2B was designed and qualified at construction (2022) for 16 instrument bays; bays 9–16 were empty behind removable panels
- AHU-2B qualified for full 16-bay occupancy (HVAC-2B-PQ-2022)
- Maximum 6 operators in the suite, validated for EM
- New instruments: same model, software 4.2, tubing set TS-200-C, recipe TESS-R7; recipe not editable at instrument level
- IQ/OQ/PQ complete for bays 9–16; three healthy-donor engineering runs passed and fell within the n=212 historical range; three media fills passed with 0 positives
- 16 concurrent instruments have never been operated; APS ran at no more than 10 in use, engineering runs at no more than 8
- Full-concurrency effect assessed only by risk assessment RA-2B-2026-02, not simulated
- No approved comparability protocol exists for this change (user-stated)
Assumptions (to be confirmed by the change owner)
- Room classification, pressure regime, gowning, material and personnel flows are genuinely unchanged; panel removal involved no construction requiring requalification
- No change to release specifications, analytical methods, testing locations, container closure, freezing profile FP-03, or storage conditions
- No change to lentiviral vector supply, reagent suppliers or ancillary material lot-release arrangements at doubled demand
- Product from bays 9–16 is intended for US commercial distribution (not clinical/expanded access only)
- Suite 2B is single-product; no multiproduct introduction accompanies this change
- Corvane is not concurrently filing an EU or other regional variation whose data package must align
Open questions — internal
- Does the approved BLA state a numerical capacity or instrument count as a licensed condition, or is 3.2.P.3.3 Section 4 descriptive? This affects whether the capacity statement itself is an approved condition of the license.
- Was HVAC-2B-PQ-2022 executed with simulated heat load and particle counts at 16-bay occupancy including 6 operators present, or equipment load only? — per change record
- What does RA-2B-2026-02 conclude on interventions per operator-hour at 16 lots, and what residual risk did it accept? — per aseptic records
- What is the staffing model at 16 concurrent lots — shift structure, operators per lot, interventions per shift?
- Is the twice-yearly APS rotation being revised so every instrument is covered on a defined cycle, and over what period? — per change record
- APS-2026-03 records "four new EM locations ... for bays 9 to 16" — per EM records — while the baseline program had 22 locations set for eight equipped bays — per change record. Four new locations for eight new bays is disproportionate on its face — confirm the number is correct and justified, or correct the record.
- Are there patient lots already manufactured or in process on bays 9–16? If so, their disposition needs an answer now, independent of the filing category.
- Would a 601.12(e) comparability protocol be worth filing now (as a PAS) to reduce the reporting burden for future capacity expansions — for example a future Suite 2C build-out? An approved protocol can justify a reduced reporting category for subsequent changes of the same type.
Targeted questions for FDA (Type B/C or informal OTP interaction, before filing)
- Does CBER agree that the Appendix 3.2.S.2.2 CGT row for increased concurrent production capacity by addition of identical unit processes controls this change and requires a PAS, notwithstanding the generic EQUIPMENT CBE-30 row?
- Does CBER consider full 16-bay concurrent aseptic process simulation necessary before approval, or is a risk assessment plus a phased concurrency build-up with defined tiers acceptable?
- How many patient lots from the new instruments, and against what acceptance criteria, would CBER expect for comparability, given that the recipe and parameters are unchanged and the instrument is closed?
- Is a prospective concurrency-tier approach (approve at 16 bays, implement stepwise with EM and APS confirmation at each tier, reported in the annual report) acceptable in the PAS?
- Would CBER entertain a 601.12(e) comparability protocol covering future addition of identical AX-200 instruments, and what would it need to contain to support a reduced reporting category?
Practical note on the CBE-30 proposal. The change owner's reading is defensible in isolation but fails on the CGT carve-outs, which exist precisely because throughput increases in autologous manufacturing raise mix-up, chain-of-identity and shared-environment risks that a duplicated bioreactor train in a monoclonal process does not. Filing CBE-30 risks a 601.12(c)(4) conversion mid-window with patient-specific lots in process. Recommend PAS, with pre-submission engagement on the comparability and full-concurrency questions so the data package is agreed before it is built.
This is regulatory analysis for internal use, not legal advice, and it is not an FDA determination.
Sources: Chemistry, Manufacturing, and Controls Changes to an Approved Application: Certain Biological Products; Guidance for Industry: https://www.gmp-compliance.org/files/guidemgr/Chemistry_Manufacturing_Controls_Changes_Application_Final_06-16-2021.pdf § 601.12 Changes to an approved application.: https://www.ecfr.gov/current/title-21/section-601.12
Rubric and grades
- States the reporting category is a prior approval supplement+23.8
- Finds the prior approval entry for a change in production capacity+20.9
- Handles the change owner's citation: the duplicated process train row does not govern here+17.1
- Flags that all sixteen instruments have never run at once, so the aseptic simulation does not cover full occupancy+13.3
- Limits what the engineering runs support+10.4
- Notes there is no approved comparability protocol, so no reduced category+9.5
- Recognises there is no location, suite or HVAC change+5.0
The plain API lands on the same recommendation and argues it well from the regulation, but it never finds the two guidance rows the answer key asks for, so it loses the points for showing which row governs.
Task
Corvane Cell Therapeutics holds BLA 197388 for TESSACEL (tessagenlecleucel), an autologous anti-CD19 CAR-T product made one patient lot per AX-200 automated closed processing instrument in Suite 2B, Frederick, MD. Change control CC-2026-0512 adds eight more AX-200 instruments of the same model, software version, tubing set and locked recipe into the eight empty bays of the same licensed suite, doubling the lots that can be in process at once from 8 to 16. Process parameters, materials, specifications, room classification and HVAC are unchanged, and the suite was qualified for 16 bays. Write a US change assessment memo with the reporting category for each element and for the submission as a whole.
Documents
- 3.2.A.1 facilities and equipment
- 3.2.P.3.3 description of manufacturing process
- APS-2026-03 aseptic process simulation summary
- ER-2026-07 engineering run report
ResponseScore 62 · Steps 6 · Cost $1.36 · Time 5.9 min
1. Executive recommendation
| Recommended category for the submission as a whole | Prior approval supplement (PAS) under 21 CFR 601.12(b) — or a CBE‑30 restructured as described in §7, Option 2 (capacity increase capped at the demonstrated state) |
| Change owner's proposal (CBE‑30 for the whole change) | Not supported as currently constituted. The equipment-duplication element is plausibly moderate; the concurrency/capacity element (8 → 16 simultaneous patient lots, never demonstrated) is the highest-risk element and drives the category |
| Principal driver | Contamination control and chain-of-identity risk at 16 concurrent lots with unchanged support infrastructure (6 operators, 2 BSCs, 4 welders, 2 controlled-rate freezers) has been risk-assessed but not demonstrated (APS‑2026‑03 §3; ER‑2026‑07 §3) |
| Recommended FDA interaction | Written request for advice / Type C-equivalent CMC interaction with CBER OTP before filing, on reporting category and on the acceptability of the concurrency data package |
| Do not implement >8 concurrent lots | Until the category is settled and (for a PAS) approval is received, or (for a capped CBE‑30) the 30-day period has run without FDA converting the filing |
Why the bundle matters: FDA's 2021 guidance is explicit that a single change may be reportable in more than one category depending on its type and extent, and that when considering the correct reporting category for a submission, the applicant should ensure that the highest risk change determines the reporting category chosen, noting that several moderate-risk changes may accompany one major-risk change. The eight instruments cannot be de-coupled from what they are for (doubling concurrent operation) in the same room, with the same air handler, the same 6-operator limit and the same downstream support equipment.
2. Documented facts (source-traceable; no interpretation)
From the approved dossier (v2.0, 9 Oct 2025):
| # | Fact | Source |
|---|---|---|
| F1 | One lot = one patient's leukapheresis = one dose; DS and DP manufactured continuously with no stored intermediate; all steps from selection to harvest occur inside a single AX-200 (SW 4.2, tubing set TS‑200‑C), one lot per instrument | 3.2.P.3.3 §1 |
| F2 | Process parameters, including AX-200 recipe TESS‑R7, are identical for every instrument; recipe cannot be edited at instrument level | 3.2.P.3.3 §3 |
| F3 | Licensed capacity statement: "At licensure, eight AX-200 instruments are installed in manufacturing suite 2B… Up to eight lots can be in process at the same time" | 3.2.P.3.3 §4 |
| F4 | Suite 2B designed/qualified at construction (2022) for 16 instrument bays with dedicated power, data, CO₂ and exhaust; bays 9–16 empty, closed with removable panels | 3.2.A.1 §1 |
| F5 | AHU‑2B qualified for full occupancy of 16 bays (heat load and particle counts at simulated full occupancy, HVAC‑2B‑PQ‑2022); ISO 7 (Grade C) background, +15 Pa, 30 ACH | 3.2.A.1 §1 |
| F6 | Licensed personnel limit: maximum 6 operators in the suite at one time (validated for EM) | 3.2.A.1 §1 |
| F7 | Segregation control = one lot per instrument, patient-specific chain-of-identity barcode on instrument/tubing set/materials, no open manipulations in the suite | 3.2.A.1 §1 |
| F8 | Licensed equipment list for Suite 2B: 8 AX‑200 (bays 1–8), 2 BSCs (sampling), 4 tube welders; 2 controlled-rate freezers in Suite 2C | 3.2.A.1 §2 |
| F9 | EM program EM‑2B‑01 at 22 locations, sampling points set for the eight equipped bays; APS per instrument at qualification and twice yearly across a rotating subset | 3.2.A.1 §3 |
From the change package:
| # | Fact | Source |
|---|---|---|
| F10 | Eight new AX-200: same model, SW 4.2, same tubing set TS‑200‑C, same recipe TESS‑R7; IQ/OQ/PQ complete (AX200‑IOPQ‑09 to ‑16) | ER‑2026‑07 §1 |
| F11 | Three engineering runs only (bays 9, 12, 15), healthy-donor material, no patient material; all attributes met release criteria and fell within the historical commercial range (n = 212 lots) | ER‑2026‑07 §1–2 |
| F12 | Report itself states healthy-donor cells typically expand better, so the runs demonstrate equipment performance, not patient-lot comparability | ER‑2026‑07 §2 |
| F13 | During engineering runs at most eight instruments ran concurrently; operation of all 16 at the same time has not been performed | ER‑2026‑07 §3 |
| F14 | Media fills on three new instruments (bays 10, 13, 16), full TESS‑R7 simulation, max duration (10 d), worst-case interventions (2 extra sampling steps); 0/3 runs positive; EM met Grade C action limits | APS‑2026‑03 §1–2 |
| F15 | Four new EM locations added for bays 9–16 (EM‑2B‑01 revision 5) | APS‑2026‑03 §2 |
| F16 | APS run with no more than ten instruments in use; effect of 16 concurrent lots on operator traffic/interventions at the 6-operator limit assessed by RA‑2B‑2026‑02 but not simulated | APS‑2026‑03 §3 |
| F17 | No approved comparability protocol exists for BLA 197388 | Change owner input |
| F18 | Five instruments (bays 9, 11, 12, 14, 15) have had neither an engineering run nor a media fill; five (bays 9, 11, 12, 14, 15) lack APS and five (10, 11, 13, 14, 16) lack an engineering run | Derived from F11/F14 |
Regulatory landscape (verified 15 Sep 2026):
| # | Fact | Source |
|---|---|---|
| F19 | The controlling reporting-category guidance is the June 2021 final guidance Chemistry, Manufacturing, and Controls Changes to an Approved Application: Certain Biological Products, which finalizes the December 2017 draft and supersedes the July 1997 guidance "Changes to an Approved Application: Biological Products" and describes a tiered-reporting system for specific changes under 21 CFR 601.12 | FDA/Federal Register |
| F20 | The guidance's Appendix is a guide, not a rule: the table is not an exhaustive list, a change may be reportable even if not listed, and although category selection generally should follow the recommendations, a different selection may in some instances be appropriate provided it complies with applicable regulatory requirements; and early consultation with FDA is recommended for changes not described in the table or when considering an adjustment to the recommended categories | 2021 guidance |
| F21 | Appendix categories are risk-derived: based in part on FDA's overall assessment of potential risks to process performance and product quality caused by the change, supported by the Agency's accumulated inspection and review experience | 2021 guidance |
| F22 | Supplement content expectations: any supplement (PAS, CBE‑30, or CBE) should include a detailed description of and rationale for the change, a description of the methods and studies performed to evaluate the effects of the change on product quality with the resulting data, and a reference list of relevant SOPs | 2021 guidance |
| F23 | Products excluded from the 2021 guidance's scope include 601.2(a) specified biological products, whole blood/components/source leukocytes, 351(k) biosimilar and interchangeable products, and 361 HCT/Ps; the guidance also does not cover applicant name changes or labeling changes — CGT products are addressed in the guidance (its footnotes define the terms, e.g. "gene therapy products" includes cell-based gene therapies) | 2021 guidance |
| F24 | The CGT-specific change guidance remains draft: FDA's CGT guidance page still lists Manufacturing Changes and Comparability for Human Cellular and Gene Therapy Products; Draft Guidance for Industry, 7/2023. It defines a manufacturing change for a licensed product as a change (other than a labeling change) falling within the types of changes described in 21 CFR 601.12(a)(1) | FDA |
| F25 | New final guidance in effect: Chemistry, Manufacturing, and Controls Flexibilities for Developing Human Cellular and Gene Therapy Products for a Biologics License Application, issued for immediate implementation under 21 CFR 10.115(g)(4)(i) (May 2026, docket FDA‑2026‑D‑4692). It is BLA-development focused, but FDA states it may consider extending some of the flexibilities to manufacturing supplements submitted post-licensure | FDA |
| F26 | CBER's stated posture: CBER recommends a risk assessment for all manufacturing changes; and on the January 2026 flexibility webpage, CBER will consider submissions seeking to re-evaluate and revise product release acceptance criteria based on post-approval manufacturing experience where manufacturers demonstrate consistent product quality | FDA |
3. Assumptions (must be confirmed before the memo is used as the filing basis)
- A1 — Appendix line quoted by the change owner. The memo assumes the entry "addition of duplicated process train or process step(s) … with no change in the process parameters" exists in the 2021 guidance Appendix in the moderate/CBE‑30 column. RA to pull the Appendix verbatim, record the row number and column, and check for any footnote or carve-out applicable to cellular/gene therapy products or to changes affecting facility capacity/segregation. Industry comment on the draft specifically flagged that some cellular, gene and cell-based gene therapy products are excluded as exceptions in certain examples in the appendix — so this check is not optional.
- A2 — Scope. BLA 197388 is a 351(a) BLA for a cellular/gene therapy product and is within scope of the 2021 guidance (F23). Confirm.
- A3 — CFR subparagraph citations. Tier framework cited as 601.12(b) (major/PAS), 601.12(c) (moderate/CBE‑30, including FDA's ability to require a PAS within 30 days of receipt), 601.12(d) (minor/annual report), 601.12(e) (protocols). Verify subparagraph designations against the current CFR text before filing.
- A4 — Review timing. A manufacturing PAS is assumed to carry a 4-month user-fee goal, with the possibility of a pre-approval inspection of Suite 2B extending real timelines. Confirm current PDUFA commitment language and CBER OTP practice for CGT facility supplements.
- A5 — Established conditions. The licensed established conditions include the instrument count and the "up to eight lots at the same time" statement (F3), the 16-bay design/qualification (F4/F5), the 6-operator limit (F6), the equipment list (F8) and the 22-location EM program (F9). Any change to these text elements is reportable under 601.12(a).
- A6 — No other change. Materials, tubing set, vector lot strategy, release specifications, analytical methods, container closure, freezing profile FP‑03, storage conditions, shelf life and labeling are unchanged; no new suite, no new establishment, no new manufacturing address, no CMO.
- A7 — Downstream capacity. QC/release testing throughput, LN₂ storage, cryoshipper fleet and the 2 controlled-rate freezers in Suite 2C are assumed not to require change. This is an assumption only — see OQ‑4.
- A8 — No product-quality signal. No trend, deviation or EM excursion in Suite 2B in the last 24 months that would be aggravated by doubled occupancy. To be confirmed by the site quality metrics review.
4. Regulatory basis relied upon
| Instrument | Section relied upon | Use in this assessment |
|---|---|---|
| 21 CFR 601.12(a) | Each change in product, production process, quality controls, equipment, facilities, responsible personnel or labeling must be reported | Establishes reportability of every element in §5 |
| 21 CFR 601.12(b) | Major change = substantial potential to adversely affect identity, strength, quality, purity or potency as they may relate to safety or effectiveness → PAS, no distribution before approval | Basis for PAS recommendation on the concurrency element |
| 21 CFR 601.12(c) | Moderate change → CBE‑30; FDA may notify the applicant within 30 days of receipt that a PAS is required, in which case distribution is barred | Basis for the "conversion risk" analysis in §6 |
| 21 CFR 601.12(d) | Minor change → annual report | Basis for AR treatment of the "no change" confirmations and EM location additions if filed standalone |
| 21 CFR 601.12(e) | Protocols (comparability protocols) may be submitted to allow a reduced reporting category for specified future changes | Basis for Option 3 (future instrument/suite additions) — none exists today (F17) |
| FDA guidance, CMC Changes to an Approved Application: Certain Biological Products (June 2021) | Appendix table; highest-risk-change rule; non-exhaustive/adjustable nature of Appendix; supplement content | F19–F23; §6, §8 |
| FDA draft guidance, Manufacturing Changes and Comparability for Human CGT Products (July 2023) | Risk assessment; analytical comparability design; communication with FDA | Comparability strategy in §8; still draft and non-binding (F24) |
| FDA guidance, CMC Flexibilities for Developing Human CGT Products for a BLA (May 2026, immediate implementation) | Risk-based comparability; possible post-licensure extension of flexibilities | Supporting argument for a CPV-based (rather than prospective side-by-side patient-lot) comparability package (F25) |
| CGMP: 21 CFR 210/211 (esp. 211.42, 211.68, 211.100, 211.113(b)), 21 CFR 600–680, 610.12 | Facility design/flow, computerised systems, aseptic controls, sterility | Underpins the APS/EM/segregation expectations in §8 regardless of reporting category |
| FDA guidance, Process Validation: General Principles and Practices (2011) | Stage 2 qualification / Stage 3 continued process verification | Basis for the CPV commitment in §8 item 8 |
5. Element-by-element reporting category
| # | Element of CC‑2026‑0512 | Risk rationale | Category if filed standalone | Comment |
|---|---|---|---|---|
| E1 | Addition of 8 AX‑200 instruments, same model/SW 4.2/TS‑200‑C/TESS‑R7, into pre-qualified bays; IQ/OQ/PQ complete | Duplicate train, no change in process parameters, no change in scale (lot size is fixed at one patient dose), locked recipe (F2) | CBE‑30 (moderate) | The change owner's Appendix line, read narrowly, fits this element only (subject to A1) |
| E2 | Increase in maximum concurrent lots in process from 8 to 16 (amendment of 3.2.P.3.3 §4) | Doubles simultaneous patient-specific lots in one room under an unchanged 6-operator limit; affects contamination control strategy, intervention frequency, operator traffic, alarm/deviation handling and chain-of-identity mix-up risk for 16 non-interchangeable single-patient lots. Not demonstrated (F13, F16) | PAS (major) | This is the category-determining element |
| E3 | Amendment of 3.2.A.1 (bays equipped 8 → 16; equipment list quantity 8 → 16; removal of panels) | Facility description change; the physical envelope, classification, pressure regime and AHU are unchanged and AHU‑2B was qualified at simulated 16-bay full occupancy (F5) | CBE‑30 | Files with E1 |
| E4 | EM program EM‑2B‑01 rev 5: 22 → 26 viable/non-viable locations | Expansion/strengthening of monitoring; but 4 new locations for 8 new bays vs 22 for 8 existing bays is a proportionality question (F9/F15) | Annual report if purely additive and justified; CBE‑30 if the sampling rationale for bays 9–16 is not equivalent to bays 1–8 | See TQ‑3 |
| E5 | APS/media-fill strategy across 16 instruments (per-instrument at qualification + 2×/yr rotating subset) | The licensed text (F9) already provides for per-instrument qualification APS; only 3 of 8 new instruments have an APS (F18) | CBE‑30, or AR if the licensed strategy is applied unchanged and all 8 receive a qualification APS before use | Close the F18 gap before filing |
| E6 | Personnel: 6-operator limit retained for 16 concurrent lots | If 6 operators cannot support 16 lots, the limit will need to rise → EM/APS revalidation at the new occupancy | PAS/CBE‑30 if the limit changes; no change if genuinely retained | See OQ‑2; do not "quietly" exceed 6 |
| E7 | Support equipment not scaled: 2 BSCs, 4 welders, 2 controlled-rate freezers (Suite 2C) | Doubled lot flow concentrates on unchanged sampling, welding and day-9 freezing capacity → hold-time and scheduling risk at harvest | Assess; may be no change (if capacity study supports) or CBE‑30/PAS if equipment added or hold times extended | See OQ‑4 |
| E8 | Confirmations of no change: process parameters, materials, specifications, methods, classification, HVAC, container closure, stability, labeling | No risk | Annual report / statement in the supplement | Include explicit "no change" statements with supporting rationale |
| Overall submission | Highest-risk element (E2) governs, per FDA's instruction that the highest risk change determines the reporting category chosen for the submission | PAS | Or restructured CBE‑30 per §7 Option 2 |
6. Assessment of the proposed CBE‑30
The Appendix citation is relevant but not sufficient. Three reasons:
- It addresses the wrong element. "Addition of a duplicated process train … with no change in the process parameters" describes E1. It does not describe an increase in the number of patient-specific lots processed simultaneously in a single classified room, which is a change to the contamination control strategy and segregation regime, i.e. to the facility control elements described in 3.2.A.1. The Appendix is explicitly not an exhaustive list, and a change may be reportable even if not listed in the table.
- The "worst case" being registered has never been executed. The applicant would be asking FDA to license a 16-lot concurrent state on the strength of (a) a 2022 HVAC qualification at simulated full occupancy, (b) three healthy-donor runs on three of eight instruments at ≤8 concurrency, (c) three media fills at ≤10 concurrency, and (d) a paper risk assessment (F5, F11, F13, F14, F16). For an autologous product where mix-up is a patient-fatal failure mode and where the Appendix categories are derived from FDA's assessment of risks to process performance and product quality, this is the kind of gap that CBER OTP reviewers and investigators pursue.
- Conversion risk is asymmetric and clinically material. Under 601.12(c) FDA may inform the applicant within 30 days that a PAS is required, which bars distribution. If bays 9–16 are already loaded with patient lots when that notice arrives, Corvane is holding unreleasable autologous product for identified patients — a supply, compliance and ethics event, not merely a regulatory one. A PAS (or the capped CBE‑30 of Option 2) removes that exposure.
Counter-arguments to preserve in the file (they are good ones, and belong in the submission whichever route is chosen):
- Lot size is invariant — one leukapheresis, one dose. This is capacity multiplication, not scale-up; the classic PAS trigger of a changed scale of a unit operation is absent.
- The recipe is locked and not editable at instrument level (F2), so there is no instrument-to-instrument parameter drift pathway.
- The process is closed with no open manipulations (F7); the AHU was qualified at simulated 16-bay full occupancy (F5); and the suite was designed and qualified for 16 bays at construction — i.e. the 16-bay state was contemplated in the approved application.
- Segregation is achieved per-instrument and per-barcode, not by spatial or temporal separation, so adding instruments does not dilute the segregation logic.
7. Strategy options
Option 1 — PAS for the full change (recommended default). File one PAS covering E1–E8, with the data package in §8 completed (including a full-occupancy APS/EM/smoke study campaign and an APS on all eight new instruments). Pros: single approval, clean established-conditions update, no distribution risk, and the pre-approval inspection (if any) occurs before commercial use of bays 9–16. Cons: longest time to capacity; requires the full-occupancy simulation work.
Option 2 — CBE‑30 capped at the demonstrated state, then a second filing (recommended if capacity is needed in 2026). File a CBE‑30 covering E1, E3, E4, E5 that installs and qualifies all 16 instruments but registers a maximum concurrency of 10 — the state actually demonstrated in APS‑2026‑03 (F16). 3.2.P.3.3 §4 is amended to "up to ten lots in process at the same time," with an explicit statement that the remaining bays are installed, qualified and held at rest. The step from 10 → 16 is then filed separately (CBE‑30 or PAS per FDA feedback) once a full-occupancy APS campaign and EM/smoke-study qualification at 16 concurrent lots is complete. Pros: aligns the registered claim exactly with the executed evidence, which is the most defensible position in an inspection; delivers 25% capacity now. Cons: two filings; requires operational discipline (scheduling lock-out) to hold the cap, and that lock-out must be proceduralised and auditable.
Option 3 — Add a comparability protocol under 601.12(e) (recommended in either case). Include in the PAS/CBE‑30 a prospective CP defining the tests, studies and acceptance criteria for future additions of identical AX‑200 trains and concurrency increases (e.g. IQ/OQ/PQ, one qualification APS per instrument, N engineering or first-commercial lots per instrument with pre-set CQA acceptance criteria, EM qualification at the new occupancy). An approved CP would allow subsequent expansions — Suite 2C, a second site, or bays beyond the current envelope — to go in at a reduced category. Given the trajectory of this product, the CP is the highest-ROI item in this memo. There is no CP today (F17).
Not viable: CBE‑0 (no designated category or FDA agreement supporting immediate distribution here) and annual report for the change as a whole.
8. Data package to support the submission
(Content framed to satisfy FDA's expectation that any supplement include a detailed description of and rationale for the change, the methods and studies used to evaluate the effects of the change on product quality with the data, and a reference list of relevant SOPs.)
- Change description and rationale, with a before/after established conditions table (instrument count; concurrent-lot maximum; equipment list; EM location count; APS strategy; operator limit) and an explicit statement of what is not changing.
- Risk assessment RA‑2B‑2026‑02 in full (not a summary), with hazard-by-hazard mitigation and residual-risk conclusions, covering at minimum: chain-of-identity/mix-up at 16 concurrent lots; intervention and traffic load at 6 operators; gowning/airlock throughput; simultaneous alarm handling and deviation management; utility load (power, CO₂, exhaust, data) at 16 bays; waste and material flow; harvest-day collision (day 9, range 8–10) across up to 16 lots; and QC sampling/testing throughput.
- Equipment qualification summaries AX200‑IOPQ‑09 to ‑16, with the traceability matrix showing identity of model, software 4.2 configuration and TS‑200‑C tubing set, plus 21 CFR Part 11 / data-integrity assessment for the eight new instrument control systems and their interface to the scheduling/COI system.
- ER‑2026‑07 with an honest statement of its limits — three instruments, healthy donors, ≤8 concurrency (F11–F13) — and the per-attribute comparison against the n = 212 commercial baseline. Do not present it as comparability evidence; the report itself does not.
- APS‑2026‑03 plus the gap closure: a qualification APS on each of the five new instruments not yet media-filled (F18), and — for a 16-lot claim — an APS/EM campaign at maximum occupancy with worst-case interventions and the maximum operator complement, supported by updated smoke/airflow visualisation studies at 16-bay occupancy and a re-verification of AHU‑2B performance with instruments and personnel actually present (the 2022 PQ was a simulation, F5).
- EM program EM‑2B‑01 rev 5 with the location-selection rationale for bays 9–16 and a justification of proportionality against the original 22-location design (F9/F15); action/alert limits unchanged; trend data for bays 1–8 over 24 months as the baseline.
- Segregation / chain-of-identity control package: barcode and two-person verification workflow at 16 concurrent lots, scheduling system controls preventing double-allocation of an instrument or a tubing set, label reconciliation, and the capacity/lock-out control that enforces the registered concurrency maximum (essential under Option 2).
- Continued process verification (CPV) commitment, e.g. per-instrument monitoring of viability, %CAR+, VCN, IFN‑γ potency, total viable CAR+ cells and endotoxin for the first defined number of commercial lots on each new bay, with pre-specified statistical comparison to the n = 212 historical distribution, pre-defined action thresholds, and a commitment to report outcomes in the annual report (and to notify FDA of any signal). This is the mechanism by which patient-lot equivalence — which cannot be generated pre-implementation — is actually demonstrated, and is consistent with CBER's stated risk-based posture (F26) and with the acknowledgement in the May 2026 guidance that FDA may consider extending some CGT CMC flexibilities to post-licensure manufacturing supplements.
- Support-capacity assessment for the 2 BSCs, 4 welders and 2 controlled-rate freezers, including day-9 harvest queuing analysis, hold-time justification between formulation and controlled-rate freezing, and LN₂ storage/shipper capacity.
- Personnel qualification and training records/plan for the new bays; aseptic technique requalification; assessment of whether the 6-operator limit is sustainable at 16 lots.
- Statements of no impact on specifications, analytical methods, materials (including vector), container closure, FP‑03 freezing profile, storage, shelf life/stability and labeling.
- SOP reference list and the updated CTD sections (annotated, clean and redline).
9. Impacted CTD sections
| Module/section | Nature of update |
|---|---|
| 3.2.A.1 Facilities and Equipment | Suite 2B: bays equipped 8 → 16; equipment list AX‑200 quantity 8 → 16 with IQ/OQ/PQ references AX200‑IOPQ‑09 to ‑16; EM program at 26 locations (rev 5) with sampling-point rationale for bays 9–16; APS strategy across 16 instruments; personnel limit statement (retained or revised); removal of the "bays 9–16 empty/closed with removable panels" text; cross-reference to HVAC‑2B‑PQ‑2022 plus any new full-occupancy qualification |
| 3.2.P.3.3 Description of Manufacturing Process and Process Controls | §4 Capacity: instrument count and "up to eight lots in process at the same time" → 10 or 16 per the option chosen; §1 wording on one lot per instrument retained; §3 confirmation that TESS‑R7 is unchanged and non-editable |
| 3.2.P.3.1 Manufacturer(s) | Confirm no change (same licensed establishment/address); update equipment references if listed |
| 3.2.P.3.5 Process Validation and/or Evaluation | Equipment qualification summary; APS results; engineering run results; CPV plan and acceptance criteria for lots manufactured on bays 9–16 |
| 3.2.S.2.2 / 3.2.S.2.5 (DS description and process validation) | Mirror the P.3.3/P.3.5 updates — the process is continuous with no stored intermediate, so DS sections carry the same instrument/capacity statements |
| 3.2.P.3.4 Controls of Critical Steps and Intermediates | Confirm unchanged; verify no IPC statement is tied to instrument count |
| 3.2.A.2 Adventitious Agents Safety Evaluation | Confirm unchanged (closed system, unchanged vector and materials); state the basis for no impact of increased concurrency on cross-contamination controls |
| 3.2.P.8 Stability | No new data; statement of no impact |
| 3.2.R Regional Information | Executed batch record / master production record updates as applicable; comparability protocol (if Option 3) |
| Module 1 | Form FDA 356h; cover letter with clear category designation and, for a CBE‑30, the prominent "Changes Being Effected in 30 Days" identification and intended implementation date; 1.12 environmental analysis — categorical exclusion claim; no labeling change (Module 1.14 unaffected); establishment information unchanged |
| Annual report | E8 "no change" confirmations if not carried in the supplement; CPV outcomes for bays 9–16; EM trend summary at the new occupancy |
10. Open questions
10.1 For the change owner / MSAT / site quality (must be closed before filing)
- OQ‑1. What is the business-required concurrency, and by when? If ≤10 lots meets 2026–27 demand, Option 2 is materially lower risk for no commercial cost.
- OQ‑2. Can 6 operators support 16 concurrent lots across the full day-0-to-day-10 cycle, including worst-case simultaneous harvests? Provide the staffing model and the interventions-per-shift calculation. If the answer is no, the operator limit is itself a change requiring EM/APS revalidation (E6).
- OQ‑3. Why were only 4 EM locations added for 8 new bays when 22 locations serve 8 existing bays? What is the documented sampling-point rationale (F9/F15)?
- OQ‑4. What is the day-9 harvest throughput limit given 2 BSCs, 4 tube welders and 2 controlled-rate freezers? What is the validated hold time between formulation and the start of FP‑03, and does a 16-lot schedule ever breach it?
- OQ‑5. Why were APS and engineering runs performed on different, non-overlapping instruments (bays 9/12/15 vs 10/13/16), leaving bays 11 and 14 with neither? What is the qualification rationale for releasing an instrument to commercial use with neither an engineering run nor an APS (F18)?
- OQ‑6. What is the plan and timeline for a full-occupancy APS/EM/smoke-study campaign at 16 concurrent lots with maximum operator load?
- OQ‑7. Does the scheduling/MES system have an enforceable, auditable control that caps concurrent lots at the registered maximum? (Prerequisite for Option 2.)
- OQ‑8. Does RA‑2B‑2026‑02 specifically address chain-of-identity mix-up as a hazard at 16 concurrent lots, with quantified detectability, or does it treat segregation as adequate by virtue of the closed-system/barcode design?
- OQ‑9. QC and release throughput: can the sterility, mycoplasma, VCN and potency workflows absorb doubled lot flow within the release timelines relied on for patient scheduling?
- OQ‑10. Any Suite 2B EM excursions, deviations, invalidated lots or out-of-trend CQA results in the last 24 months (A8)?
- OQ‑11. Are there parallel or planned changes (e.g. AX‑200 software upgrade, Suite 2C expansion, second site) that should be bundled or sequenced with CC‑2026‑0512 rather than filed serially?
- OQ‑12. Ex-US: EU/UK/JP/CA reporting categories for the same change, and whether the US strategy creates a divergent registered capacity across regions. (Out of scope for this memo; flag to International RA now, not after US filing.)
10.2 Proposed questions for FDA (CBER OTP) — written advice request or CMC meeting
- Does the Agency agree that installation of eight additional, identical AX‑200 closed-system trains in the already-licensed and 16-bay-qualified Suite 2B, with no change to process parameters, materials, specifications or the locked TESS‑R7 recipe, is a moderate change reportable in a CBE‑30 under 21 CFR 601.12(c)?
- Does the Agency consider the associated increase in maximum concurrent lots in process from 8 to 16 to be a separately assessable change and, if so, is it a major change requiring a PAS under 601.12(b)?
- Would the Agency accept a staged approach in which a CBE‑30 registers a concurrency maximum equal to the demonstrated state (10 lots, per APS‑2026‑03), with the increase to 16 filed after a full-occupancy aseptic process simulation and EM qualification campaign?
- For the 16-lot claim, is an APS campaign at maximum occupancy with the maximum operator complement required, or would the Agency accept the risk assessment (RA‑2B‑2026‑02) plus per-instrument APS supplemented by enhanced EM at the new occupancy?
- Does the Agency agree that patient-lot comparability for the new instruments is appropriately demonstrated prospectively through a defined CPV plan with pre-specified CQA acceptance criteria against the n = 212 historical baseline, given that healthy-donor engineering runs cannot demonstrate patient-lot comparability and that autologous lots cannot be manufactured in duplicate?
- Does the Agency have comments on the adequacy of the EM sampling-point expansion for bays 9–16?
- Would the Agency review a comparability protocol under 601.12(e) covering future additions of identical AX‑200 process trains and defined concurrency increases, to support a reduced reporting category for subsequent expansions? What content would the Agency expect?
- Should a PAS be filed, does the Agency anticipate a pre-approval inspection of Suite 2B, and are there sequencing preferences relative to the completion of the full-occupancy APS campaign?
Basis for the interaction: the 2021 guidance itself recommends early consultation with FDA for manufacturing changes not described in the Appendix table, or when considering an adjustment to the recommended reporting categories, and the CGT change/comparability guidance remains a draft (F24), so a documented FDA position is the only way to de-risk the category call.
11. Next steps
| # | Action | Owner | Target |
|---|---|---|---|
| 1 | Pull and archive the verbatim 2021 guidance Appendix row(s) and any CGT carve-out; close A1–A3 | RA CMC | 22 Sep 2026 |
| 2 | Close OQ‑1 (required concurrency) — determines Option 1 vs Option 2 | Commercial / Supply Chain | 22 Sep 2026 |
| 3 | Close OQ‑2 to OQ‑5, OQ‑8, OQ‑10; upgrade RA‑2B‑2026‑02 if mix-up and traffic hazards are not quantified | MSAT / Site QA / Microbiology | 13 Oct 2026 |
| 4 | Decide Option 1 / Option 2 at Change Review Board; record the category decision and its rationale in CC‑2026‑0512 | CRB | 20 Oct 2026 |
| 5 | Draft and submit the FDA advice request / meeting request with the §10.2 questions | RA CMC | 27 Oct 2026 |
| 6 | Protocol and execute qualification APS on the five remaining new instruments; plan the full-occupancy campaign | Microbiology / MSAT | Per §10.1 OQ‑6 |
| 7 | Draft the 601.12(e) comparability protocol for future expansions (Option 3) | RA CMC / MSAT | With the filing |
| 8 | Implement the concurrency lock-out control in scheduling/MES (Option 2 prerequisite) | Manufacturing IT / QA | Before implementation |
| 9 | Hold: no commercial lot to be started on bays 9–16, and concurrency not to exceed the currently licensed 8 lots, until the filing is made and the applicable waiting period or approval is obtained | Site Head of Quality | Immediate |
Bottom line: the Appendix line the change owner cites supports the instruments; it does not support the doubling of concurrent autologous lots in a single room that has never been run at that occupancy. Either file the PAS, or register only what has been demonstrated and earn the rest with a full-occupancy simulation campaign — and use this filing to put a 601.12(e) comparability protocol in place so the next expansion is a notification rather than a negotiation.
Rubric and grades
- States the reporting category is a prior approval supplement+23.8
- Finds the prior approval entry for a change in production capacity0
- Handles the change owner's citation: the duplicated process train row does not govern here0
- Flags that all sixteen instruments have never run at once, so the aseptic simulation does not cover full occupancy+13.3
- Limits what the engineering runs support+10.4
- Notes there is no approved comparability protocol, so no reduced category+9.5
- Recognises there is no location, suite or HVAC change+5.0
The data behind the answers
Many regulatory answers turn on one record, such as a guidance row or an approval letter. Arca queries over 200 regulatory data sources directly instead of relying on web search.
| Source | What Arca reads |
|---|---|
| openFDA | Drug and device adverse events, labels, recalls, 510(k) and PMA |
| Drugs@FDA | Approval letters, review documents, complete response letters |
| FDA enforcement | Warning letters and import refusals |
| DailyMed, Orange Book, Purple Book | Labels, patents and exclusivity |
| VAERS | Vaccine adverse event reports |
| EUDAMED and device regulators | EU device records, field safety notices from BfArM, PMDA and others |
| Trial registries | ClinicalTrials.gov, CTIS, WHO ICTRP |
| Literature | PubMed, Europe PMC, OpenAlex |
It reads a company's own documents in Veeva Vault and SharePoint the same way, with every claim cited to its source.
Results
- Claude Opus 5
- +14.0
- Arca 88.5 vs plain API 74.5
- GPT-6 Astra
- +7.4
- Arca 86.0 vs plain API 78.6
| Model | Arca | Plain API | Arca vs API |
|---|---|---|---|
| Claude Opus 5 | 88.5 | 74.5 | +14.0 |
| GPT-6 Astra | 86.0 | 78.6 | +7.4 |
The plain APIs use their native web search, with the task documents supplied in context, so this compares Arca against search-enabled APIs rather than models answering from memory.
Strict pass rate
A mean score gives partial credit. The strict pass rate counts an answer only when the decision and the code are right and no fail line fires. Explanation lines add to the mean but do not decide a pass.
| System | Strict pass rate |
|---|---|
| Arca + Claude Opus 5 | 82.4% |
| Arca + GPT-6 Astra | 82.4% |
| Plain GPT-6 Astra API | 70.6% |
| Plain Claude Opus 5 API | 52.9% |
The plain Claude API misses the decision or the code on almost half the tasks.
Limits and next steps
Scores measure the written deliverable, not time saved or the outcome of a real submission. Some keys rest on judgment calls. On one cell therapy change EMA accepted Type IB, and the rubric gives partial credit for Type II when the recommendation rests on a comparability gap.
We keep improving the benchmark. We are currently collecting hard cases from regulatory specialists' own work, where a careful colleague could still pick the wrong answer. A case enters the benchmark only if plain model APIs get its decision wrong.
References
- Xiong et al. (2026), "FDARxBench: Benchmarking Regulatory and Clinical Reasoning on FDA Generic Drug Assessment." arXiv:2603.19539↩
- OpenAI, "Introducing LifeSciBench." openai.com↩
- Harvey, "Introducing Harvey's Legal Agent Benchmark," 6 May 2026. harvey.ai↩
- US reporting-category tasks are checked line by line against 21 CFR 314.70, 601.12 and FDA's post-approval guidance. Device vigilance tasks are checked against the FDA adverse-event record.↩
- Two experts wrote rubrics for the same ten tasks without seeing each other's work. Scoring the same 69 answers with each rubric gives a Pearson correlation of 0.86, and the systems rank almost identically under either one (Spearman 0.96). Where they disagreed on substance, the merged rubric follows the written guidance.↩
