Compare commits
| Author | SHA1 | Date | |
|---|---|---|---|
 N0zoM1z0
|
f620dbb140 |
No files matched your search
@@ -2,7 +2,7 @@
|
||||
name: reverse-engineer-anything
|
||||
description: Reverse engineer native, managed, Electron/JavaScript, packaged, firmware, and browser targets with REA. Use shipped-artifact or requested runtime evidence to explain features, compare versions, decompile code, or guide a reconstruction. Skip REA for ordinary source-repository architecture analysis.
|
||||
metadata:
|
||||
version: "41"
|
||||
version: "40"
|
||||
---
|
||||
|
||||
# REA
|
||||
@@ -61,20 +61,11 @@ explicit path or endpoint and do not need it.
|
||||
consult the NativeAOT workflow in `references/native-and-artifacts.md` for
|
||||
optional metadata recovery and its supported host/layout boundary.
|
||||
- User-owned browser page already open: `list_browser_targets`.
|
||||
- Fiddler Everywhere traffic or a native `.saz` capture: read the
|
||||
[Fiddler workflow](references/runtime-observation.md#fiddler-everywhere-traffic-debugging).
|
||||
Inspect saved SAZ with `inspect_web_network_capture` and `format: "saz"`;
|
||||
connect Everywhere's separate MCP server for live traffic.
|
||||
- Retained HAR/SAZ/native mitmproxy/aioquic qlog capture: `inspect_web_network_capture`. Select
|
||||
- Retained HAR/native mitmproxy capture: `inspect_web_network_capture`. Select
|
||||
original record ordinals when useful; inspect producer fields and byte/number
|
||||
sidecars without fetching recorded URLs or claiming live attribution. See
|
||||
[historical captures](https://github.com/morluto/rea/blob/main/docs/web-network-captures.md) for the exact upstream
|
||||
profile and credential exclusions. Qlog support starts with aioquic 1.5.0
|
||||
JSON 0.3; stream coverage and endpoint loss declarations do not recover bodies
|
||||
or establish network loss. Prefer detail summary, then kind qlog trace/stream
|
||||
pages; select one trace, stream ID and direction for contribution/range pages.
|
||||
Facts retain all-recorded-events-before-selection scope. Other qlog layouts
|
||||
and PCAP correlation are unsupported.
|
||||
profile and credential exclusions.
|
||||
- User-owned Electron runtime already open: `list_electron_targets`.
|
||||
- Recorded packet captures: `inspect_packet_capture` with selected TShark fields,
|
||||
display filters and decode-as rules. Requires Linux, util-linux prlimit and `REA_TSHARK_COMMAND`; see
|
||||
@@ -83,12 +74,6 @@ explicit path or endpoint and do not need it.
|
||||
frames; use `match_offset` / `match_limit` for later pages, or explicit null
|
||||
limit for complete matching output. Preserve the source digest across pages.
|
||||
This does not perform live capture.
|
||||
For address/DNS/SNI/protocol summaries use `inspect_pcap_capture` with MCP
|
||||
detail summary, then retained kind pcap pages. Requires Wireshark 4.x tshark
|
||||
and capinfos, with Linux prlimit or Windows Job Objects; see
|
||||
[packet summaries](https://github.com/morluto/rea/blob/main/docs/pcap-analysis.md).
|
||||
Select an exact DNS question for address pages; page exhaustion does not prove
|
||||
network completeness. This reads recordings and does not acquire traffic.
|
||||
- Recorded logic/signal traces: `decode_signal_recording` with explicit decoder,
|
||||
channel and protocol settings. On Linux with util-linux prlimit, supply sigrok-cli 0.7.2 through
|
||||
`REA_SIGROK_COMMAND`; see [recording guide](https://github.com/morluto/rea/blob/main/docs/signal-recordings.md).
|
||||
|
||||
@@ -194,9 +194,8 @@ every executable in the bundle. It also lists missing or weak loads and earlier
|
||||
`architecture`. System paths stay undetermined because the dyld shared cache
|
||||
provides them.
|
||||
|
||||
Use `extract_artifact` when materialized files are needed. It extracts the active
|
||||
target and accepts optional `integrity_policy`; see the [MCP contracts](https://github.com/morluto/rea/blob/main/docs/mcp-contracts.md).
|
||||
It materializes all regular files into a fresh temporary directory chosen by
|
||||
Use `extract_artifact` when materialized files are needed. It takes no arguments
|
||||
and materializes all regular files into a fresh temporary directory chosen by
|
||||
REA. Symlinks and encrypted entries are inventory facts, not extractable files.
|
||||
The result reports the materialized directory; callers do not choose the
|
||||
destination. No separate permission grant is needed.
|
||||
|
||||
@@ -26,18 +26,3 @@ passive browser/Electron Evidence exist. Prefer captured-source digest identity;
|
||||
report path/digest disagreement as a mismatch and preserve ambiguity. Explicit
|
||||
path mappings are inference inputs and never broaden filesystem or CDP authority.
|
||||
A bundle observed at runtime does not prove every contained module executed.
|
||||
|
||||
## Fiddler Everywhere traffic debugging
|
||||
|
||||
For large saved captures, request `detail: "summary"`, then page retained Evidence
|
||||
with `inspect_analysis_view` and `view: {kind: "capture", detail: "preview", offset: 0, limit: 20}`.
|
||||
Select complete record pages only for needed headers, metadata or payloads; views
|
||||
read the historical parent without repeating capture decoding.
|
||||
|
||||
Inspect native `.saz` snapshots with `inspect_web_network_capture` and
|
||||
`format: "saz"`; encrypted archives are unsupported. For live
|
||||
traffic analysis, connect Everywhere's separate MCP server and use its
|
||||
advertised session tools with an explicit `sessionsSource` (`LiveTraffic` or
|
||||
`AgentCalls`). Preserve existing sessions and filters when inspecting a
|
||||
recorded run. See the [capture and MCP guide](https://github.com/morluto/rea/blob/main/docs/web-network-captures.md)
|
||||
for the workflow and Telerik's public setup and traffic-debugging skills.
|
||||
@@ -3,6 +3,3 @@
|
||||
|
||||
# Windows command fixtures retain their native line endings.
|
||||
*.cmd text eol=crlf
|
||||
|
||||
# Preserve whitespace in original upstream licensing texts.
|
||||
licenses/npm-runtime-notices.txt whitespace=-blank-at-eol
|
||||
@@ -509,7 +509,6 @@ jobs:
|
||||
tests/boundary/providers/native/artifactProvider.extractionCompleteness.test.ts
|
||||
tests/boundary/filesystem/setupUnavailableProvider.test.ts
|
||||
tests/boundary/filesystem/windowsNpxRegistration.test.ts
|
||||
tests/acceptance/setup/homeDirectoryFallback.test.ts
|
||||
tests/boundary/filesystem/webScriptManifestPaths.test.ts
|
||||
tests/boundary/process/ProcessEvidence.host.test.ts
|
||||
tests/acceptance/webModuleCli.test.ts
|
||||
|
||||
@@ -7,13 +7,6 @@ on:
|
||||
- "tests/boundary/cli/captureCleanup.test.ts"
|
||||
- "tests/boundary/mcp/packetCaptureMcp.test.ts"
|
||||
- "src/captures/**"
|
||||
- "src/pcap/**"
|
||||
- "src/domain/pcap/**"
|
||||
- "src/domain/analysisView/pcapCaptureView.ts"
|
||||
- "src/application/pcap/**"
|
||||
- "src/contracts/pcap/**"
|
||||
- "src/server/registerPcapTools.ts"
|
||||
- "tests/boundary/pcap/**"
|
||||
- "src/domain/captures/**"
|
||||
- "src/application/captures/**"
|
||||
- "src/contracts/captures/**"
|
||||
@@ -55,4 +48,3 @@ jobs:
|
||||
- run: node scripts/verify-packet-capture.mjs
|
||||
env:
|
||||
REA_TSHARK_COMMAND: /usr/bin/tshark
|
||||
REA_CAPINFOS_COMMAND: /usr/bin/capinfos
|
||||
@@ -161,7 +161,7 @@ Additional tools and host support depend on the target:
|
||||
| Recorded Linux crashes | Raw notes, every recorded thread's registers/signals and optional mapping candidates | Caller-supplied pwntools on Linux x64; optional GDB/pwndbg; [recorded crashes](docs/recorded-crashes.md) |
|
||||
| JavaScript / Electron | Modules, imports, source maps, routes, IPC and native add-on relationships | Node.js and npm; [application analysis](https://rea.tools/guides/javascript/) |
|
||||
| Websites | Page structure, scripts, network observations and requested screenshots | A Chrome-family browser; [browser analysis](https://rea.tools/guides/browser/) |
|
||||
| Saved network captures | Requests, responses, exposed payloads and source locations | HAR or Fiddler Everywhere SAZ; mitmdump on Linux for native mitmproxy; [capture guide](docs/web-network-captures.md) |
|
||||
| Saved network captures | Requests, responses, exposed payloads and source locations | HAR; mitmdump on Linux for native mitmproxy captures; [capture guide](docs/web-network-captures.md) |
|
||||
| .NET assemblies | Metadata, CIL instructions, declared native dependencies and build comparisons | None (static only); [managed-code guide](docs/managed-code-analysis.md) |
|
||||
| Android APKs | Manifest declarations, classes, decompiled methods and references | Headless JADX and a full JDK on Linux/macOS/Windows x64; [Android guide](docs/android-analysis.md) |
|
||||
| Android devices | Devices, packages, processes, logs, dumps, screen captures, and APK/file transfers | Caller-supplied adb (emulator or hardware); [ADB guide](docs/adb-device-analysis.md) |
|
||||
@@ -170,7 +170,6 @@ Additional tools and host support depend on the target:
|
||||
| Flutter apps | Dart snapshot hash, per-ABI library digests and engine build provenance | None (static APK parsing); [Flutter guide](docs/flutter-analysis.md) |
|
||||
| Firmware | Regions, extraction results and native-analysis handoffs | Binwalk / Unblob on Linux; [firmware guide](docs/firmware-analysis.md) |
|
||||
| Recorded packets | Selected fields, repeated values, filters and decode-as rules | Linux: TShark 4.x + prlimit; [capture guide](docs/packet-captures.md) |
|
||||
| Packet summaries | Endpoints, DNS, TLS SNI, protocol distribution and HTTP requests | Caller-supplied tshark and capinfos (Linux-verified); [pcap guide](docs/pcap-analysis.md) |
|
||||
| Recorded logic signals | Decoder annotations, sample ranges and diagnostics | Linux: sigrok-cli 0.7.2 + prlimit; [signal recordings](docs/signal-recordings.md) |
|
||||
| Packages and resources | File inventories, digests, plists, Apple bundle anatomy and extracted resources | [Artifact and JavaScript guide](docs/javascript-artifact-reconstruction.md), [Apple applications](docs/apple-application-analysis.md) |
|
||||
| Process behavior | Terminal output, interactions, exit and filesystem observations, and run comparisons | Linux/macOS with a native PTY; [process capture](docs/process-capture.md) |
|
||||
@@ -322,7 +321,7 @@ Report vulnerabilities through [SECURITY.md](SECURITY.md).
|
||||
|
||||
## Star history
|
||||
|
||||
🎉 **170,000 GitHub stars — thank you!**
|
||||
🎉 **110,000 GitHub stars — thank you!**
|
||||
|
||||
Thanks to everyone using REA, reporting bugs, requesting features, testing builds, and contributing fixes.
|
||||
|
||||
|
||||
+1
-2
@@ -139,7 +139,6 @@ npx rea-agents@latest setup
|
||||
| JavaScript / Electron | الوحدات، وعمليات الاستيراد، وخرائط المصدر، والمسارات، وIPC، وعلاقات إضافات الشيفرة الأصلية | Node.js وnpm؛ [تحليل التطبيقات](https://rea.tools/ar/guides/javascript/) |
|
||||
| المواقع | بنية الصفحة، والسكربتات، وملاحظات الشبكة، ولقطات الشاشة المطلوبة | متصفح من عائلة Chrome؛ [تحليل المتصفح](https://rea.tools/ar/guides/browser/) |
|
||||
| تسجيلات الشبكة المحفوظة | الطلبات، والاستجابات، ومحتويات الحمولة المتاحة، ومواضعها في المصدر | HAR؛ وmitmdump على Linux لتسجيلات mitmproxy بصيغتها الأصلية؛ [دليل تسجيلات الشبكة](docs/web-network-captures.md) |
|
||||
| التقاط الحزم | نقاط النهاية وDNS وTLS SNI وتوزيع البروتوكولات وطلبات HTTP | tshark وcapinfos يوفّرهما المُستدعي؛ [دليل pcap](docs/pcap-analysis.md) |
|
||||
| تجميعات .NET | البيانات الوصفية، وتعليمات CIL، واعتماديات الشيفرة الأصلية المعلنة، ومقارنات البناء | فحص ثابت؛ [دليل الشيفرة المُدارة](docs/managed-code-analysis.md) |
|
||||
| حزم Android APK | تصريحات ملف manifest، والأصناف، والدوال الناتجة عن فك الترجمة، والمراجع | JADX دون واجهة رسومية وJDK كامل على Linux/macOS/Windows x64؛ [دليل Android](docs/android-analysis.md) |
|
||||
| أجهزة Android | الأجهزة والحزم والعمليات والسجلات والدامبات ولقطات الشاشة ونقل APK/الملفات | adb يوفّره المُستدعي (محاكي أو جهاز)؛ [دليل ADB](docs/adb-device-analysis.md) |
|
||||
@@ -264,7 +263,7 @@ npx rea-agents@latest setup
|
||||
|
||||
## سجل النجوم
|
||||
|
||||
🎉 **170,000 نجمة على GitHub — شكرًا لكم!**
|
||||
🎉 **110,000 نجمة على GitHub — شكرًا لكم!**
|
||||
|
||||
شكرًا لكل من يستخدم REA، ويبلّغ عن الأخطاء، ويقترح ميزات، ويختبر إصدارات البناء، ويساهم بالإصلاحات.
|
||||
|
||||
|
||||
+1
-2
@@ -139,7 +139,6 @@ REA benötigt Node.js 22.x (>=22.19), 24.x (>=24.11) oder 26+ sowie npm. Zusätz
|
||||
| JavaScript / Electron | Module, Imports, Source Maps, Routen, IPC und Beziehungen zu nativen Add-ons | Node.js und npm; [Anwendungsanalyse](https://rea.tools/de/guides/javascript/) |
|
||||
| Websites | Seitenstruktur, Skripte, Netzwerkbeobachtungen und angeforderte Screenshots | Ein Browser aus der Chrome-Familie; [Browseranalyse](https://rea.tools/de/guides/browser/) |
|
||||
| Gespeicherte Netzwerkaufzeichnungen | Anfragen, Antworten, zugängliche Nutzdaten und Quellpositionen | HAR; mitmdump unter Linux für Aufzeichnungen im nativen mitmproxy-Format; [Leitfaden zu Netzwerkaufzeichnungen](docs/web-network-captures.md) |
|
||||
| Paketerfassungen | Endpunkte, DNS, TLS SNI, Protokollverteilung und HTTP-Anfragen | Vom Aufrufer bereitgestellte tshark- und capinfos-Binaries; [pcap-Leitfaden](docs/pcap-analysis.md) |
|
||||
| .NET-Assemblies | Metadaten, CIL-Anweisungen, deklarierte native Abhängigkeiten und Build-Vergleiche | Statische Untersuchung; [Leitfaden für verwalteten Code](docs/managed-code-analysis.md) |
|
||||
| Android-APKs | Manifest-Deklarationen, Klassen, dekompilierte Methoden und Verweise | JADX ohne grafische Oberfläche und ein vollständiges JDK unter Linux/macOS/Windows x64; [Android-Leitfaden](docs/android-analysis.md) |
|
||||
| Android-Geräte | Geräte, Pakete, Prozesse, Logs, Dumps, Bildschirmaufnahmen sowie APK- und Dateiübertragungen | Vom Aufrufer bereitgestelltes adb (Emulator oder Gerät); [ADB-Leitfaden](docs/adb-device-analysis.md) |
|
||||
@@ -262,7 +261,7 @@ Melde Sicherheitslücken gemäß [SECURITY.md](SECURITY.md).
|
||||
|
||||
## Sternverlauf
|
||||
|
||||
🎉 **170.000 GitHub-Sterne – vielen Dank!**
|
||||
🎉 **110.000 GitHub-Sterne – vielen Dank!**
|
||||
|
||||
Danke an alle, die REA nutzen, Fehler melden, Funktionswünsche äußern, Builds testen und Fehlerbehebungen beitragen.
|
||||
|
||||
|
||||
+1
-2
@@ -139,7 +139,6 @@ REA requiere Node.js 22.x (>=22.19), 24.x (>=24.11) o 26+, además de npm. Las h
|
||||
| JavaScript / Electron | Módulos, importaciones, mapas de código fuente, rutas, IPC y relaciones con complementos nativos | Node.js y npm; [análisis de aplicaciones](https://rea.tools/es/guides/javascript/) |
|
||||
| Sitios web | Estructura de la página, scripts, observaciones de red y capturas de pantalla solicitadas | Un navegador de la familia Chrome; [análisis del navegador](https://rea.tools/es/guides/browser/) |
|
||||
| Capturas de red guardadas | Solicitudes, respuestas, contenido accesible de las cargas útiles y ubicaciones de origen | HAR; mitmdump en Linux para capturas en formato nativo de mitmproxy; [guía de capturas](docs/web-network-captures.md) |
|
||||
| Capturas de paquetes | Endpoints, DNS, TLS SNI, distribución de protocolos y solicitudes HTTP | tshark y capinfos suministrados por el autor de la llamada; [guía pcap](docs/pcap-analysis.md) |
|
||||
| Ensamblados .NET | Metadatos, instrucciones CIL, dependencias nativas declaradas y comparaciones de compilaciones | Inspección estática; [guía de código administrado](docs/managed-code-analysis.md) |
|
||||
| APK de Android | Declaraciones del manifiesto, clases, métodos descompilados y referencias | JADX sin interfaz gráfica y un JDK completo en Linux/macOS/Windows x64; [guía de Android](docs/android-analysis.md) |
|
||||
| Dispositivos Android | Dispositivos, paquetes, procesos, registros, volcados, capturas de pantalla y transferencias de APK/archivos | adb suministrado por el autor de la llamada (emulador o dispositivo); [guía de ADB](docs/adb-device-analysis.md) |
|
||||
@@ -262,7 +261,7 @@ Informa de vulnerabilidades siguiendo [SECURITY.md](SECURITY.md).
|
||||
|
||||
## Historial de estrellas
|
||||
|
||||
🎉 **170.000 estrellas en GitHub: ¡gracias!**
|
||||
🎉 **110.000 estrellas en GitHub: ¡gracias!**
|
||||
|
||||
Gracias a quienes usan REA, informan de errores, solicitan funciones, prueban compilaciones y contribuyen con correcciones.
|
||||
|
||||
|
||||
+1
-2
@@ -139,7 +139,6 @@ REA به Node.js 22.x (>=22.19)، 24.x (>=24.11) یا 26+، بههمراه np
|
||||
| برنامههای فلاتر | هش اسنپشات دارت، هش کتابخانهها به تفکیک ABI و اصالت بیلد موتور | هیچ (تحلیل ایستا APK)؛ [راهنمای فلاتر](docs/flutter-analysis.md) |
|
||||
| Firmware | ناحیهها، نتایج استخراج و تحویل به ابزارهای تحلیل بومی | Binwalk / Unblob در لینوکس؛ [راهنمای Firmware](docs/firmware-analysis.md) |
|
||||
| بستههای ضبطشده | فیلدهای منتخب، مقادیر تکراری، فیلترها و قواعد رمزگشایی | Linux: TShark 4.x + prlimit; [راهنمای ضبط بسته](docs/packet-captures.md) |
|
||||
| ضبط بستهها | نقاط پایانی، DNS، TLS SNI، توزیع پروتکل و درخواستهای HTTP | tshark و capinfos تأمینشده توسط فراخوانکننده؛ [راهنمای pcap](docs/pcap-analysis.md) |
|
||||
| سیگنالهای منطقی ضبطشده | توضیحات رمزگشا، بازههای نمونه و اطلاعات عیبیابی | Linux: sigrok-cli 0.7.2 + prlimit; [راهنمای سیگنالها](docs/signal-recordings.md) |
|
||||
| بستهها و منابع | فهرست فایلها، digestها، فایلهای plist، ساختار bundle اپل و منابع استخراجشده | [راهنمای آرتیفکت و JavaScript](docs/javascript-artifact-reconstruction.md)، [برنامههای اپل](docs/apple-application-analysis.md) |
|
||||
| رفتار فرایند | خروجی ترمینال، تعاملات، وضعیت خروج، مشاهدات سیستم فایل و مقایسهٔ اجراها | Linux/macOS با PTY بومی؛ [ضبط فرایند](docs/process-capture.md) |
|
||||
@@ -247,7 +246,7 @@ npx rea-agents@latest setup
|
||||
|
||||
## تاریخچهٔ ستارهها
|
||||
|
||||
🎉 **۱۷۰٬۰۰۰ ستارهٔ GitHub — سپاسگزاریم!**
|
||||
🎉 **۱۱۰٬۰۰۰ ستارهٔ GitHub — سپاسگزاریم!**
|
||||
|
||||
از همهٔ کسانی که از REA استفاده میکنند، خطاها را گزارش میدهند، قابلیتهای جدید پیشنهاد میکنند، buildها را آزمایش میکنند و در بهبود پروژه مشارکت دارند سپاسگزاریم.
|
||||
|
||||
|
||||
+1
-2
@@ -143,7 +143,6 @@ REA nécessite Node.js 22.x (>=22.19), 24.x (>=24.11) ou 26+, ainsi que npm. Les
|
||||
| JavaScript / Electron | Modules, imports, source maps, routes, IPC et relations avec les modules natifs | Node.js et npm ; [analyse d'applications](https://rea.tools/fr/guides/javascript/) |
|
||||
| Sites web | Structure des pages, scripts, observations réseau et captures d'écran demandées | Un navigateur de la famille Chrome ; [analyse du navigateur](https://rea.tools/fr/guides/browser/) |
|
||||
| Captures réseau enregistrées | Requêtes, réponses, payloads exposés et emplacements dans le code source | HAR ; mitmdump sous Linux pour les captures mitmproxy natives ; [guide des captures](docs/web-network-captures.md) |
|
||||
| Captures de paquets | Points de terminaison, DNS, TLS SNI, distribution des protocoles et requêtes HTTP | tshark et capinfos fournis par l'appelant ; [guide pcap](docs/pcap-analysis.md) |
|
||||
| Assemblys .NET | Métadonnées, instructions CIL, dépendances natives déclarées et comparaisons de builds | Inspection statique ; [guide du code managé](docs/managed-code-analysis.md) |
|
||||
| APK Android | Déclarations du manifeste, classes, méthodes décompilées et références | JADX headless et un JDK complet sous Linux/macOS/Windows x64 ; [guide Android](docs/android-analysis.md) |
|
||||
| Appareils Android | Appareils, paquets, processus, journaux, dumps, captures d'écran et transferts d'APK/fichiers | adb fourni par l'appelant (émulateur ou appareil) ; [guide ADB](docs/adb-device-analysis.md) |
|
||||
@@ -266,7 +265,7 @@ Signalez les vulnérabilités via [SECURITY.md](SECURITY.md).
|
||||
|
||||
## Historique des étoiles
|
||||
|
||||
🎉 **170 000 étoiles GitHub — merci !**
|
||||
🎉 **110 000 étoiles GitHub — merci !**
|
||||
|
||||
Merci à toutes les personnes qui utilisent REA, signalent des bugs, proposent des fonctionnalités, testent les builds et contribuent des correctifs.
|
||||
|
||||
|
||||
+1
-2
@@ -146,7 +146,6 @@ Alat tambahan dan dukungan sistem host bergantung pada target yang dianalisis:
|
||||
| JavaScript / Electron | Modul, impor, source map, rute, IPC, dan hubungan add-on native | Node.js dan npm; [analisis aplikasi](https://rea.tools/id/guides/javascript/) |
|
||||
| Situs web | Struktur halaman, skrip, pengamatan jaringan, dan tangkapan layar yang diminta | Peramban berbasis Chrome; [analisis peramban](https://rea.tools/id/guides/browser/) |
|
||||
| Rekaman jaringan tersimpan | Permintaan, respons, payload yang terekspos, dan lokasi sumber | HAR; mitmdump di Linux untuk rekaman native mitmproxy; [panduan rekaman](docs/web-network-captures.md) |
|
||||
| Capturan paket | Endpoint, DNS, TLS SNI, distribusi protokol, dan permintaan HTTP | tshark dan capinfos buatan pemanggil; [panduan pcap](docs/pcap-analysis.md) |
|
||||
| Assembly .NET | Metadata, instruksi CIL, dependensi native yang dideklarasikan, dan perbandingan build | Tidak ada (hanya analisis statis); [panduan kode terkelola](docs/managed-code-analysis.md) |
|
||||
| APK Android | Deklarasi manifest, kelas, metode hasil dekompilasi, dan referensi | JADX mode headless dan JDK lengkap di Linux/macOS/Windows x64; [panduan Android](docs/android-analysis.md) |
|
||||
| Perangkat Android | Perangkat, paket, proses, log, dump, tangkapan layar, serta transfer APK/berkas | adb buatan pemanggil (emulator atau perangkat); [panduan ADB](docs/adb-device-analysis.md) |
|
||||
@@ -287,7 +286,7 @@ Laporkan kerentanan melalui [SECURITY.md](SECURITY.md).
|
||||
|
||||
## Riwayat Bintang
|
||||
|
||||
🎉 **170.000 bintang GitHub, terima kasih!**
|
||||
🎉 **110.000 bintang GitHub, terima kasih!**
|
||||
|
||||
Terima kasih kepada semua orang yang menggunakan REA, melaporkan bug, meminta fitur, menguji build, dan berkontribusi dalam perbaikan.
|
||||
|
||||
|
||||
+1
-2
@@ -143,7 +143,6 @@ REA richiede Node.js 22.x (>=22.19), 24.x (>=24.11) o 26+, oltre a npm. Strument
|
||||
| JavaScript / Electron | Moduli, import, source map, route, IPC e relazioni con add-on nativi | Node.js e npm; [analisi delle applicazioni](https://rea.tools/it/guides/javascript/) |
|
||||
| Siti web | Struttura della pagina, script, osservazioni di rete e screenshot richiesti | Un browser della famiglia Chrome; [analisi browser](https://rea.tools/it/guides/browser/) |
|
||||
| Acquisizioni di rete salvate | Richieste, risposte, payload esposti e posizioni sorgente | HAR; mitmdump su Linux per acquisizioni mitmproxy native; [guida alle acquisizioni](docs/web-network-captures.md) |
|
||||
| Captured di pacchetti | Endpoint, DNS, TLS SNI, distribuzione dei protocolli e richieste HTTP | tshark e capinfos forniti dal chiamante; [guida pcap](docs/pcap-analysis.md) |
|
||||
| Assembly .NET | Metadati, istruzioni CIL, dipendenze native dichiarate e confronti di build | Nessuno (solo statico); [guida managed-code](docs/managed-code-analysis.md) |
|
||||
| APK Android | Dichiarazioni manifest, classi, metodi decompilati e riferimenti | JADX headless e un JDK completo su Linux/macOS/Windows x64; [guida Android](docs/android-analysis.md) |
|
||||
| Dispositivi Android | Dispositivi, pacchetti, processi, log, dump, screenshot e trasferimenti APK/file | adb fornito dal chiamante (emulatore o hardware); [guida ADB](docs/adb-device-analysis.md) |
|
||||
@@ -266,7 +265,7 @@ Segnala vulnerabilità tramite [SECURITY.md](SECURITY.md).
|
||||
|
||||
## Cronologia delle stelle
|
||||
|
||||
🎉 **170.000 stelle su GitHub — grazie!**
|
||||
🎉 **110.000 stelle su GitHub — grazie!**
|
||||
|
||||
Grazie a tutti coloro che usano REA, segnalano bug, propongono funzionalità, testano le build e contribuiscono con correzioni.
|
||||
|
||||
|
||||
+1
-2
@@ -139,7 +139,6 @@ REA には Node.js 22.x（>=22.19）、24.x（>=24.11）、または 26+ と npm
|
||||
| JavaScript / Electron | モジュール、インポート、ソースマップ、ルート、IPC、ネイティブアドオンの関係 | Node.js と npm；[アプリケーション分析](https://rea.tools/ja/guides/javascript/) |
|
||||
| ウェブサイト | ページ構造、スクリプト、ネットワークの観測結果、依頼されたスクリーンショット | Chrome 系ブラウザー；[ブラウザー分析](https://rea.tools/ja/guides/browser/) |
|
||||
| 保存済みのネットワークキャプチャ | リクエスト、レスポンス、取得可能なペイロード、ソース内の位置 | HAR；mitmproxy ネイティブ形式のキャプチャには Linux 上の mitmdump；[キャプチャガイド](docs/web-network-captures.md) |
|
||||
| パケットキャプチャ | エンドポイント、DNS、TLS SNI、プロトコル分布、HTTPリクエスト | 呼び出し側が用意した tshark と capinfos；[pcapガイド](docs/pcap-analysis.md) |
|
||||
| .NET アセンブリ | メタデータ、CIL 命令、宣言されたネイティブ依存関係、ビルドの比較 | 静的な検査；[マネージドコードのガイド](docs/managed-code-analysis.md) |
|
||||
| Android APK | マニフェストの宣言、クラス、逆コンパイルされたメソッド、参照 | Linux/macOS/Windows x64 上のヘッドレス JADX と完全な JDK；[Android ガイド](docs/android-analysis.md) |
|
||||
| Android デバイス | デバイス、パッケージ、プロセス、ログ、ダンプ、スクリーンキャプチャ、APK/ファイル転送 | 呼び出し側が用意した adb（エミュレーターまたは実機）；[ADB ガイド](docs/adb-device-analysis.md) |
|
||||
@@ -264,7 +263,7 @@ npx rea-agents@latest setup
|
||||
|
||||
## スター履歴
|
||||
|
||||
🎉 **GitHub スター 170,000 件、ありがとうございます！**
|
||||
🎉 **GitHub スター 110,000 件、ありがとうございます！**
|
||||
|
||||
REA の利用、バグ報告、機能の要望、ビルドのテスト、修正への貢献に感謝します。
|
||||
|
||||
|
||||
+1
-2
@@ -139,7 +139,6 @@ REA에는 Node.js 22.x(>=22.19), 24.x(>=24.11) 또는 26+와 npm이 필요합니
|
||||
| JavaScript / Electron | 모듈, 임포트, 소스 맵, 라우트, IPC, 네이티브 애드온 관계 | Node.js와 npm; [애플리케이션 분석](https://rea.tools/ko/guides/javascript/) |
|
||||
| 웹사이트 | 페이지 구조, 스크립트, 네트워크 관찰 결과, 요청한 스크린샷 | Chrome 계열 브라우저; [브라우저 분석](https://rea.tools/ko/guides/browser/) |
|
||||
| 저장된 네트워크 캡처 | 요청, 응답, 접근 가능한 페이로드, 소스 위치 | HAR; mitmproxy 네이티브 캡처에는 Linux의 mitmdump; [캡처 가이드](docs/web-network-captures.md) |
|
||||
| 패킷 캡처 | 엔드포인트, DNS, TLS SNI, 프로토콜 분포, HTTP 요청 | 호출자 제공 tshark 및 capinfos; [pcap 가이드](docs/pcap-analysis.md) |
|
||||
| .NET 어셈블리 | 메타데이터, CIL 명령, 선언된 네이티브 의존성, 빌드 비교 | 정적 검사; [관리 코드 가이드](docs/managed-code-analysis.md) |
|
||||
| Android APK | 매니페스트 선언, 클래스, 디컴파일된 메서드, 참조 | Linux/macOS/Windows x64의 헤드리스 JADX와 전체 JDK; [Android 가이드](docs/android-analysis.md) |
|
||||
| Android 기기 | 기기, 패키지, 프로세스, 로그, 덤프, 화면 캡처, APK/파일 전송 | 호출자 제공 adb(에뮬레이터 또는 실제 기기); [ADB 가이드](docs/adb-device-analysis.md) |
|
||||
@@ -264,7 +263,7 @@ npx rea-agents@latest setup
|
||||
|
||||
## 스타 기록
|
||||
|
||||
🎉 **GitHub 스타 170,000개, 감사합니다!**
|
||||
🎉 **GitHub 스타 110,000개, 감사합니다!**
|
||||
|
||||
REA를 사용하고, 버그를 보고하고, 기능을 요청하고, 빌드를 테스트하고, 수정에 기여해 주신 모든 분께 감사드립니다.
|
||||
|
||||
|
||||
+1
-2
@@ -139,7 +139,6 @@ REA wymaga Node.js 22.x (>=22.19), 24.x (>=24.11) lub 26+ oraz npm. Dodatkowe na
|
||||
| JavaScript / Electron | Moduły, importy, mapy źródeł, trasy, IPC i powiązania z natywnymi dodatkami | Node.js i npm; [analiza aplikacji](https://rea.tools/pl/guides/javascript/) |
|
||||
| Strony internetowe | Struktura strony, skrypty, obserwacje sieciowe i zamówione zrzuty ekranu | Przeglądarka z rodziny Chrome; [analiza w przeglądarce](https://rea.tools/pl/guides/browser/) |
|
||||
| Zapisane przechwycenia ruchu sieciowego | Żądania, odpowiedzi, dostępne dane przesyłane i lokalizacje źródłowe | HAR; mitmdump w systemie Linux dla natywnych przechwyceń mitmproxy; [przewodnik przechwytywania](docs/web-network-captures.md) |
|
||||
| Przechwytywanie pakietów | Punkty końcowe, DNS, TLS SNI, dystrybucja protokołów i żądania HTTP | Dostarczone przez wywołującego tshark i capinfos; [przewodnik pcap](docs/pcap-analysis.md) |
|
||||
| Zestawy .NET | Metadane, instrukcje CIL, zadeklarowane zależności natywne i porównania kompilacji | Analiza statyczna; [przewodnik kodu zarządzanego](docs/managed-code-analysis.md) |
|
||||
| Pakiety APK dla Androida | Deklaracje manifestu, klasy, zdekompilowane metody i odwołania | JADX bez interfejsu graficznego i pełny JDK w systemach Linux/macOS/Windows x64; [przewodnik Androida](docs/android-analysis.md) |
|
||||
| Urządzenia z Androidem | Urządzenia, pakiety, procesy, logi, zrzuty, zrzuty ekranu oraz transfery APK/plików | adb dostarczony przez wywołującego (emulator lub urządzenie); [przewodnik ADB](docs/adb-device-analysis.md) |
|
||||
@@ -262,7 +261,7 @@ Zgłaszaj podatności zgodnie z [SECURITY.md](SECURITY.md).
|
||||
|
||||
## Historia gwiazdek
|
||||
|
||||
🎉 **170 000 gwiazdek na GitHubie — dziękujemy!**
|
||||
🎉 **110 000 gwiazdek na GitHubie — dziękujemy!**
|
||||
|
||||
Dziękujemy wszystkim, którzy używają REA, zgłaszają błędy, proponują nowe funkcje, testują kompilacje i przesyłają poprawki.
|
||||
|
||||
|
||||
+1
-2
@@ -139,7 +139,6 @@ O REA requer Node.js 22.x (>=22.19), 24.x (>=24.11) ou 26+, além do npm. As fer
|
||||
| JavaScript / Electron | Módulos, importações, source maps, rotas, IPC e relações com complementos nativos | Node.js e npm; [análise de aplicativos](https://rea.tools/pt-BR/guides/javascript/) |
|
||||
| Sites | Estrutura da página, scripts, observações de rede e capturas de tela solicitadas | Um navegador da família Chrome; [análise do navegador](https://rea.tools/pt-BR/guides/browser/) |
|
||||
| Capturas de rede salvas | Requisições, respostas, payloads acessíveis e localizações de origem | HAR; mitmdump no Linux para capturas no formato nativo do mitmproxy; [guia de capturas](docs/web-network-captures.md) |
|
||||
| Capturas de pacotes | Endpoints, DNS, TLS SNI, distribuição de protocolos e requisições HTTP | tshark e capinfos fornecidos pelo chamador; [guia pcap](docs/pcap-analysis.md) |
|
||||
| Assemblies .NET | Metadados, instruções CIL, dependências nativas declaradas e comparações de builds | Inspeção estática; [guia de código gerenciado](docs/managed-code-analysis.md) |
|
||||
| APKs Android | Declarações do manifesto, classes, métodos descompilados e referências | JADX sem interface gráfica e um JDK completo no Linux/macOS/Windows x64; [guia de Android](docs/android-analysis.md) |
|
||||
| Dispositivos Android | Dispositivos, pacotes, processos, logs, despejos, capturas de tela e transferências de APK/arquivos | adb fornecido pelo chamador (emulador ou aparelho); [guia de ADB](docs/adb-device-analysis.md) |
|
||||
@@ -262,7 +261,7 @@ Relate vulnerabilidades conforme [SECURITY.md](SECURITY.md).
|
||||
|
||||
## Histórico de estrelas
|
||||
|
||||
🎉 **170.000 estrelas no GitHub — muito obrigado!**
|
||||
🎉 **110.000 estrelas no GitHub — muito obrigado!**
|
||||
|
||||
Obrigado a todos que usam o REA, relatam bugs, sugerem funcionalidades, testam builds e contribuem com correções.
|
||||
|
||||
|
||||
+1
-2
@@ -147,7 +147,6 @@ REA требует Node.js 22.x (>=22.19), 24.x (>=24.11) или 26+, а так
|
||||
| Приложения Flutter | Хеш снапшота Dart, дайджесты библиотек по ABI и происхождение сборки движка | Не требуется (статический разбор APK); [руководство по Flutter](docs/flutter-analysis.md) |
|
||||
| Прошивки | Области, результаты извлечения и передача в нативный анализ | Binwalk / Unblob в Linux; [руководство по прошивкам](docs/firmware-analysis.md) |
|
||||
| Записанные пакеты | Выбранные поля, повторяющиеся значения, фильтры и правила декодирования | Linux: TShark 4.x + prlimit; [руководство по захватам](docs/packet-captures.md) |
|
||||
| Захват пакетов | Конечные точки, DNS, TLS SNI, распределение протоколов и HTTP-запросы | Предоставленные вызывающей стороной tshark и capinfos; [руководство по pcap](docs/pcap-analysis.md) |
|
||||
| Записанные логические сигналы | Аннотации декодера, диапазоны отсчётов и диагностика | Linux: sigrok-cli 0.7.2 + prlimit; [руководство по сигналам](docs/signal-recordings.md) |
|
||||
| Пакеты и ресурсы | Списки файлов, хеши, plist, структура пакетов Apple и извлечённые ресурсы | [Руководство по артефактам и JavaScript](docs/javascript-artifact-reconstruction.md), [приложения Apple](docs/apple-application-analysis.md) |
|
||||
| Поведение процессов | Вывод терминала, взаимодействия, наблюдения за завершением и файловой системой, сравнения запусков | Linux/macOS с нативным PTY; [захват процессов](docs/process-capture.md) |
|
||||
@@ -262,7 +261,7 @@ npx rea-agents@latest setup
|
||||
|
||||
## История звёзд
|
||||
|
||||
🎉 **170 000 звёзд на GitHub — спасибо!**
|
||||
🎉 **110 000 звёзд на GitHub — спасибо!**
|
||||
|
||||
Спасибо всем, кто использует REA, сообщает об ошибках, предлагает новые функции, тестирует сборки и помогает с исправлениями.
|
||||
|
||||
|
||||
+1
-2
@@ -139,7 +139,6 @@ REA ต้องใช้ Node.js 22.x (>=22.19), 24.x (>=24.11) หรือ 26
|
||||
| JavaScript / Electron | โมดูล การนำเข้า ซอร์สแมป เส้นทาง IPC และความสัมพันธ์กับส่วนเสริมเนทีฟ | Node.js และ npm; [การวิเคราะห์แอปพลิเคชัน](https://rea.tools/th/guides/javascript/) |
|
||||
| เว็บไซต์ | โครงสร้างหน้า สคริปต์ ข้อมูลเครือข่ายที่สังเกตได้ และภาพหน้าจอที่ร้องขอ | เบราว์เซอร์ในตระกูล Chrome; [การวิเคราะห์ผ่านเบราว์เซอร์](https://rea.tools/th/guides/browser/) |
|
||||
| ข้อมูลเครือข่ายที่บันทึกไว้ | คำขอ คำตอบ เพย์โหลดที่ปรากฏ และตำแหน่งต้นทาง | HAR; mitmdump บน Linux สำหรับข้อมูลที่บันทึกในรูปแบบเนทีฟของ mitmproxy; [คู่มือการบันทึกข้อมูล](docs/web-network-captures.md) |
|
||||
| การจับแพ็กเก็ต | จุดเชื่อมต่อ, DNS, TLS SNI, การกระจายโปรโตคอล และคำขอ HTTP | tshark และ capinfos ที่ผู้เรียกจัดเตรียม; [คู่มือ pcap](docs/pcap-analysis.md) |
|
||||
| แอสเซมบลี .NET | เมทาดาทา คำสั่ง CIL การพึ่งพาเนทีฟที่ประกาศไว้ และการเปรียบเทียบผลการบิลด์ | การตรวจสอบแบบสถิต; [คู่มือโค้ดแบบจัดการ](docs/managed-code-analysis.md) |
|
||||
| APK ของ Android | การประกาศใน manifest คลาส เมธอดที่ดีคอมไพล์ และการอ้างอิง | JADX แบบไม่มี GUI และ JDK แบบเต็มบน Linux/macOS/Windows x64; [คู่มือ Android](docs/android-analysis.md) |
|
||||
| อุปกรณ์ Android | อุปกรณ์ แพ็กเกจ โพรเซส บันทึก ดัมพ์ ภาพหน้าจอ และการถ่ายโอน APK/ไฟล์ | adb ที่ผู้เรียกจัดเตรียม (โปรแกรมจำลองหรืออุปกรณ์จริง); [คู่มือ ADB](docs/adb-device-analysis.md) |
|
||||
@@ -262,7 +261,7 @@ npx rea-agents@latest setup
|
||||
|
||||
## ประวัติดาว
|
||||
|
||||
🎉 **170,000 ดาวบน GitHub — ขอบคุณทุกคน!**
|
||||
🎉 **110,000 ดาวบน GitHub — ขอบคุณทุกคน!**
|
||||
|
||||
ขอบคุณทุกคนที่ใช้ REA รายงานบั๊ก เสนอฟีเจอร์ ทดสอบบิลด์ และช่วยแก้ไข
|
||||
|
||||
|
||||
+1
-2
@@ -139,7 +139,6 @@ REA; Node.js 22.x (>=22.19), 24.x (>=24.11) veya 26+ ve npm gerektirir. Ek araç
|
||||
| JavaScript / Electron | Modüller, içe aktarmalar, kaynak haritaları, rotalar, IPC ve yerel eklenti ilişkileri | Node.js ve npm; [uygulama analizi](https://rea.tools/tr/guides/javascript/) |
|
||||
| Web siteleri | Sayfa yapısı, betikler, ağ gözlemleri ve istenen ekran görüntüleri | Chrome ailesinden bir tarayıcı; [tarayıcı analizi](https://rea.tools/tr/guides/browser/) |
|
||||
| Kaydedilmiş ağ yakalamaları | İstekler, yanıtlar, erişilebilir yük içerikleri ve kaynak konumları | HAR; mitmproxy'nin kendi biçimindeki yakalamalar için Linux üzerinde mitmdump; [ağ yakalama rehberi](docs/web-network-captures.md) |
|
||||
| Paket yakalamaları | Uç noktalar, DNS, TLS SNI, protokol dağılımı ve HTTP istekleri | Çağıranın sağladığı tshark ve capinfos; [pcap rehberi](docs/pcap-analysis.md) |
|
||||
| .NET derlemeleri | Meta veriler, CIL talimatları, bildirilmiş yerel bağımlılıklar ve derleme karşılaştırmaları | Statik inceleme; [yönetilen kod rehberi](docs/managed-code-analysis.md) |
|
||||
| Android APK'leri | Manifest bildirimleri, sınıflar, tersine derlenmiş metotlar ve referanslar | Linux/macOS/Windows x64 üzerinde arayüzsüz JADX ve tam bir JDK; [Android rehberi](docs/android-analysis.md) |
|
||||
| Android cihazları | Cihazlar, paketler, süreçler, günlükler, dökümler, ekran görüntüleri ve APK/dosya aktarımları | Çağıranın sağladığı adb (emülatör veya cihaz); [ADB rehberi](docs/adb-device-analysis.md) |
|
||||
@@ -262,7 +261,7 @@ Güvenlik açıklarını [SECURITY.md](SECURITY.md) üzerinden bildirin.
|
||||
|
||||
## Yıldız geçmişi
|
||||
|
||||
🎉 **GitHub'da 170.000 yıldız — teşekkürler!**
|
||||
🎉 **GitHub'da 110.000 yıldız — teşekkürler!**
|
||||
|
||||
REA'yı kullanan, hata bildiren, özellik talep eden, derlemeleri test eden ve düzeltmelere katkıda bulunan herkese teşekkürler.
|
||||
|
||||
|
||||
+1
-2
@@ -139,7 +139,6 @@ REA потребує Node.js 22.x (>=22.19), 24.x (>=24.11) або 26+, а та
|
||||
| JavaScript / Electron | Модулі, імпорти, карти вихідного коду, маршрути, IPC і зв'язки з нативними доповненнями | Node.js і npm; [аналіз застосунків](https://rea.tools/uk/guides/javascript/) |
|
||||
| Сайти | Структура сторінки, скрипти, мережеві спостереження й запитані знімки екрана | Браузер сімейства Chrome; [аналіз браузера](https://rea.tools/uk/guides/browser/) |
|
||||
| Збережені мережеві захоплення | Запити, відповіді, доступні корисні дані та місця в джерелі | HAR; mitmdump у Linux для захоплень у власному форматі mitmproxy; [посібник мережевих захоплень](docs/web-network-captures.md) |
|
||||
| Захоплення пакетів | Кінцеві точки, DNS, TLS SNI, розподіл протоколів та HTTP-запити | Надані викликаючою стороною tshark та capinfos; [підручник pcap](docs/pcap-analysis.md) |
|
||||
| Збірки .NET | Метадані, інструкції CIL, оголошені нативні залежності й порівняння збірок | Статична перевірка; [посібник керованого коду](docs/managed-code-analysis.md) |
|
||||
| Android APK | Оголошення маніфесту, класи, декомпільовані методи й посилання | JADX без графічного інтерфейсу й повний JDK у Linux/macOS/Windows x64; [посібник Android](docs/android-analysis.md) |
|
||||
| Пристрої Android | Пристрої, пакети, процеси, журнали, дампи, знімки екрана та передавання APK/файлів | adb, наданий викликаючою стороною (емулятор або пристрій); [підручник ADB](docs/adb-device-analysis.md) |
|
||||
@@ -262,7 +261,7 @@ npx rea-agents@latest setup
|
||||
|
||||
## Історія зірок
|
||||
|
||||
🎉 **170 000 зірок на GitHub — дякуємо!**
|
||||
🎉 **110 000 зірок на GitHub — дякуємо!**
|
||||
|
||||
Дякуємо всім, хто використовує REA, повідомляє про помилки, пропонує нові функції, тестує збірки й допомагає з виправленнями.
|
||||
|
||||
|
||||
+1
-2
@@ -139,7 +139,6 @@ REA yêu cầu Node.js 22.x (>=22.19), 24.x (>=24.11) hoặc 26+, cùng với np
|
||||
| JavaScript / Electron | Mô-đun, các khai báo import, source map, tuyến, IPC và quan hệ với tiện ích mở rộng mã máy | Node.js và npm; [phân tích ứng dụng](https://rea.tools/vi/guides/javascript/) |
|
||||
| Trang web | Cấu trúc trang, script, quan sát mạng và ảnh chụp màn hình được yêu cầu | Trình duyệt thuộc họ Chrome; [phân tích trình duyệt](https://rea.tools/vi/guides/browser/) |
|
||||
| Bản ghi lưu lượng mạng đã lưu | Yêu cầu, phản hồi, payload có thể truy cập và vị trí nguồn | HAR; mitmdump trên Linux cho bản ghi định dạng gốc của mitmproxy; [hướng dẫn bản ghi mạng](docs/web-network-captures.md) |
|
||||
| Bắt gói tin | Điểm cuối, DNS, TLS SNI, phân bố giao thức và yêu cầu HTTP | tshark và capinfos do nơi gọi cung cấp; [hướng dẫn pcap](docs/pcap-analysis.md) |
|
||||
| Assembly .NET | Siêu dữ liệu, lệnh CIL, các phụ thuộc mã máy được khai báo và so sánh bản dựng | Kiểm tra tĩnh; [hướng dẫn mã được quản lý](docs/managed-code-analysis.md) |
|
||||
| APK Android | Khai báo manifest, lớp, phương thức được dịch ngược và tham chiếu | JADX không giao diện đồ họa và JDK đầy đủ trên Linux/macOS/Windows x64; [hướng dẫn Android](docs/android-analysis.md) |
|
||||
| Thiết bị Android | Thiết bị, gói, tiến trình, nhật ký, dump, ảnh chụp màn hình và truyền APK/tệp | adb do nơi gọi cung cấp (trình giả lập hoặc thiết bị); [hướng dẫn ADB](docs/adb-device-analysis.md) |
|
||||
@@ -262,7 +261,7 @@ Báo cáo lỗ hổng theo [SECURITY.md](SECURITY.md).
|
||||
|
||||
## Lịch sử sao
|
||||
|
||||
🎉 **170.000 sao trên GitHub — xin cảm ơn!**
|
||||
🎉 **110.000 sao trên GitHub — xin cảm ơn!**
|
||||
|
||||
Cảm ơn mọi người đã sử dụng REA, báo lỗi, đề xuất tính năng, kiểm thử bản dựng và đóng góp bản sửa lỗi.
|
||||
|
||||
|
||||
+1
-2
@@ -139,7 +139,6 @@ REA 需要 Node.js 22.x（>=22.19）、24.x（>=24.11）或 26+，以及 npm。
|
||||
| JavaScript / Electron | 模組、匯入、source map、路由、IPC 和原生附加元件關係 | Node.js 和 npm；[應用分析](https://rea.tools/zh-TW/guides/javascript/) |
|
||||
| 網站 | 頁面結構、腳本、網路觀察結果和按請求獲取的螢幕擷取畫面 | Chrome 系瀏覽器；[瀏覽器分析](https://rea.tools/zh-TW/guides/browser/) |
|
||||
| 已保存的網路擷取 | 請求、回應、可訪問的酬載和來源位置 | HAR；原生 mitmproxy 擷取需要 Linux 上的 mitmdump；[擷取指南](docs/web-network-captures.md) |
|
||||
| 封包擷取 | 端點、DNS、TLS SNI、通訊協定分佈和 HTTP 請求 | 呼叫端提供的 tshark 和 capinfos；[pcap 指南](docs/pcap-analysis.md) |
|
||||
| .NET 程式集 | 中繼資料、CIL 指令、聲明的原生依賴和建置對比 | 靜態檢查；[托管程式碼指南](docs/managed-code-analysis.md) |
|
||||
| Android APK | 清單聲明、類別、反編譯的方法和引用 | Linux/macOS/Windows x64 上的無界面 JADX 和完整 JDK；[Android 指南](docs/android-analysis.md) |
|
||||
| Android 裝置 | 裝置、套件、程序、日誌、傾印、螢幕擷取以及 APK/檔案傳輸 | 呼叫端提供的 adb（模擬器或實體裝置）；[ADB 指南](docs/adb-device-analysis.md) |
|
||||
@@ -264,7 +263,7 @@ npx rea-agents@latest setup
|
||||
|
||||
## Star 歷史
|
||||
|
||||
🎉 **GitHub Star 達到 170,000 個，感謝大家！**
|
||||
🎉 **GitHub Star 達到 110,000 個，感謝大家！**
|
||||
|
||||
感謝每一位使用 REA、報告錯誤、提出功能需求、測試建置和貢獻修復的朋友。
|
||||
|
||||
|
||||
+1
-2
@@ -139,7 +139,6 @@ REA 需要 Node.js 22.x（>=22.19）、24.x（>=24.11）或 26+，以及 npm。
|
||||
| JavaScript / Electron | 模块、导入、source map、路由、IPC 和原生扩展关系 | Node.js 和 npm；[应用分析](https://rea.tools/zh-CN/guides/javascript/) |
|
||||
| 网站 | 页面结构、脚本、网络观察结果和按请求获取的截图 | Chrome 系浏览器；[浏览器分析](https://rea.tools/zh-CN/guides/browser/) |
|
||||
| 已保存的网络捕获 | 请求、响应、可访问的载荷和来源位置 | HAR；原生 mitmproxy 捕获需要 Linux 上的 mitmdump；[捕获指南](docs/web-network-captures.md) |
|
||||
| 数据包捕获 | 端点、DNS、TLS SNI、协议分布和 HTTP 请求 | 调用方提供的 tshark 和 capinfos；[pcap 指南](docs/pcap-analysis.md) |
|
||||
| .NET 程序集 | 元数据、CIL 指令、声明的原生依赖和构建对比 | 静态检查；[托管代码指南](docs/managed-code-analysis.md) |
|
||||
| Android APK | 清单声明、类、反编译的方法和引用 | Linux/macOS/Windows x64 上的无界面 JADX 和完整 JDK；[Android 指南](docs/android-analysis.md) |
|
||||
| Android 设备 | 设备、软件包、进程、日志、转储、屏幕截图以及 APK/文件传输 | 调用方提供的 adb（模拟器或实体设备）；[ADB 指南](docs/adb-device-analysis.md) |
|
||||
@@ -264,7 +263,7 @@ npx rea-agents@latest setup
|
||||
|
||||
## Star 历史
|
||||
|
||||
🎉 **GitHub Star 达到 170,000 个，感谢大家！**
|
||||
🎉 **GitHub Star 达到 110,000 个，感谢大家！**
|
||||
|
||||
感谢每一位使用 REA、报告错误、提出功能需求、测试构建和贡献修复的朋友。
|
||||
|
||||
|
||||
+3
-6
@@ -24,12 +24,9 @@ provider-dependent behavior to be reproduced safely.
|
||||
|
||||
## Security boundary
|
||||
|
||||
REA authenticates its Hopper and Ghidra bridges with per-session random
|
||||
capability tokens. POSIX uses current-user Unix sockets; Windows Ghidra uses
|
||||
authenticated loopback TCP with a private NTFS runtime whose DACL admits only
|
||||
the current user and SYSTEM. See [Windows Ghidra P0](docs/windows-ghidra-p0.md#private-runtime-transport-and-lifecycle).
|
||||
Tokens are transferred through private session descriptors rather than process
|
||||
arguments or environment variables.
|
||||
REA authenticates each local provider bridge session with a random capability
|
||||
token and a current-user Unix socket. Tokens are transferred through private
|
||||
session descriptors rather than process arguments or environment variables.
|
||||
This is not a sandbox and does not protect against malicious processes already
|
||||
running as the same operating-system user. Opening an untrusted binary
|
||||
delegates parsing and analysis to the selected local provider with that user's
|
||||
|
||||
@@ -28,13 +28,6 @@ entries preserve the declared license and author metadata and include a clearly
|
||||
labeled standard license text. These are documented upstream notice gaps, not
|
||||
recovered copyright notices or a claim that attribution has been fully verified.
|
||||
|
||||
The optional `frida@17.23.2` npm archive and tagged Node binding source also
|
||||
omit a standalone license/copyright document. Its declared
|
||||
`LGPL-2.0 WITH WxWindows-exception-3.1` license is recorded with unchanged
|
||||
[Frida licensing text](licenses/frida-17.23.2-COPYING.txt) and the
|
||||
[GNU Library GPL v2](licenses/LGPL-2.0.txt). These are licensing supplements,
|
||||
not recovered Node binding or prebuild-component copyright notices.
|
||||
|
||||
## Open-source engine credits and licenses
|
||||
|
||||
We thank the maintainers and contributors of the projects below. Their
|
||||
|
||||
@@ -37,10 +37,6 @@ export default defineConfig({
|
||||
link: "/javascript-application-workflows",
|
||||
},
|
||||
{ text: "Browser observation", link: "/browser-observation" },
|
||||
{
|
||||
text: "Web network captures",
|
||||
link: "/web-network-captures",
|
||||
},
|
||||
{ text: "Electron observation", link: "/electron-observation" },
|
||||
{ text: "Process capture", link: "/process-capture" },
|
||||
{ text: ".NET assemblies", link: "/managed-code-analysis" },
|
||||
|
||||
@@ -136,8 +136,8 @@ existing analysis families directly, for example
|
||||
## Resource and lifecycle limits
|
||||
|
||||
- Caller values reach adb only as positional arguments in fixed vectors;
|
||||
no tool accepts an arbitrary shell command line, `input`, or `monkey`.
|
||||
The app/activity lifecycle tools use `am start -W` and `am force-stop`.
|
||||
no tool accepts an arbitrary shell command line, and UI interaction
|
||||
(`input`, `am`, `monkey`) is deliberately not exposed.
|
||||
- Per-invocation budgets: client/devices 10-20 s, shell reads 20-60 s with
|
||||
64 KiB-8 MiB capture caps (logcat 4 MiB, screen 32 MiB), transfers and
|
||||
bugreports 600 s. Exceeded budgets report `resource_constraint`; stopped
|
||||
|
||||
@@ -9,27 +9,6 @@ This family is present on repository main and in npm 4.1.0. Check the
|
||||
[released package boundary](installation.md#released-package-and-main) and the
|
||||
connected server's tool list before selecting it.
|
||||
|
||||
## Optional package delivery
|
||||
|
||||
The MCP `inspect_android_package` request keeps complete output when `detail` is
|
||||
omitted or `"complete"`. Select `detail: "summary"` explicitly to receive all
|
||||
package, SDK and permission declarations, engine identity and class/resource
|
||||
counts without decoded manifest text or duplicate raw provider replies. A
|
||||
retaining session keeps the complete original Evidence and returns a distinct
|
||||
linked `inspect_analysis_view` summary. This changes delivery, not JADX analysis.
|
||||
|
||||
Use the returned `normalized_result.parent_evidence_id` with
|
||||
`inspect_analysis_view`, source kind `retained-evidence`, and
|
||||
`view: {kind: "android", facet: "manifest", offset: 0, limit: 4096}` to read the
|
||||
exact decoded manifest without reopening the APK. Offsets and limits count UTF-16
|
||||
code units; follow `coverage.next_offset`. The page preserves `source_status` and
|
||||
`reported_total_bytes`: exhausting retained text does not make a partial decoded
|
||||
manifest complete. Complete source Evidence remains exportable under the existing
|
||||
session lifetime. Servers without retention reject summary before starting JADX.
|
||||
One-shot CLI output remains complete. Older servers require the existing complete
|
||||
request after schema discovery. APK authenticity and runtime behavior remain
|
||||
unverified.
|
||||
|
||||
## Supply tools
|
||||
|
||||
Use a **full JDK 17 or newer** (including its compiler module) and
|
||||
|
||||
@@ -8,10 +8,6 @@ exported script's native imports under an explicit URL/import-map context.
|
||||
|
||||
REA can attach to a user-owned Chrome-family browser through the Chrome DevTools Protocol (CDP) and produce bounded Evidence about an existing page. This is a passive reverse-engineering capability, not a general browser automation or remote-control surface.
|
||||
|
||||
For request/response bodies and traffic debugging, see
|
||||
[Fiddler Everywhere captures and MCP](web-network-captures.md#reading-fiddler-captures-saz).
|
||||
Inspect native SAZ or HAR 1.2 offline with REA, or connect Everywhere's separate MCP server.
|
||||
|
||||
## Shipped surfaces
|
||||
|
||||
- `list_browser_targets` / `rea list-browser-targets` discovers all eligible page targets at the endpoint by default, with an optional exact-origin filter.
|
||||
|
||||
@@ -6,12 +6,6 @@ for the reviewed setup transaction and [client IDs](installation.md#supported-ag
|
||||
The versioned verification notes below describe their stated runs; live service
|
||||
acceptance is verified only where explicitly recorded.
|
||||
|
||||
## Fiddler Everywhere alongside REA
|
||||
|
||||
Connect Fiddler Everywhere's MCP server separately for HTTP traffic debugging,
|
||||
preserving your REA client entry. See the
|
||||
[setup instructions and public skills](web-network-captures.md#fiddler-everywhere-mcp-and-public-skills).
|
||||
|
||||
## GitHub Copilot CLI
|
||||
|
||||
For GitHub Copilot CLI 1.0.95, `gpt-4.1` model metadata can block ordinary
|
||||
@@ -101,11 +95,6 @@ Setup and doctor follow Qwen Code's tilde and working-directory-relative home
|
||||
overrides. Qwen Code also discovers personal skills in `~/.agents/skills`,
|
||||
where setup installs the bundled workflow.
|
||||
|
||||
## Antigravity
|
||||
|
||||
Antigravity 2.0 discovers personal skills in `~/.gemini/config/skills`.
|
||||
Setup installs its selected skill copy there.
|
||||
|
||||
## Gemini CLI
|
||||
|
||||
Gemini CLI uses `$GEMINI_CLI_HOME/.gemini/settings.json` when that home override
|
||||
|
||||
@@ -298,42 +298,13 @@ subsequent wire recovery and clean shutdown. Caller timeout does not interrupt
|
||||
Hopper's synchronous native operation. Socket boundary tests deterministically
|
||||
cover active and queued expiry, late replies and timer cleanup.
|
||||
|
||||
The Linux demo lane remains a separate `verify:hopper:linux` command. Hopper
|
||||
6.4.2's ELF loader did not recognize the original 4,119-byte literal or three
|
||||
non-ASCII byte strings in the measured fixtures. The lane retains complete raw
|
||||
byte checks for those literals through source-owned symbols. Recognition of the
|
||||
original full-length literal is bound to its exact source address; its decoded
|
||||
object coverage remains explicitly unverified on Linux even when recognized.
|
||||
Absent non-ASCII recognition also reports decoded-object coverage as unverified.
|
||||
Recognized non-ASCII and control-text objects must still match their source
|
||||
bytes, encoding, filters and searches.
|
||||
A separate 548-byte ASCII literal requires native fragmentation, shortened
|
||||
provider display, complete decoded fragments and dossier provenance on Linux;
|
||||
the macOS lane retains the original full-length recognition requirement. These
|
||||
are observed fixture/build capabilities, not universal Hopper length limits.
|
||||
Its lifecycle checks attempt competing CLI launches for the active target and a
|
||||
The Linux demo lane remains a separate `verify:hopper:linux` command. Its
|
||||
lifecycle checks attempt competing CLI launches for the active target and a
|
||||
different target, requiring rejection before either can change the owning
|
||||
MCP session's documents or procedures. Lease boundary tests also preserve
|
||||
unresponsive or malformed live endpoints while allowing confirmed stale
|
||||
sockets to recover.
|
||||
|
||||
`verify:setup:linux` exercises installation on a clean supported Linux runner as
|
||||
root. Use a disposable VM: this lane installs Hopper and its Linux runtime
|
||||
dependencies through the system package manager. Set `REA_VERIFY_SERVER_COMMAND`
|
||||
to the CLI entrypoint being verified. The command builds and checks source-owned
|
||||
ELF fixtures before testing the read-only Hopper setup plan, approved
|
||||
installation, scoped doctor, real CLI/MCP analysis, rejection of a modified
|
||||
launcher, idempotent setup without requesting a reinstall, and owned child
|
||||
cleanup. Before installation and after teardown, a clean-runner process scan
|
||||
also rejects surviving Hopper demo helpers or Xvfb groups, including orphans
|
||||
whose launcher exited. This scan observes processes without signaling them.
|
||||
Hopper detection compares executable file identity through `/proc`, covering
|
||||
alternate or configured launcher paths even after an invoked symlink is removed.
|
||||
The dedicated runner must have no unrelated Hopper/Xvfb sessions. It requires
|
||||
the repository's pinned development toolchain and an
|
||||
existing host C compiler, `file`, `nm`, and `strings`. Use `verify:hopper:linux`
|
||||
instead when Hopper is already installed.
|
||||
|
||||
`verify:hopper:fat` is a separate macOS lane requiring installed Hopper and the
|
||||
existing Xcode clang/lipo toolchain. It compiles arm64/x86-64 thin executables and
|
||||
one- and two-slice FAT32 containers, verifies exact/interior address mappings
|
||||
|
||||
@@ -25,26 +25,6 @@ The equivalent MCP methods are `identify_flutter_build` (with `path`) and
|
||||
arm64-v8a, then x86_64, then x86, then armeabi-v7a, then the remaining
|
||||
ABIs alphabetically).
|
||||
|
||||
## Optional retained AOT delivery
|
||||
|
||||
MCP `inspect_dart_aot` keeps complete output when `detail` is omitted or
|
||||
`"complete"`. Explicit `detail: "summary"` returns the selected target/ABI/library
|
||||
identity, all snapshot headers, structural coverage, string-pool coverage and
|
||||
original lower-bound counts without the string lists. It retains complete source
|
||||
Evidence and returns a distinct linked `inspect_analysis_view` summary. Analysis
|
||||
and the caller's ABI choice are unchanged; one-shot CLI output stays complete.
|
||||
|
||||
Use `normalized_result.parent_evidence_id` as the retained source for
|
||||
`inspect_analysis_view`, with `view: {kind: "dart-aot", collection: "package_uris",
|
||||
offset: 0, limit: 64}`. Collections are `package_uris`, `dart_uris` and
|
||||
`class_like_tokens`. Pages preserve the original strings and order, selected ABI,
|
||||
library identity and source coverage. `returned_counts` describe producer-returned
|
||||
rows; counts ending in `_at_least` remain lower bounds. Exhausting a page sequence
|
||||
does not make a partial pool complete or turn byte-pattern tokens into typed
|
||||
classes/functions. Views do not reopen the APK. Original Evidence remains
|
||||
exportable under its existing session lifetime. Summary requires a retaining
|
||||
server; older servers keep the complete request after schema discovery.
|
||||
|
||||
## What the AOT inspection returns
|
||||
|
||||
`inspect_dart_aot` reads one ABI's `libapp.so` in full and reports:
|
||||
|
||||
+10
-10
@@ -22,16 +22,16 @@ header declarations, not proof that every instruction conforms to that ISA.
|
||||
Provider selection returns the specific unsupported constraint rather than
|
||||
guessing a compatible profile:
|
||||
|
||||
| Declaration | Outcome |
|
||||
| ----------------------------------------------- | ---------------------------------------------------------------------------------------- |
|
||||
| Little-endian ELF64 `ET_EXEC`, double-float ABI | admitted, `RISCV:LE:64:default` + `gcc` |
|
||||
| Little-endian ELF32 `ET_EXEC`, double-float ABI | admitted, `RISCV:LE:32:default` + `gcc` |
|
||||
| Big-endian | refused; Ghidra 12.1.4 ships no big-endian RISC-V language |
|
||||
| `ET_REL`, `ET_DYN`, other `e_type` | refused with the declared value |
|
||||
| `EF_RISCV_RVE` | refused; the embedded 16-register profile (x0–x15) needs its own processor specification |
|
||||
| `EF_RISCV_TSO` | refused; the total-store-order memory model is unverified here |
|
||||
| Soft, single, or quad float ABI | refused; the pinned generic compiler specification models double-float |
|
||||
| Reserved or newer `e_flags` bits | refused with the offending bits named |
|
||||
| Declaration | Outcome |
|
||||
| ----------------------------------------------- | --------------------------------------------------------------------------- |
|
||||
| Little-endian ELF64 `ET_EXEC`, double-float ABI | admitted, `RISCV:LE:64:default` + `gcc` |
|
||||
| Little-endian ELF32 `ET_EXEC`, double-float ABI | admitted, `RISCV:LE:32:default` + `gcc` |
|
||||
| Big-endian | refused; Ghidra 12.1.4 ships no big-endian RISC-V language |
|
||||
| `ET_REL`, `ET_DYN`, other `e_type` | refused with the declared value |
|
||||
| `EF_RISCV_RVE` | refused; the embedded 15-register ABI needs its own processor specification |
|
||||
| `EF_RISCV_TSO` | refused; the total-store-order memory model is unverified here |
|
||||
| Soft, single, or quad float ABI | refused; the pinned generic compiler specification models double-float |
|
||||
| Reserved or newer `e_flags` bits | refused with the offending bits named |
|
||||
|
||||
`e_type` is the only load-shape declaration this lane reads. A fixed-address
|
||||
`ET_EXEC` declaration does **not** establish static linkage: `PT_INTERP` and
|
||||
|
||||
@@ -138,8 +138,6 @@ Run `npm run verify:ida -- --target /absolute/path/to/program --procedure main`
|
||||
|
||||
Native verification requires `--second-procedure other_function --second-marker unique_second_body_text`; these options remain optional for the other profiles. The marker must occur in the second function's pseudocode and be absent from the first; the verifier also checks that returning to the first restores its text.
|
||||
|
||||
The verifier requires the resolved procedure in both inventory and procedure search, then compares address, assembly, pseudocode, instruction windows and relationship results with the CLI/MCP dossier. Supply `--expected-string known_literal` to check a known positive string inventory/search result and `--expected-xref 0xSOURCE` to check a known reference source address. Choose those oracles independently from the operation under test. Without them, string and xref correctness are listed in `unverified`; valid output shapes alone do not establish those behaviors. Callee parity does not independently establish semantic completeness. Native callee successes must report an explicit truncation marker; missing markers remain protocol failures.
|
||||
|
||||
The initial real workflows use stdio registrations for the legacy Windows GUI profile and a Windows x64 headless supervisor with IDA 9.3. The headless workflow has also passed on macOS arm64 with IDA Professional 9.1 (build 9.1.250226) against the same upstream commit `c133c3853faa111a9b00ee615c013b720d0c4acd`, using a source-built arm64 Mach-O fixture; Mach-O C symbols carry a leading underscore, so the procedure name is `_rea_fixture_add`. Streamable HTTP is tested against a loopback MCP fixture with the pinned client SDK; a real IDA HTTP-supervisor workflow remains unverified. Linux headless engine operation, other IDA releases, architectures, and modern attached GUI tools require their corresponding real workflows before support is claimed.
|
||||
|
||||
Native Windows verification uses IDA Pro 9.3 with the public two-function fixture and Windows `whoami.exe`, using upstream `c9d15d98e8a143fc74f6e14037c48f63889b6d6c` with a loopback-listener change. It covers production CLI/MCP parity, distinct-function switching, identity and connection cleanup. See the [correctness and performance measurements](https://github.com/morluto/rea/blob/main/experiments/analysis-efficiency/ida-native-windows.md). This follow-up did not run Windows IDA Free or native macOS.
|
||||
+13
-18
@@ -101,11 +101,13 @@ rea setup --yes --all-detected --install-hopper --json
|
||||
|
||||
### Skill destinations
|
||||
|
||||
The bundled skill is installed in each selected client's personal skill directory.
|
||||
See [client configuration](client-configuration.md) for client-specific roots,
|
||||
profiles, and environment overrides. A mixed selection plans each distinct
|
||||
destination. Selecting the skill without a client uses `~/.agents/skills`.
|
||||
Setup leaves existing skill copies in other locations untouched.
|
||||
The bundled skill is installed where each selected client discovers personal
|
||||
skills: Claude Code uses `~/.claude/skills` (or
|
||||
`$CLAUDE_CONFIG_DIR/skills` when configured). Gemini CLI uses `.agents/skills`
|
||||
under its selected home; Antigravity 2.0 uses `~/.gemini/config/skills`.
|
||||
Other integrations, including Qwen Code, use `~/.agents/skills`.
|
||||
A mixed selection plans each distinct destination. Selecting the skill without a client uses the shared
|
||||
directory. Setup leaves existing skill copies in other locations untouched.
|
||||
|
||||
`rea setup --skill-client claude_code --yes --json` refreshes and verifies the
|
||||
selected skill destination independently of MCP registration selection. The
|
||||
@@ -317,8 +319,8 @@ The Hopper launcher action used by REA creates a document from an executable;
|
||||
its supported command-line interface does not attach to an already-open
|
||||
document. While another live REA session owns the same target and loader
|
||||
profile, a second session reports the owning run ID instead of opening a
|
||||
duplicate document. On macOS, closing the owning REA session releases this guard;
|
||||
Hopper keeps its document open. A later REA session can therefore open another
|
||||
duplicate document. Closing the owning REA session releases this guard; Hopper
|
||||
keeps its document open. A later REA session can therefore open another
|
||||
document for the same target. REA does not currently identify, focus, or reuse
|
||||
that existing GUI document, and the supported launcher exposes no attach or
|
||||
reuse action for it.
|
||||
@@ -341,14 +343,8 @@ Hopper application per user across cooperating REA processes. A competing
|
||||
CLI or MCP session receives the owning session ID before Hopper is launched,
|
||||
for both the same target and a different target. Switch targets through that
|
||||
MCP session, or close it before starting another session. Closing the owner
|
||||
releases the reservation and stops REA's owned demo application and private
|
||||
display; the headless Linux demo does not retain documents after MCP shutdown.
|
||||
Its helper watches a private lifetime pipe, so an owner crash or SIGKILL also
|
||||
stops those children, without relying on a reusable PID or a process-name scan.
|
||||
A later session recovers the dead owner's stale lease after child cleanup;
|
||||
private runtime files can remain when REA itself was killed. This does not attach to
|
||||
or claim ownership of manually opened Hopper applications. An application left
|
||||
running by an older REA version must still be closed before starting a new session.
|
||||
releases the reservation. This does not attach to or claim ownership of
|
||||
manually opened Hopper applications.
|
||||
|
||||
Stale lease recovery is serialized. If an interrupted recovery leaves its
|
||||
reservation directory, the diagnostic identifies that exact path. Stop REA
|
||||
@@ -441,9 +437,8 @@ For cursor navigation, string decoding, symbol-name limits, and regex matching,
|
||||
see [Hopper analysis behavior](native-investigation.md#hopper-analysis-behavior).
|
||||
|
||||
Closing or switching a target closes its bound Hopper document, shuts down REA's
|
||||
bridge and removes its temporary socket directory. The macOS Hopper application
|
||||
and unrelated documents remain open; the owned Linux demo application stops.
|
||||
A `cleanup_incomplete`
|
||||
bridge and removes its temporary socket directory while preserving the Hopper
|
||||
application and unrelated documents. A `cleanup_incomplete`
|
||||
result identifies resources whose cleanup could not be verified.
|
||||
REA retains unresolved cleanup ownership and any confirmed shutdown phases.
|
||||
After addressing the reported failure, retry `close_binary` on the same
|
||||
|
||||
@@ -156,12 +156,9 @@ to the comparison Evidence in a live session.
|
||||
`compare_source_to_bundle` compares one cryptographically committed
|
||||
`HistoricalSourceGraph` with authenticated application-graph Evidence. The
|
||||
stable scoring model reports every admitted signal and weight: exact source
|
||||
digest, source-map original path, exact current path, path suffix, Unicode-
|
||||
equivalent path, basename, and language extension. Exact digest wins over
|
||||
location inference; weak basename, extension, and Unicode-equivalence evidence
|
||||
never forces a mapping. Unicode-equivalent spellings are candidate evidence
|
||||
only because distinct filesystem paths can preserve those spellings as separate
|
||||
files; multiple canonical-equivalent candidates remain unknown.
|
||||
digest, source-map original path, exact current path, path suffix, basename, and
|
||||
language extension. Exact digest wins over location inference; weak basename
|
||||
or extension evidence never forces a mapping.
|
||||
|
||||
Each historical source file is classified as `unchanged`, `modified`,
|
||||
`removed`, `split`, `merged`, `duplicated`, or `unknown`. Multiple equally
|
||||
|
||||
@@ -1,31 +1,28 @@
|
||||
# JavaScript static/runtime reconciliation
|
||||
|
||||
REA can combine an existing static JavaScript Application Graph with one or
|
||||
more browser, Electron, or Node/Electron V8 Inspector observations while
|
||||
preserving their different authorities. The `reconcile_javascript_runtime` MCP tool and
|
||||
more passive browser, Electron page, or Node/Electron V8 Inspector captures without collapsing their different
|
||||
authorities. The `reconcile_javascript_runtime` MCP tool and
|
||||
`rea reconcile-javascript-runtime` CLI command accept Evidence records and
|
||||
return derived Evidence containing a combined JavaScript Application Graph
|
||||
and explicit match, ambiguity, mismatch, and unknown classifications.
|
||||
|
||||
The operation performs no filesystem, browser, or Electron I/O. It accepts only
|
||||
semantically verified Evidence produced by `analyze_javascript_application`,
|
||||
`inspect_web_page`, `inspect_electron_page`, `observe_javascript_runtime`, or
|
||||
`capture_electron_scenario`; matching operation names alone
|
||||
`inspect_web_page`, `inspect_electron_page`, or
|
||||
`observe_javascript_runtime`; matching operation names alone
|
||||
is insufficient. Provider identity, predicate type, subject digest, target
|
||||
parameters, and normalized-result schemas are checked before reconciliation.
|
||||
|
||||
`capture_electron_scenario` supplies target-only partial observations. It does
|
||||
not establish loaded-script coverage; see [Electron observation](electron-observation.md).
|
||||
|
||||
## Workflow
|
||||
|
||||
1. Run `analyze_javascript_application` against exactly one application layer.
|
||||
Optional cache or assets directories can be analyzed independently and
|
||||
supplied as additional layers.
|
||||
2. Run `inspect_web_page`, `inspect_electron_page`, or the attach-only
|
||||
`observe_javascript_runtime`, or supply existing `capture_electron_scenario`
|
||||
Evidence with the partial scope above. Capturing script sources is optional,
|
||||
but a source capture provides the strongest byte identity.
|
||||
`observe_javascript_runtime`. Capturing script sources
|
||||
is optional, but a source capture provides the strongest byte
|
||||
identity.
|
||||
3. Pass the resulting Evidence records to `reconcile_javascript_runtime`.
|
||||
Browser URLs normally need an explicit URL-prefix mapping. Extracted
|
||||
Electron and V8 Inspector file locations are mapped automatically when runtime files remain
|
||||
@@ -107,7 +104,7 @@ nodes. REA evaluates compatible static candidates conservatively:
|
||||
|
||||
Every successful cross-layer `observed_as` edge has
|
||||
`authority: cross-layer-reconciliation` and `state: inferred`. The underlying
|
||||
artifact/AST observations and runtime observations remain unchanged and
|
||||
artifact/AST observations and passive-CDP observations remain unchanged and
|
||||
retain their own Evidence links.
|
||||
|
||||
## Loaded, resident, and not observed
|
||||
|
||||
@@ -151,7 +151,7 @@ assembly. Older member Evidence without `selection` remains readable.
|
||||
|
||||
Start by identifying the artifact with `inspect_managed_artifact`, then inspect
|
||||
its types and CIL with `inspect_managed_members`. Use [member comparison](#member-comparison)
|
||||
for another build, and [managed/native boundary rules](#managed-native-boundaries)
|
||||
for another build, and [managed/native boundary rules](#managednative-boundary-rules)
|
||||
when matching declared native calls to supplied native Evidence. Static inspection
|
||||
does not load or execute the assembly. Reconstructed structure and unresolved
|
||||
native/runtime questions retain their own authority and coverage.
|
||||
@@ -220,8 +220,6 @@ to native function addresses requires verified
|
||||
provider evidence; names or vtable similarity alone do not prove that a native
|
||||
function implements a specific managed method.
|
||||
|
||||
<div id="managed-native-boundaries"></div>
|
||||
|
||||
## Managed/native boundary rules
|
||||
|
||||
`verify_managed_native_boundaries` compares declared P/Invoke module and entry
|
||||
|
||||
@@ -21,12 +21,6 @@ directly to `compare_functions`, and `inspect_artifact` Evidence to
|
||||
`compare_artifacts`. Use `get_evidence_bundle` when the task needs broader
|
||||
retained session history or an explicit bundle for transfer.
|
||||
|
||||
Evidence and bundle imports reject unsupported fields in their envelopes,
|
||||
identities, manifests and other fixed metadata before authentication. Imports
|
||||
leave retained session state unchanged when validation fails. Keep application
|
||||
metadata in the supported JSON payloads (`parameters`, `raw_result`,
|
||||
`normalized_result`, or analysis-profile parameters), where keys are preserved.
|
||||
|
||||
Tool execution failures return `isError: true` and the complete canonical
|
||||
`{ "error": ... }` diagnostic as JSON in text `content`. Read that diagnostic
|
||||
for the error code, target details, partial observations, and remediation.
|
||||
|
||||
@@ -4,7 +4,7 @@
|
||||
in an existing capture. Network, USB or Bluetooth recordings can use the same
|
||||
field/filter interface when the installed TShark supports their encapsulation
|
||||
and dissectors. This tool does not acquire traffic, open an interface or control
|
||||
a device. HAR/SAZ/mitmproxy web-capture workflows remain separate.
|
||||
a device. HAR/mitmproxy web-capture workflows remain separate.
|
||||
|
||||
Supply an existing TShark 4.x installation **on Linux**, with util-linux
|
||||
`prlimit` available at `/usr/bin/prlimit`. Override its absolute path with
|
||||
|
||||
@@ -1,118 +0,0 @@
|
||||
# Packet capture summaries
|
||||
|
||||
REA summarizes already saved pcap/pcapng files through caller-selected Wireshark
|
||||
4.x `tshark` and `capinfos`. Use `inspect_packet_capture` for selected fields,
|
||||
filters and decode-as rules; use this family for address, DNS, SNI, protocol-stack
|
||||
and URI inventories. It does not acquire traffic or fetch recorded targets.
|
||||
|
||||
## Supply tools
|
||||
|
||||
```sh
|
||||
export REA_TSHARK_COMMAND=/absolute/path/tshark
|
||||
export REA_CAPINFOS_COMMAND=/absolute/path/capinfos
|
||||
# Linux only; default /usr/bin/prlimit
|
||||
export REA_TSHARK_PRLIMIT_COMMAND=/absolute/path/prlimit
|
||||
rea inspect-pcap-client
|
||||
rea inspect-pcap-capture /captures/session.pcapng --json
|
||||
```
|
||||
|
||||
Without explicit tool commands, this family resolves them through PATH and
|
||||
records that selection source. Client inspection reads no capture file. Capture
|
||||
inspection requires Linux with util-linux prlimit or Windows with owned Job
|
||||
Objects. macOS capture inspection returns a capability gap because the new
|
||||
native memory boundary is unverified; its version probes remain available.
|
||||
Tools and installed libraries/plugins are caller-trusted. An empty private
|
||||
personal Wireshark configuration is used; this is not an OS sandbox.
|
||||
|
||||
## Inspect only the needed facts
|
||||
|
||||
MCP `inspect_pcap_capture` accepts `path` and optional `detail: "summary"`.
|
||||
Complete delivery remains the default. Summary commits and retains the same
|
||||
complete Evidence, returning identity, capture metadata, observed counts,
|
||||
retained counts, source coverage and diagnostic lengths without large lists.
|
||||
Then use its `normalized_result.parent_evidence_id` with
|
||||
`inspect_analysis_view` source kind `retained-evidence`:
|
||||
|
||||
```json
|
||||
{"kind":"pcap","facet":"endpoints","offset":0,"limit":20}
|
||||
{"kind":"pcap","facet":"dns-queries","offset":0,"limit":20}
|
||||
{"kind":"pcap","facet":"dns-addresses","query":"example.com","offset":0,"limit":20}
|
||||
{"kind":"pcap","facet":"tls-sni","offset":0,"limit":20}
|
||||
{"kind":"pcap","facet":"diagnostics","stream":"tshark","offset":0,"limit":4096}
|
||||
```
|
||||
|
||||
Other row facets are `protocols`, `http-uris` and `unattributed-addresses`.
|
||||
Defaults are offset 0 and limit 64. DNS question pages give address counts;
|
||||
select one exact retained question to page its addresses. Diagnostic windows
|
||||
count UTF-16 code units; other windows count rows. Missing/ambiguous selectors
|
||||
fail. Unknown legacy diagnostics remain unknown, not an observed empty stream.
|
||||
Portable CLI views use the existing `inspect-analysis-view` workflow with inline
|
||||
complete Evidence. Views never reread the source or launch Wireshark and work
|
||||
after the original file is deleted. Page exhaustion covers the retained facet;
|
||||
it does not establish network completeness or recover missing traffic.
|
||||
|
||||
## Interpret provenance and coverage
|
||||
|
||||
`target.sha256` binds observations to an admitted stable capture snapshot. Both
|
||||
tools read that copy, which is hashed again after analysis. Capture metadata and
|
||||
literal field values are producer observations; address/protocol counts and DNS
|
||||
associations are derivations. Capture Evidence has historical-reference authority.
|
||||
|
||||
Addresses count once per packet, including loopback and nested IP occurrences.
|
||||
DNS addresses are associated only with one question in the same response packet;
|
||||
additional records may be included, so this does not prove final resolution.
|
||||
Ambiguous addresses remain in a separate inventory. Protocol distribution counts
|
||||
exact `frame.protocols` stack strings. TLS SNI is recorded handshake metadata,
|
||||
not process identity or proof of the destination's authenticity.
|
||||
|
||||
All examined inventories are retained within the resource budget; no fixed
|
||||
200/100/50-item truncation is applied. HTTP transport credentials are excluded
|
||||
without rewriting other URI bytes; ambiguous credential spans cause omission.
|
||||
Counts preserve distinct observed source URIs before omission or coalescing.
|
||||
`coverage: "partial"` records unresolved DNS attribution or URI item loss;
|
||||
component credential exclusion is also counted explicitly. Diagnostics retain
|
||||
both tool stderr streams. Recorded fields do not establish decrypted payloads,
|
||||
causality, process identity, absence of unrecorded traffic or current deployments.
|
||||
|
||||
## Resources and lifecycle
|
||||
|
||||
One inspection is admitted at a time per provider. Concurrent calls return a
|
||||
capacity error; close drains active work before releasing resources. Captures
|
||||
are streamed into a read-only owned snapshot with a 2 GiB disk budget. Native
|
||||
capture commands enforce Linux address-space ceilings of at most 1 GiB,
|
||||
300 CPU seconds, 64 MiB per file and no core dumps, preserving stricter inherited
|
||||
limits. Windows uses a 1 GiB committed-memory limit for each owned tool tree.
|
||||
These are not aggregate machine or filesystem quotas.
|
||||
|
||||
TShark output is bounded at 8 MiB; its known five-level selected-field shape and
|
||||
128 MiB graph-expansion estimate are checked before allocation. Retained facts
|
||||
have a separate 16 MiB estimate. Capinfos output is limited to 64 KiB. Command
|
||||
wall deadlines are 300 s for dissection, 60 s for metadata and 20 s for probes.
|
||||
Native ownership preparation has its own bounded lifecycle.
|
||||
|
||||
Malformed/oversized output returns no partial success. Unvalidated partial JSON
|
||||
is not returned as facts. Cancellation reaches probes, acquisition, commands and
|
||||
projection. Cleanup failure returns a typed error, retains completed Evidence
|
||||
when available, and retains owned resources for retry on close.
|
||||
|
||||
## Verification scope
|
||||
|
||||
Current follow-up verification uses Linux/Node 24.18.0 and Wireshark 4.0.17.
|
||||
Private real recorded corpora are checked against independent raw-frame/IP
|
||||
parsing and Python aggregation, public CLI/stdio MCP parity, SDK schemas, source
|
||||
hashes and retained views. Synthetic native tools separately test malformed
|
||||
output, cancellation, source/snapshot mutation, capacity and cleanup; they do
|
||||
not establish real Wireshark or other-platform behavior.
|
||||
|
||||
The original proposal reported Linux 4.6.6, macOS/Windows 4.6.9 verification on
|
||||
its earlier implementation. Those reports do not verify the new final memory
|
||||
boundary. Actual Windows/Bun Wireshark execution is unverified here; macOS
|
||||
capture support needs a separate enforceable-bound decision.
|
||||
|
||||
```sh
|
||||
npm run verify:pcap -- --pcap /absolute/saved-capture.pcapng
|
||||
```
|
||||
|
||||
This verifier exercises built CLI/stdio MCP, schemas, artifact identity and
|
||||
cleanup. Without `--pcap`, capture inspection is reported as unverified. Private
|
||||
captures, keys and provider runtime files are not committed.
|
||||
+1
-1
@@ -61,7 +61,7 @@ Independent raw verification streams the complete private snapshot digest and
|
||||
extent with bounded memory and supports cancellation during the read.
|
||||
|
||||
Hopper and IDA refuse raw-binary targets. Windows Ghidra P0 continues to admit
|
||||
native PE applications and DLLs only; raw-binary targets are unsupported.
|
||||
PE applications only.
|
||||
|
||||
## Limitations
|
||||
|
||||
|
||||
@@ -218,15 +218,6 @@ release baseline and can propose an already-published version again.
|
||||
After publication, open a PR from the release branch back to main. Preserve
|
||||
main's later implementation changes and regenerate ignored build outputs from
|
||||
the combined contracts with the released package version.
|
||||
Before merging, check whether GitHub permits merge commits:
|
||||
|
||||
```bash
|
||||
gh api repos/morluto/rea --jq .allow_merge_commit
|
||||
```
|
||||
|
||||
If disabled, a maintainer must arrange an approved ancestry-preserving merge
|
||||
path before synchronization can finish. Squash and rebase merges do not put the
|
||||
released tag in main's ancestry. Do not substitute them for this step.
|
||||
Review and test this synchronization PR, then use a merge commit so the release
|
||||
tag remains in main's ancestry. Keep the released tag unchanged.
|
||||
|
||||
|
||||
@@ -849,14 +849,6 @@ establish passing Android coverage; inspect its execution receipt.
|
||||
The `termux-browser-diagnostics` artifact retains the Termux command log, exit
|
||||
status, and Android logcat on success or failure. The emulator is disposable.
|
||||
|
||||
## Packet capture analysis
|
||||
|
||||
`npm run verify:pcap -- --pcap PATH` exercises caller-supplied tshark and
|
||||
capinfos against a saved capture. Linux verification uses Wireshark 4.6.6
|
||||
and captures containing DNS, TLS and HTTP traffic. Native Windows and macOS
|
||||
engine behavior remains unverified; process fixtures do not establish it.
|
||||
See [Packet capture analysis](pcap-analysis.md) for contracts and budgets.
|
||||
|
||||
## Apple native metadata and UI
|
||||
|
||||
`npm run verify:apple-dispatch` compiles the Objective-C fixture (classes,
|
||||
|
||||
@@ -25,36 +25,6 @@ and original zero-based producer ordinals; duplicate or out-of-range selections
|
||||
are input errors. Every record is validated before selection, so selecting one
|
||||
entry does not hide a malformed entry elsewhere.
|
||||
|
||||
For agent discovery over MCP, request `detail: "summary"`. REA retains the
|
||||
complete selected Evidence in the session and returns identity and counts.
|
||||
Use `normalized_result.parent_evidence_id` with `inspect_analysis_view`:
|
||||
|
||||
```json
|
||||
{
|
||||
"source": {
|
||||
"kind": "retained-evidence",
|
||||
"evidence_id": "<parent_evidence_id>"
|
||||
},
|
||||
"view": { "kind": "capture", "detail": "preview", "offset": 0, "limit": 20 }
|
||||
}
|
||||
```
|
||||
|
||||
Preview pages select recorded HTTP headline fields, event names/times when
|
||||
present, original locations and byte descriptors; they omit headers, XML and
|
||||
payload content. Choose `detail: "complete"` in that view for exact record
|
||||
pages, including all sidecars. Offsets follow the parent's selected record
|
||||
order; producer ordinals remain unchanged. `total_records` counts the original
|
||||
capture while `retained_records` and page coverage count records in the parent.
|
||||
An exhausted page does not establish absence from unselected records.
|
||||
|
||||
Views do not reopen the file or rerun its decoder. They remain historical
|
||||
Evidence if the source changes or disappears; inspect the capture again to
|
||||
observe new bytes. The inspection tool's default `detail: "complete"` preserves
|
||||
existing inline delivery. For CLI use, save complete inspection JSON and pass
|
||||
it as inline Evidence to `inspect-analysis-view`; the same summary and capture
|
||||
page contracts apply. Large complete records can still exceed MCP's response
|
||||
budget; export the retained Evidence when a single record cannot fit.
|
||||
|
||||
## Formats and upstream profiles
|
||||
|
||||
HAR uses unchanged `har-schema@2.0.0` draft-06 schemas, `ajv@8.20.0`,
|
||||
@@ -87,80 +57,11 @@ tested upstream source is tag `v12.2.3`, commit
|
||||
an explicit unsupported-profile diagnostic. Non-Linux native decoding is not
|
||||
supported by this adapter.
|
||||
|
||||
## Reading Fiddler captures (`.saz`)
|
||||
|
||||
Fiddler Everywhere saves traffic in **Session Archive Zip (`.saz`)** files.
|
||||
Inspect native SAZ directly, without installing Fiddler or converting to HAR:
|
||||
|
||||
```sh
|
||||
rea inspect-web-network-capture /absolute/session.saz saz --json
|
||||
rea inspect-web-network-capture /absolute/session.saz saz --record 0 --json
|
||||
```
|
||||
|
||||
MCP uses the same `capture_path`, `format: "saz"`, and optional
|
||||
`record_ordinals` fields as the examples above. REA pairs `raw/<id>_c.txt`
|
||||
requests, `_s.txt` responses, and `_m.xml` metadata by filename stem. Archive
|
||||
member names identify the source; zero-based ordinals follow each session's
|
||||
first member in ZIP directory order, not its numeric ID or capture time.
|
||||
|
||||
HTTP fields and ordered duplicate headers are retained, with stored body bytes
|
||||
in binary sidecars. Bodies are not dechunked or decompressed. Metadata is an
|
||||
XML node tree; optional `_w.txt` and `_g.txt` files retain opaque WebSocket and
|
||||
gRPC message bytes. Missing members remain null, distinct from empty bodies.
|
||||
See Telerik's [SAZ format reference](https://www.telerik.com/fiddler/fiddler-everywhere/documentation/knowledge-base/fiddler-archives).
|
||||
|
||||
The existing ZIP reader verifies read members; expanded archive contents are
|
||||
limited to 32 MiB in addition to the input/output budgets below. Encrypted
|
||||
archives and unrecognized raw session members are unsupported. SAZ requires an
|
||||
enforced decoder memory bound: Node's fixed heap, or the Windows Job Object
|
||||
commit limit. Bun on hosts without that Job Object limit returns capability
|
||||
unavailable before starting the SAZ decoder. Non-session
|
||||
members are inventoried without decoding their content. Original files remain
|
||||
unchanged. Linux verification includes independently checked public recorded
|
||||
Mattermost captures from [FOREST](https://github.com/dfrc-korea/FOREST/tree/405c9154658a128ea203a6c10040cec55111ed03/api-results/dataset)
|
||||
and the Fiddler author's [encoding corpus](https://github.com/ericlaw1979/Clearinet/blob/b6faf78cde1e72042980364f180ceb34b77d1434/Test/data/Encodings.saz),
|
||||
plus synthetic malformed/limit fixtures. Their exporting product versions are
|
||||
not authenticated. An interactive export from a current Fiddler Everywhere
|
||||
installation and its live MCP server remain unverified. Support here is the
|
||||
bounded documented raw HTTP/XML SAZ layout, not every product/version profile.
|
||||
|
||||
For visual inspection, use Everywhere's **Import Snapshot**, then **Inspectors**
|
||||
and **Overview**. HAR remains an alternative: select sessions, choose
|
||||
**Export > HTTPArchive**, and confirm `log.version` is `"1.2"`. Preserve the
|
||||
original SAZ when exporting. See the [import/export instructions](https://www.telerik.com/fiddler/fiddler-everywhere/documentation/collaboration/exporting-and-importing).
|
||||
|
||||
## Fiddler Everywhere MCP and public skills
|
||||
|
||||
For agent-driven traffic debugging, connect Everywhere's MCP server separately
|
||||
from REA. Run a current Everywhere release with MCP access (Trial, Pro, or
|
||||
higher), internet access, and a compatible MCP client. Use
|
||||
**Settings > MCP Server > Coding agent**, or **Manual setup** with the generated
|
||||
API key. The default endpoint is `http://localhost:8868/mcp`. See Telerik's
|
||||
[MCP setup guide](https://www.telerik.com/fiddler/fiddler-everywhere/documentation/agent-tools/fiddler-mcp-server)
|
||||
and [agent-skills prerequisites](https://www.telerik.com/fiddler/fiddler-everywhere/documentation/agent-tools/agent-skills).
|
||||
|
||||
Telerik's [public skills](https://github.com/telerik/fiddler-agent-tools) cover
|
||||
installation (`fiddler-download-setup`), connection setup, and traffic analysis:
|
||||
|
||||
```sh
|
||||
npx skills add telerik/fiddler-agent-tools --skill fiddler-mcp-setup
|
||||
npx skills add telerik/fiddler-agent-tools --skill fiddler-traffic-debugging
|
||||
```
|
||||
|
||||
After setup, reload the agent client and use the connected server's advertised
|
||||
tool names and schemas. Check status, list sessions, then inspect relevant
|
||||
session IDs. Set `sessionsSource` to `LiveTraffic` for HTTP(S) traffic or
|
||||
`AgentCalls` for enriched LLM calls; active filters affect the session list.
|
||||
For an existing run, skip the skill's pre-capture steps that replace process
|
||||
filters and clear sessions. The documented MCP session sources do not provide
|
||||
a saved-snapshot selector; use the SAZ workflow above for saved files. REA does
|
||||
not register or wrap the Fiddler MCP server.
|
||||
|
||||
## Reading the evidence
|
||||
|
||||
- `artifact` identifies the caller-selected file and stable snapshot digest.
|
||||
- `records` preserve producer order/ordinals and original JSON pointers, byte
|
||||
ranges, or SAZ member names. No live browser transaction or scenario IDs are invented.
|
||||
- `records` preserve producer order/ordinals and original JSON pointers or byte
|
||||
ranges. No live browser transaction or scenario IDs are invented.
|
||||
- `reported` retains the producer's fields. HAR container metadata is returned
|
||||
separately, with `log.entries` replaced by `null` and `records_pointer`
|
||||
identifying the record collection. This is an inspection representation,
|
||||
@@ -255,7 +156,7 @@ response fields, including HAR's `status: 0` and an empty `mimeType`, remain
|
||||
unknown, not invented statuses or MIME types.
|
||||
|
||||
The view makes no handler-identity, schema or causality claim. It performs no
|
||||
network activity. Native mitmproxy, SAZ and qlog captures return a typed unsupported error.
|
||||
network activity. Native mitmproxy captures return a typed unsupported error.
|
||||
Parents inspected with `sensitive_values`, or whose Evidence does not record
|
||||
`sensitive_value_count`, return a typed unsupported error whose reason is the
|
||||
canonical token `sensitive_values_unretained`. The view would write path
|
||||
@@ -291,15 +192,14 @@ Complete evidence has a 32 MiB input, 96 MiB decoder reply and 64-level nesting
|
||||
budget. Exceeding a budget returns no partial success.
|
||||
Oversized selected captures return an input error identifying `capture_path`
|
||||
and the byte budget; owned reply/output failures remain output or provider errors.
|
||||
HAR, SAZ and qlog run in an owned
|
||||
192 MiB Node old-generation heap with one V8 worker. Mitmproxy decoding applies
|
||||
HAR runs in an owned
|
||||
192 MiB Node old-generation heap with one V8 worker. Native decoding applies
|
||||
Linux limits of 768 MiB address space, 30 seconds CPU and 96 MiB file output;
|
||||
both commands have a 30-second wall deadline and independently supervised
|
||||
process cleanup. Owned decoder diagnostics retain at most 1 MiB across stdout
|
||||
and stderr; the collector drops overflow as it arrives, reports the limit
|
||||
failure and verifies cleanup. Heap limits alone do not establish aggregate RSS limits.
|
||||
SAZ and qlog refuse decoding when neither a Node heap limit nor a Windows Job Object bound can be enforced. Existing HAR availability is preserved.
|
||||
When REA runs on Bun, the HAR/SAZ/qlog decoder runs on Bun, which ignores these V8 heap
|
||||
When REA runs on Bun, the HAR decoder runs on Bun, which ignores these V8 heap
|
||||
flags; its limitations and resource failures then omit the heap sizes. On
|
||||
Windows, the decoder's owned Job Object instead limits its committed memory to
|
||||
704 MiB, the 192 MiB budget plus a 512 MiB reserve for Bun itself. The
|
||||
@@ -307,7 +207,7 @@ limitations state that limit, and reaching it returns `resource_constraint`
|
||||
with `process_memory_limit_bytes`, whatever exit status Bun reports.
|
||||
|
||||
Observed decoder memory exhaustion returns `resource_constraint`, with the
|
||||
selected capture, applicable limits and retained process diagnostics. HAR/SAZ/qlog's
|
||||
selected capture, applicable limits and retained process diagnostics. HAR's
|
||||
old-generation heap is fixed; inherited `NODE_OPTIONS` cannot raise it.
|
||||
Record selection happens after complete decoding and does not reduce that
|
||||
workload. Use a smaller capture exported by its producer or another decoder
|
||||
@@ -334,108 +234,3 @@ Command cleanup failures retain the original status and both diagnostic streams;
|
||||
the decoder's ownership preparation receives the same cancellation signal.
|
||||
|
||||
MCP advertises the same strict named input contract used by the application. Historical inspection delegates argument validation to that shared application boundary so accepted explicit-sensitive declarations also cover invalid argument names and other correction details. The SDK receives raw arguments through its Standard Schema interface; malformed inputs still fail before decoder or filesystem effects and return the normal structured REA error. Protocol-envelope validation remains owned by MCP.
|
||||
|
||||
## Retained aioquic qlog
|
||||
|
||||
Select `format: "qlog"` through `inspect_web_network_capture`, or:
|
||||
|
||||
```bash
|
||||
rea inspect-web-network-capture /absolute/origin.qlog qlog --json
|
||||
rea inspect-web-network-capture /absolute/origin.qlog qlog --record 95 --record 0 --json
|
||||
```
|
||||
|
||||
The initial profile is **aioquic 1.5.0, JSON qlog 0.3**: one JSON object with
|
||||
`qlog_format: "JSON"`, `qlog_version: "0.3"`, `traces` containing object events
|
||||
with `name`, finite numeric `time` and object `data`. JSON-SEQ, JSONL, columnar
|
||||
array events and other versions are unsupported. Duplicate JSON members,
|
||||
malformed UTF-8, invalid interpreted QUIC integers and excessive nesting fail
|
||||
without partial success, including in events outside the selected ordinals.
|
||||
Well-formed event subsets and missing frame metadata remain inspectable.
|
||||
Unknown extensions are retained; this is not validation of every qlog schema.
|
||||
|
||||
Choosing the format selects the interpretation profile; the file does not
|
||||
necessarily report or authenticate an aioquic version. The profile's clock
|
||||
uses Unix-epoch milliseconds, verified in aioquic 1.5.0's `QuicLoggerTrace`
|
||||
`log_event`/`encode_time`. The `qlog.clock.basis` and Evidence analysis profile
|
||||
state that assumption explicitly. Numeric lexemes survive independently of
|
||||
safe JSON-number projections; decimal spelling does not establish physical
|
||||
clock precision or monotonicity.
|
||||
|
||||
Every event has a global ordinal from trace/event source traversal and its
|
||||
original `/traces/T/events/E` pointer. This order is not a global time sort.
|
||||
Trace index and the selected artifact identify a connection observation;
|
||||
reported ODCID is preserved without claiming global uniqueness. Streams are
|
||||
scoped by trace, stream ID and sent/received direction. Control/QPACK streams
|
||||
are retained, so counting streams does not count HTTP requests.
|
||||
|
||||
`qlog` is a typed facet required exactly for this format. Its scope is
|
||||
`all-recorded-events-before-selection`: selection changes returned event
|
||||
records while facts cite the original ordinals across the entire recorded
|
||||
file. The container retains trace metadata with each events array replaced
|
||||
by null; there is no single events pointer shared by all traces.
|
||||
|
||||
| Fact | Basis and limits |
|
||||
| ----------------------------------- | ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
|
||||
| Original event and loss declaration | Observed endpoint report; `recovery:packet_lost` does not prove actual network loss. Missing packet number/type remains unknown. |
|
||||
| STREAM ranges and byte totals | Derived per trace and direction from reported offsets and lengths using exact integer arithmetic. `unique_bytes` unions intervals; `frame_length_sum` includes overlaps; `repeated_bytes` is their difference. Overlap alone does not prove retransmission or equal contents. |
|
||||
| FIN final sizes | Reported offset plus length where FIN is true; multiple conflicting sizes remain visible. A final size does not establish complete coverage or a received body. |
|
||||
| Incomplete fact records | Ordinals with omitted/redacted interpretable frame metadata; usable fields in other records survive. An empty list does not establish complete logging or capture. |
|
||||
| HTTP bodies and causality | `body_bytes: "not-reported"`; lengths and headers are metadata, with no reconstructed body, hash, timing causality or live process attribution. |
|
||||
|
||||
QUIC integer fields interpreted here accept exact nonnegative JSON integer
|
||||
values through `2^62 - 1`, including equivalent exponent notation. Offsets plus
|
||||
lengths must fit that range. Derived sums are decimal strings and are not
|
||||
rounded to JavaScript numbers. A missing offset is unknown, never defaulted to
|
||||
zero. Ranges can start above zero or contain gaps. Packet headers, HTTP events,
|
||||
raw lengths and unknown extensions remain producer evidence rather than being
|
||||
normalized into invented HAR requests.
|
||||
|
||||
The adapter excludes authorization/proxy authorization/cookie/set-cookie
|
||||
values in known HTTP frame events, reset tokens in transport parameters and
|
||||
NEW_CONNECTION_ID frames, and NEW_TOKEN frame tokens. Known URL header userinfo
|
||||
and explicit sensitive values follow the shared exclusions. Ordinary extension
|
||||
fields and token-looking query text remain retained. Explicit declarations also
|
||||
cover normalized numeric projections, derived totals and trace pointers; facts
|
||||
that cannot be safely shown are omitted with incomplete-record coordinates.
|
||||
No keylog, PCAP, live URL or recorded target is opened by the qlog decoder.
|
||||
|
||||
To repeat the real-provider lane with **local caller-supplied evidence** from
|
||||
the educational aioquic 1.5.0 experiment (one origin trace, known 32,803-byte
|
||||
stream coverage and one 1,169-byte repeated range in the loss case):
|
||||
|
||||
```bash
|
||||
npm run verify:web:qlog -- /absolute/control/origin.qlog /absolute/loss/origin.qlog /absolute/new-report.json
|
||||
```
|
||||
|
||||
This lane checks built CLI/stdio MCP parity, SDK-converted JSON Schemas,
|
||||
artifact digests, original event count, selection scope, retained parent lookup,
|
||||
credential exclusions and the known control/loss facts. The report is created
|
||||
exclusively and contains no keys or captured credential values. It is a
|
||||
fixture-specific verification, not a general loss detector. CI uses synthetic
|
||||
format inputs for malformed cases and limits; those tests do not establish
|
||||
producer provenance. PCAP parsing and correlation remain outside this stage.
|
||||
|
||||
### Focused qlog views
|
||||
|
||||
Use MCP `inspect_web_network_capture` with `format: "qlog", detail: "summary"`
|
||||
for identity, profile, scope and retained-fact counts. Then pass its
|
||||
`normalized_result.parent_evidence_id` to `inspect_analysis_view` as a
|
||||
`retained-evidence` source.
|
||||
|
||||
```json
|
||||
{"kind":"qlog","facet":"traces","offset":0,"limit":10}
|
||||
{"kind":"qlog","facet":"streams","trace_index":0,"offset":0,"limit":10}
|
||||
{"kind":"qlog","facet":"contributions","trace_index":0,"stream_id":"0","direction":"sent","offset":0,"limit":20}
|
||||
```
|
||||
|
||||
Trace pages omit nested lists and give their counts. Stream pages preserve
|
||||
exact byte totals but omit contributions, ranges and final-size lists. For
|
||||
those lists select `contributions`, `ranges` or `final-sizes` with all three
|
||||
stream selectors. `loss-declarations` and `incomplete-records` need only
|
||||
`trace_index`. Offsets count rows in that retained facet; defaults are 0 and 64. Missing or ambiguous selectors fail rather than choosing a connection.
|
||||
|
||||
These views page already interpreted facts without decoding again or opening
|
||||
the source, and work after its deletion. Facts still cover all recorded events
|
||||
before parent record selection. Their exhaustion does not prove logging or
|
||||
network completeness. Event preview/complete pages remain available through
|
||||
kind `capture`, with original numeric lexemes and producer ordinals preserved.
|
||||
@@ -7,18 +7,6 @@ JSON measurements belong outside the checkout. This document keeps the measured
|
||||
findings, verification scope and revision references; the scripts and `corpus.json`
|
||||
keep the reproduction inputs. Generated `results/` is ignored.
|
||||
|
||||
Follow-up: [latest-main capability audit](latest-main-audit.md) records the
|
||||
Flutter, SQLite, TShark and sigrok priorities and the first shipped Dart AOT
|
||||
baseline, preserving existing controls before introducing another selector.
|
||||
|
||||
Follow-up: [Dart AOT summary and retained string pools](flutter-aot-summary.md)
|
||||
records real LocalSend delivery pairs and old Evidence continuation, preserving
|
||||
ABI selection, snapshot identity, original lower bounds and partial coverage.
|
||||
|
||||
Follow-up: [SQLite existing-control measurements](sqlite-existing-controls.md)
|
||||
tests QGIS's shipped GeoPackage through the existing column selection, preserving
|
||||
full selected-table schema and typed cells before considering another API.
|
||||
|
||||
Follow-up: [native PE/DOS entry views and real model verification](native-entry-views.md)
|
||||
records the post-merge native continuation, including a small-function case where
|
||||
four selected replies cost more bytes than the complete dossier.
|
||||
@@ -44,20 +32,6 @@ records two shipped assembly checks, previous-runtime portable Evidence, and fou
|
||||
actual Codex trials. Selected replies shrink substantially; observed model input
|
||||
tokens increase and latency is mixed, so model-token savings are not claimed.
|
||||
|
||||
Follow-up: [model tool context and per-response usage](model-context.md) separates
|
||||
raw MCP replies from observed client execution/discovery and usage. Optional
|
||||
trial capture retains tool/usage items while excluding account and ambient state;
|
||||
existing ephemeral trials keep their default behavior.
|
||||
|
||||
Follow-up: [Android package delivery and retained manifest](android-package-summary.md)
|
||||
records real NewPipe SDK pairs, unchanged old requests/Evidence, exact retained
|
||||
text, and actual Codex outcomes including client errors and a failed discovery.
|
||||
Reply bytes fall; model-token/time gains are not established.
|
||||
|
||||
Follow-up: [resource counters at payload completion](resource-counters.md) adds
|
||||
optional owned counter observations while preserving unknown whole-scope final
|
||||
counters, default receipt shape and the unchanged CPU/memory safeguards.
|
||||
|
||||
The 12 detailed checkpoint receipts were archived byte-for-byte before removal
|
||||
from the final PR tree. The archive `review-receipts-00d51e0fc-20261012` is in the
|
||||
private experiment lab outside the checkout; its `archive-index.json` records
|
||||
|
||||
@@ -11,8 +11,6 @@ import subprocess
|
||||
import tempfile
|
||||
import time
|
||||
|
||||
from codex_context import capture_tool_context
|
||||
|
||||
|
||||
def file_digest(path):
|
||||
digest = hashlib.sha256()
|
||||
@@ -50,20 +48,7 @@ def main():
|
||||
parser.add_argument('--providers', type=Path)
|
||||
parser.add_argument('--enabled-tools', type=Path)
|
||||
parser.add_argument('--authority', choices=['static', 'browser'], default='static')
|
||||
parser.add_argument('--capture-tool-context', action='store_true',
|
||||
help='Retain owned tool/usage items; excludes account/ambient state')
|
||||
parser.add_argument('--guide-enabled-tools', action='store_true',
|
||||
help='Opt-in exact-name discovery guidance for selected REA tools')
|
||||
args = parser.parse_args()
|
||||
if args.guide_enabled_tools and args.enabled_tools is None:
|
||||
parser.error('--guide-enabled-tools requires --enabled-tools')
|
||||
enabled_tools = None
|
||||
if args.enabled_tools:
|
||||
enabled_tools = json.loads(args.enabled_tools.read_text())
|
||||
if not isinstance(enabled_tools, list) or not all(isinstance(name, str) and name for name in enabled_tools) or len(enabled_tools) != len(set(enabled_tools)):
|
||||
raise ValueError('enabled-tools must be a unique list of exact tool names')
|
||||
if args.guide_enabled_tools and not enabled_tools:
|
||||
parser.error('--guide-enabled-tools requires a nonempty selected tool list')
|
||||
def terminate(signum, _frame):
|
||||
# The outer resource scope terminates descendants together. Ensure the
|
||||
# runner's copied credentials are also removed on a resource abort.
|
||||
@@ -145,14 +130,11 @@ def main():
|
||||
'possible and select the requested normalized_result fields before returning '
|
||||
'intermediate output to model context. Keep real Evidence IDs and limitations.'
|
||||
)
|
||||
if args.guide_enabled_tools:
|
||||
instruction += (
|
||||
' Configured REA tool function names for this trial: '
|
||||
+ json.dumps(['mcp__rea__' + name for name in enabled_tools])
|
||||
+ '. For discovery select only these exact names from ALL_TOOLS and '
|
||||
'return only their metadata. Preserve the original analyst question, '
|
||||
'dependency order and source Evidence.'
|
||||
)
|
||||
enabled_tools = None
|
||||
if args.enabled_tools:
|
||||
enabled_tools = json.loads(args.enabled_tools.read_text())
|
||||
if not isinstance(enabled_tools, list) or not all(isinstance(name, str) and name for name in enabled_tools) or len(enabled_tools) != len(set(enabled_tools)):
|
||||
raise ValueError('enabled-tools must be a unique list of exact tool names')
|
||||
quote = json.dumps
|
||||
config = '\n'.join([
|
||||
'approval_policy = "never"', 'sandbox_mode = "read-only"',
|
||||
@@ -178,7 +160,6 @@ def main():
|
||||
'inspect_android_package', 'search_android_classes',
|
||||
'inspect_android_class', 'inspect_android_method',
|
||||
'inspect_firmware_regions', 'inspect_managed_artifact',
|
||||
'inspect_sqlite_database',
|
||||
'inspect_managed_members', 'inspect_managed_native_boundaries',
|
||||
'inspect_artifact', 'inspect_wasm_artifact',
|
||||
'inspect_evm_interface', 'get_evidence_bundle', 'export_evidence_bundle',
|
||||
@@ -202,8 +183,6 @@ def main():
|
||||
(args.output / 'prompt.txt').write_text(prompt)
|
||||
(args.output / 'trial-settings.json').write_text(json.dumps({
|
||||
'mode': args.mode, 'model': args.model, 'reasoning': args.reasoning,
|
||||
'capture_tool_context': args.capture_tool_context,
|
||||
'guide_enabled_tools': args.guide_enabled_tools,
|
||||
'driver_commit': subprocess.check_output(
|
||||
['git', 'rev-parse', 'HEAD'], cwd=driver_repository, text=True).strip(),
|
||||
'runtime_revision': args.revision,
|
||||
@@ -217,7 +196,7 @@ def main():
|
||||
'package_lock_sha256': file_digest(repository / 'package-lock.json'),
|
||||
'experiment_sources_sha256': {
|
||||
name: hashlib.sha256((experiment / name).read_bytes()).hexdigest()
|
||||
for name in ['agent-trial.py', 'codex_context.py', 'provider-environment.json']
|
||||
for name in ['agent-trial.py', 'provider-environment.json']
|
||||
},
|
||||
'developer_instructions': instruction,
|
||||
'developer_instructions_sha256': hashlib.sha256(instruction.encode()).hexdigest(),
|
||||
@@ -233,8 +212,7 @@ def main():
|
||||
'multi_agent': False, 'code_mode': args.mode == 'client-code',
|
||||
'code_mode_only': args.mode == 'client-code'},
|
||||
}, indent=2) + '\n')
|
||||
invocation = [args.codex, '--no-daemon', 'exec', '--strict-config',
|
||||
*([] if args.capture_tool_context else ['--ephemeral']),
|
||||
invocation = [args.codex, '--no-daemon', 'exec', '--strict-config', '--ephemeral',
|
||||
'--skip-git-repo-check', '--ignore-rules', '--json',
|
||||
'--color', 'never', '-C', str(workspace),
|
||||
'--output-last-message', str(args.output.resolve() / 'answer.txt'), '-']
|
||||
@@ -256,28 +234,26 @@ def main():
|
||||
usage = []
|
||||
tools = []
|
||||
event_types = {}
|
||||
with (args.output / 'events.jsonl').open() as event_file:
|
||||
for line in event_file:
|
||||
if not line.strip():
|
||||
continue
|
||||
event = json.loads(line)
|
||||
kind = event.get('type', 'unknown')
|
||||
event_types[kind] = event_types.get(kind, 0) + 1
|
||||
if 'usage' in event:
|
||||
usage.append(event['usage'])
|
||||
item = event.get('item', {})
|
||||
if item.get('type') == 'mcp_tool_call' and kind == 'item.completed':
|
||||
tools.append({
|
||||
**{k: item.get(k) for k in ['server', 'tool', 'arguments', 'status', 'error']},
|
||||
'codex_event_result_json_utf8_bytes': len(json.dumps(
|
||||
item.get('result'), separators=(',', ':'), ensure_ascii=False
|
||||
).encode()),
|
||||
})
|
||||
for line in (args.output / 'events.jsonl').open():
|
||||
if not line.strip():
|
||||
continue
|
||||
event = json.loads(line)
|
||||
kind = event.get('type', 'unknown')
|
||||
event_types[kind] = event_types.get(kind, 0) + 1
|
||||
if 'usage' in event:
|
||||
usage.append(event['usage'])
|
||||
item = event.get('item', {})
|
||||
if item.get('type') == 'mcp_tool_call' and kind == 'item.completed':
|
||||
tools.append({
|
||||
**{k: item.get(k) for k in ['server', 'tool', 'arguments', 'status', 'error']},
|
||||
'codex_event_result_json_utf8_bytes': len(json.dumps(
|
||||
item.get('result'), separators=(',', ':'), ensure_ascii=False
|
||||
).encode()),
|
||||
})
|
||||
final_target_digest = file_digest(Path(args.artifact_path)) if args.artifact_path else None
|
||||
summary = {
|
||||
'mode': args.mode, 'requested_model': args.model, 'reasoning': args.reasoning,
|
||||
'runtime_revision': args.revision,
|
||||
'capture_tool_context_requested': args.capture_tool_context,
|
||||
'selected_artifact_sha256_before': target_digest,
|
||||
'selected_artifact_sha256_after': final_target_digest,
|
||||
'selected_artifact_bytes_unchanged': target_digest == final_target_digest if target_digest else None,
|
||||
@@ -292,13 +268,9 @@ def main():
|
||||
(args.output / 'summary.json').write_text(json.dumps(summary, indent=2) + '\n')
|
||||
print(json.dumps(summary))
|
||||
finally:
|
||||
try:
|
||||
if args.capture_tool_context:
|
||||
capture_tool_context(trial_codex_home, args.output)
|
||||
finally:
|
||||
# Capture failure must never prevent copied-credential cleanup.
|
||||
shutil.rmtree(profile)
|
||||
(args.output / 'cleanup.json').write_text(json.dumps({'profile_removed': not profile.exists()}) + '\n')
|
||||
# Always remove copied credentials, config, caches and profile state.
|
||||
shutil.rmtree(profile)
|
||||
(args.output / 'cleanup.json').write_text(json.dumps({'profile_removed': not profile.exists()}) + '\n')
|
||||
raise SystemExit(124 if timeout else exit_code)
|
||||
|
||||
|
||||
|
||||
@@ -1,166 +0,0 @@
|
||||
# Android package summary and exact retained manifest
|
||||
|
||||
Continues [#2016](https://github.com/morluto/rea/issues/2016) and
|
||||
[#2438](https://github.com/morluto/rea/pull/2438). The recurring NewPipe question
|
||||
asks for APK/package/version identity, all case-sensitive MainActivity matches
|
||||
and all reported onCreate entries, including explicit null DEX descriptors.
|
||||
Complete package replies delivered decoded manifest text and duplicate upstream
|
||||
calls unrelated to those selected facts.
|
||||
|
||||
## Compatibility and ownership
|
||||
|
||||
MCP `inspect_android_package` accepts explicit `detail: "summary"`; omitted and
|
||||
`"complete"` requests preserve the complete output and provider request. The
|
||||
one-shot CLI stays complete. Summary selection happens in the application
|
||||
workflow, independently of the engine protocol, using the existing retained
|
||||
analysis-view machinery. No third-party plugin API or persistent analysis cache
|
||||
is introduced. Servers lacking retention reject summary before provider work.
|
||||
|
||||
The complete original Evidence stays under its original ID and session lifetime.
|
||||
A distinct linked derived view returns all package/SDK/permission declarations,
|
||||
engine identity, class/resource counts and signature-verification status.
|
||||
Manifest metadata retains the producer's partial/complete status, nullable
|
||||
reported byte total, and observed UTF-16 length. Text and duplicate raw calls
|
||||
remain in the original record, rather than being rewritten under its ID.
|
||||
|
||||
Use `inspect_analysis_view` with the parent's ID and
|
||||
`view: {kind: "android", facet: "manifest", offset: 0, limit: 4096}` to read exact
|
||||
retained decoded text. Follow `coverage.next_offset`; surrogate boundaries use
|
||||
the existing text-page implementation. Exhaustion describes the retained text,
|
||||
not global completeness when the producer says partial. APK signatures and
|
||||
runtime behavior remain unverified. Engine artifact SHA-256 identifies the JAR;
|
||||
views require the authenticated APK subject and never substitute the engine
|
||||
hash for a missing target identity. Older servers require schema discovery and
|
||||
the original complete request; automatic fallback is not introduced.
|
||||
|
||||
## Frozen runtime and real SDK pairs
|
||||
|
||||
Source runtime: `28c84e78cf2fbfde4aceed345b773c59eb889f68`; later test-only schema
|
||||
typing corrections do not relabel these receipts. Compiled dist/bridge file-table
|
||||
SHA-256: `5332dda13981f043e146b3601ebec1f380d9f698280ca53d75786b638a912e11`.
|
||||
The frozen old runtime is `8bc1601ca51e417ca472d90ea0367e9418a1a0f2`, digest
|
||||
`9e7380f537301bf0cfe2926f5619011af848af7c220750e75189498e65d825e1`.
|
||||
|
||||
Real NewPipe 0.29.1 bytes, acquisition and digest are pinned in `corpus.json`.
|
||||
Actual configured JADX headless MCP 0.7.1/Java runs use the same selected
|
||||
provider settings and search-path digests, one worker and 768 MiB Java heap.
|
||||
Node is 24.18.0; actual SDK client/server are 2.3.1. Processes and engines are
|
||||
fresh per trial; host page caches are not flushed. SDK schema mode is selected
|
||||
in both treatments. Heavy runs are serial, with one CPU, unchanged 3 GiB early
|
||||
stop/4 GiB hard memory, no swap, and 192 tasks.
|
||||
|
||||
All four candidate workflows use three successful public MCP calls. Only the
|
||||
first package delivery changes. Both pairs pass settings and selected-fact
|
||||
comparison, including all declarations, manifest status/length, engine identity,
|
||||
original limitations, matching class rows and onCreate entries. Original replies
|
||||
and IDs remain separate. A fresh old-runtime complete workflow also passes
|
||||
comparison against the candidate complete request; both complete package replies
|
||||
are exactly 119,527 compact client-result JSON bytes. This is scoped compatibility
|
||||
evidence, not a guarantee for every historical release/client/host.
|
||||
|
||||
| Trial | Package reply bytes | SDK workflow seconds | Payload CPU seconds | Kernel peak bytes |
|
||||
| -------------- | ------------------: | -------------------: | ------------------: | ----------------: |
|
||||
| sdk-complete-1 | 119,527 | 24.059 | 25.259 | 1,225,076,736 |
|
||||
| sdk-summary-1 | 8,659 | 23.694 | 24.894 | 1,226,870,784 |
|
||||
| sdk-summary-2 | 8,659 | 24.407 | 25.611 | 1,228,296,192 |
|
||||
| sdk-complete-2 | 119,527 | 24.509 | 25.740 | 1,229,844,480 |
|
||||
|
||||
Summary replies are 8,659 bytes, about 92.8% smaller; all three replies together
|
||||
fall from 149,577 to 38,709 bytes. This is a delivery result, not a model-token
|
||||
or engine-work saving. The SDK timing differences are small. CPU and memory do
|
||||
not establish a reduction. No provider setting or analysis scope changes.
|
||||
Transport roundtrip includes server/client work and is not an engine-only timer.
|
||||
|
||||
The complete catalog is 2,506,213 compact JSON bytes versus 2,497,635 on the old
|
||||
runtime: about 0.34% growth, including intervening main changes. Discovery cost
|
||||
remains visible alongside selected-delivery savings.
|
||||
|
||||
## Authentic old Evidence continuation
|
||||
|
||||
A real package record from old runtime 8bc160 imports into the candidate and
|
||||
supports retained summary, exact manifest pages, inline portable summary and
|
||||
export through actual public SDK tools. The new session explicitly selects an
|
||||
absent JADX JAR; this workflow performs no package analysis. Eleven successful
|
||||
calls preserve the original record, original ID, all declarations and all 25,222
|
||||
manifest UTF-16 units. Manifest UTF-8 SHA-256:
|
||||
`fee192fe2a6d7892c22cba115184c74c7e2c42ce464e8bb37be6289f2c16881d`.
|
||||
The exported original record is deeply equal to the imported record.
|
||||
|
||||
## Actual Codex task outcomes
|
||||
|
||||
Four serial trials run in complete/summary/summary/complete order on the same
|
||||
frozen candidate. Requested configuration: Codex CLI 0.161.0, `gpt-5.6-terra` high,
|
||||
three exact selected tool names and the same optional context/discovery capture
|
||||
settings. The requested alias does not certify the server-resolved model. The
|
||||
original analyst question is unchanged; equal treatment instructions explicitly
|
||||
choose package detail and explain the summary carrier. Temporary configuration
|
||||
points to the frozen modified REA MCP; no global configuration is edited.
|
||||
|
||||
| Trial | Input | Cached | Uncached | Output | Seconds | MCP calls | Usage records | Facts |
|
||||
| ---------------- | ------: | -----: | -------: | -----: | ------: | --------: | ------------: | ----- |
|
||||
| model-complete-1 | 39,267 | 23,040 | 16,227 | 1,690 | 94.053 | 3 | 3 | Pass |
|
||||
| model-summary-1 | 128,417 | 93,440 | 34,977 | 3,633 | 150.401 | 8 | 9 | Pass |
|
||||
| model-summary-2 | 54,437 | 37,120 | 17,317 | 2,185 | 123.677 | 3 | 4 | Pass |
|
||||
| model-complete-2 | 21,332 | 9,984 | 11,348 | 667 | 20.774 | 0 | 2 | Fail |
|
||||
|
||||
Three answers pass the original selected-fact gate against the actual SDK
|
||||
producer. Each trial preserves APK bytes and removes its isolated profile.
|
||||
The first summary trial makes five successful calls and three rejected requests:
|
||||
an invented `case_sensitive` argument, empty class-search input and empty
|
||||
class-inspection input. It then repeats successful package/search work. These
|
||||
errors and correction turns remain part of measured task cost; strict existing
|
||||
schemas correctly reject them. The second summary trial uses the intended three
|
||||
successful calls, but still does not establish improved total/uncached input or
|
||||
latency against the factually acceptable first complete control.
|
||||
|
||||
The final complete control's first client executor filters `ALL_TOOLS` for the
|
||||
same three exact names and receives an empty array. It makes zero MCP calls,
|
||||
reports all requested facts unknown and fails the factual gate. Identical name
|
||||
filters worked in the other trials. Stderr contains no explanatory error; the
|
||||
client visibility failure remains unexplained and is not attributed to REA or
|
||||
summary delivery. Its short duration is not comparable completed work. The
|
||||
original failed receipt is retained rather than replaced by a successful trial.
|
||||
|
||||
These measurements demonstrate no real-model token or speed gain. Smaller raw
|
||||
MCP envelopes do not establish smaller model context; observed usage also
|
||||
includes discovery, execution context, corrections and extra responses. Usage
|
||||
records count captured usage items rather than asserting exact remote request
|
||||
contents or equating MCP calls with model rounds. The complete default and
|
||||
opt-in choice remain unchanged; this is useful delivery/retention capability,
|
||||
not a general performance recommendation.
|
||||
|
||||
All model runs have verified payload-completion witnesses with only the observer
|
||||
remaining and zero memory/task limit events at that phase. Kernel peaks are
|
||||
602,472,448–1,444,945,920 bytes; the failed no-analysis control is included in that
|
||||
range and is not evidence of lower analysis memory. Whole-scope final counters
|
||||
remain unknown and the existing full resource grader stays false. No broader
|
||||
CPU, memory, OS/provider or model claim is made.
|
||||
|
||||
## Resource interpretation
|
||||
|
||||
Every SDK run and portable continuation has a verified owned
|
||||
payload-exited-observer-alive witness, with only the observer remaining and no
|
||||
memory/task limit events at that phase. Kernel peak and CPU include that opt-in
|
||||
observer. Whole-scope terminal counters remain unknown; the existing complete
|
||||
physical resource grader is not changed or called successful. No OOM stress or
|
||||
resource-limit increase is used.
|
||||
|
||||
## Verification and scope
|
||||
|
||||
Twenty-seven relevant converted-schema, SDK, domain and existing Android
|
||||
failure/cancellation/cleanup checks pass. A three-case focused rerun passes after
|
||||
a test-only schema typing correction. The 1 MiB manifest protocol fixture verifies
|
||||
original default/full output, reconstruction after source removal, unchanged
|
||||
exported Evidence and one engine launch. Other cases preserve nulls and partial
|
||||
status, Unicode boundaries and tagged malformed/missing-identity failures, and
|
||||
reject unavailable retention or cancelled requests before provider work. These
|
||||
fixtures verify production boundaries; actual JADX claims use the real NewPipe
|
||||
runs above. Full supported single-thread compiler and unchanged lint pass under
|
||||
the same memory safeguards. No other Android OS/device/provider lane is inferred.
|
||||
|
||||
Raw SDK/model replies, private profiles and resource receipts stay outside Git.
|
||||
Reproduce SDK pairs using the existing `measure.mjs` with `--artifact newpipe.apk`,
|
||||
`--schemas selected`, identical explicit provider configuration and frozen runtime,
|
||||
and alternating `--delivery complete` / `--delivery summary`. Preserve failed
|
||||
attempts and run `compare.mjs` on both pair orders. Model findings require their
|
||||
own identical analyst facts and explicit delivery controls.
|
||||
@@ -1,117 +0,0 @@
|
||||
"""Retain owned Codex tool/usage observations without account or ambient state."""
|
||||
|
||||
import hashlib
|
||||
import json
|
||||
import os
|
||||
|
||||
|
||||
def token_counts(value):
|
||||
if not isinstance(value, dict):
|
||||
raise ValueError('Expected a token-count object')
|
||||
result = {}
|
||||
for key in ['input_tokens', 'cached_input_tokens', 'cache_write_input_tokens',
|
||||
'output_tokens', 'reasoning_output_tokens', 'total_tokens']:
|
||||
if key in value:
|
||||
count = value[key]
|
||||
if not isinstance(count, int) or isinstance(count, bool) or count < 0:
|
||||
raise ValueError('Expected nonnegative integer token counts')
|
||||
result[key] = count
|
||||
return result
|
||||
|
||||
|
||||
def selected_event(event):
|
||||
"""Select observed items; these are not the exact submitted model request."""
|
||||
if not isinstance(event, dict) or not isinstance(event.get('payload'), dict):
|
||||
raise ValueError('Expected an event object with an object payload')
|
||||
if not isinstance(event.get('type'), str):
|
||||
raise ValueError('Expected an event type string')
|
||||
if event.get('timestamp') is not None and not isinstance(event['timestamp'], str):
|
||||
raise ValueError('Expected a timestamp string or omission')
|
||||
payload = event['payload']
|
||||
kind = event.get('type')
|
||||
if kind == 'response_item' and payload.get('type') in [
|
||||
'custom_tool_call', 'custom_tool_call_output',
|
||||
'function_call', 'function_call_output',
|
||||
]:
|
||||
keys = ['type', 'call_id', 'name', 'input', 'arguments', 'output']
|
||||
elif kind == 'token_usage_record':
|
||||
keys = ['response_id', 'usage', 'turn_token_usage', 'thread_token_usage']
|
||||
payload = {key: token_counts(payload[key]) if key != 'response_id'
|
||||
else payload[key] for key in keys if key in payload}
|
||||
elif kind == 'event_msg' and payload.get('type') == 'token_count':
|
||||
keys = ['type', 'info']
|
||||
info = payload.get('info')
|
||||
if info is not None:
|
||||
if not isinstance(info, dict):
|
||||
raise ValueError('Expected token-count info')
|
||||
selected_info = {key: token_counts(info[key]) for key in
|
||||
['total_token_usage', 'last_token_usage'] if key in info}
|
||||
window = info.get('model_context_window')
|
||||
if 'model_context_window' in info:
|
||||
if window is not None and (not isinstance(window, int) or isinstance(window, bool) or window <= 0):
|
||||
raise ValueError('Expected a positive model context window')
|
||||
selected_info['model_context_window'] = window
|
||||
payload = {'type': 'token_count', 'info': selected_info}
|
||||
else:
|
||||
payload = {'type': 'token_count', 'info': None}
|
||||
else:
|
||||
return None
|
||||
return {
|
||||
'timestamp': event.get('timestamp'),
|
||||
'type': kind,
|
||||
'payload': {key: payload[key] for key in keys if key in payload},
|
||||
}
|
||||
|
||||
|
||||
def capture_tool_context(codex_home, output):
|
||||
"""Capture only an explicitly selected trial's rollouts; never its auth/config."""
|
||||
sessions = codex_home / 'sessions'
|
||||
blocked = sessions.is_symlink()
|
||||
sources = [] if blocked else sorted(sessions.rglob('*.jsonl'))
|
||||
target = output / 'codex-tool-context.jsonl'
|
||||
source_receipts = []
|
||||
errors = [{'source': 'sessions', 'reason': 'not_an_owned_directory'}] if blocked else []
|
||||
retained = 0
|
||||
with os.fdopen(os.open(target, os.O_WRONLY | os.O_CREAT | os.O_EXCL, 0o600),
|
||||
'w', encoding='utf-8') as result:
|
||||
for source in sources:
|
||||
name = source.relative_to(codex_home).as_posix()
|
||||
if source.is_symlink() or not source.is_file():
|
||||
errors.append({'source': name, 'reason': 'not_an_owned_regular_file'})
|
||||
continue
|
||||
digest = hashlib.sha256()
|
||||
counts = {}
|
||||
with source.open('rb') as lines:
|
||||
for ordinal, line in enumerate(lines, 1):
|
||||
digest.update(line)
|
||||
try:
|
||||
event = json.loads(line)
|
||||
selected = selected_event(event)
|
||||
except ValueError as error:
|
||||
errors.append({'source': name, 'line': ordinal,
|
||||
'reason': type(error).__name__})
|
||||
continue
|
||||
kind = event.get('type')
|
||||
counts[str(kind)] = counts.get(str(kind), 0) + 1
|
||||
if selected is not None:
|
||||
result.write(json.dumps(selected, ensure_ascii=False) + '\n')
|
||||
retained += 1
|
||||
source_receipts.append({'source': name, 'sha256': digest.hexdigest(),
|
||||
'event_counts': counts})
|
||||
retained_digest = hashlib.sha256()
|
||||
with target.open('rb') as captured:
|
||||
for chunk in iter(lambda: captured.read(1024 * 1024), b''):
|
||||
retained_digest.update(chunk)
|
||||
receipt = {
|
||||
'status': 'partial' if errors else 'captured' if source_receipts else 'unavailable',
|
||||
'retained_file': target.name,
|
||||
'retained_sha256': retained_digest.hexdigest(),
|
||||
'retained_events': retained, 'sources': source_receipts, 'errors': errors,
|
||||
'scope': 'Owned client tool-call/reply and per-response usage items, not '
|
||||
'the exact submitted model request. Session/account metadata, '
|
||||
'world state, user/developer messages, encrypted reasoning and '
|
||||
'internal passthrough are omitted. Authentication, configuration '
|
||||
'and ambient environment are never copied by this capture.',
|
||||
}
|
||||
(output / 'context-receipt.json').write_text(json.dumps(receipt, indent=2) + '\n')
|
||||
return receipt
|
||||
@@ -235,34 +235,6 @@
|
||||
},
|
||||
"immutable_scope": "Published Hardhat artifact does not record an immutable-reference map; absence is unknown, not proof of no immutables. Runtime template bytes remain exact."
|
||||
}
|
||||
},
|
||||
{
|
||||
"id": "localsend-arm64.apk",
|
||||
"file": "LocalSend-1.18.2-android-arm64v8.apk",
|
||||
"bytes": 46558706,
|
||||
"sha256": "82ec3568fba2aa5295b9aae8b76f701d7a4703d86b9f8bad749472038fbaeab3",
|
||||
"provenance": {
|
||||
"project": "LocalSend",
|
||||
"version": "1.18.2",
|
||||
"upstreamFile": "LocalSend-1.18.2-android-arm64v8.apk",
|
||||
"url": "https://github.com/localsend/localsend/releases/download/v1.18.2/LocalSend-1.18.2-android-arm64v8.apk",
|
||||
"transport_sha256": "82ec3568fba2aa5295b9aae8b76f701d7a4703d86b9f8bad749472038fbaeab3",
|
||||
"transport_bytes": 46558706,
|
||||
"derivation": "Official arm64 release APK, compared with GitHub release asset digest; byte-only analysis without execution"
|
||||
}
|
||||
},
|
||||
{
|
||||
"id": "qgis-world-map.gpkg",
|
||||
"file": "qgis-world-map.gpkg",
|
||||
"bytes": 12914688,
|
||||
"sha256": "01d293159d1b77bd9212b5252587853f61aa9e25b2387135f34afaba8d057190",
|
||||
"provenance": {
|
||||
"project": "QGIS bundled world map",
|
||||
"source_commit": "e1223b8e9e71fc50ee995ed556f711c54ccc101b",
|
||||
"git_blob_sha1": "c9ff80228dff0de93c9acdef16a97545ba360244",
|
||||
"url": "https://raw.githubusercontent.com/qgis/QGIS/e1223b8e9e71fc50ee995ed556f711c54ccc101b/resources/data/world_map.gpkg",
|
||||
"derivation": "unmodified official resource file; streaming Git blob and SHA-256 verification"
|
||||
}
|
||||
}
|
||||
]
|
||||
}
|
||||
@@ -179,40 +179,3 @@ interface question through an explicitly selected precise view, retain full
|
||||
bytecode/original Evidence under the existing lifetime, and preserve complete
|
||||
defaults. Discover support before sending new options to an older server. Include
|
||||
discovery, follow-up, failures and retries in the complete task cost.
|
||||
|
||||
## Static contract admission verification
|
||||
|
||||
The follow-up from main `c462a4ebd3a10e59253bcf38353a0914b176738b` tests the
|
||||
pilot's actual static boundary, without adding a dynamic module registry or
|
||||
changing production code. Complete-project TypeScript checking now verifies
|
||||
that the inferred descriptor type rejects a WASM operation contract, a WASM
|
||||
CLI command, a WASM service factory, an unrelated input schema and an unrelated
|
||||
output schema. These are negative assignability assertions: their guarantee
|
||||
comes from the compiler, not from executing an incompatible descriptor.
|
||||
The existing named contract and CLI identity are also checked at runtime;
|
||||
separate factory calls produce distinct service/provider owners. Invalid target
|
||||
input remains an application error without launching a worker.
|
||||
|
||||
The actual public in-memory MCP SDK test additionally spies on the provider:
|
||||
duplicate EVM registration throws the named `already registered` error before
|
||||
any provider call. Converted input/output JSON Schemas validate before the
|
||||
first valid operation. Invalid client arguments are rejected before execution;
|
||||
incompatible provider reply data is validated **after** execution and is not
|
||||
presented as a pre-use contract guarantee. Existing healthy-peer, cancellation,
|
||||
retained summary/default and cleanup-retry scenarios remain covered.
|
||||
|
||||
Full project typecheck passes with the installed compiler's supported single
|
||||
thread scheduling; it includes all source/test files. The two exact focused
|
||||
files pass 12 runtime cases. The resource scopes sample 2,057,961,472 bytes for
|
||||
typecheck and 2,426,290,176 bytes for required build plus focused tests, below the
|
||||
unchanged 3 GiB early-stop/4 GiB hard ceiling. Final transient-cgroup counters
|
||||
remain unknown. No new real-provider or performance improvement is claimed by
|
||||
these compile/SDK checks; the earlier pinned real EVMole/WABT/lifecycle evidence
|
||||
retains its original scope and source identity.
|
||||
|
||||
This proves the one statically composed descriptor's named/schema/factory
|
||||
compatibility and duplicate-registration guard. It does not implement runtime
|
||||
admission of arbitrary JavaScript descriptors, third-party plugin ABI/version
|
||||
negotiation or a general plugin SDK. Those remain deferred by the original plan.
|
||||
Existing callers, full defaults, provider inputs, owned lifetimes and output
|
||||
identities are unchanged.
|
||||
@@ -1,160 +0,0 @@
|
||||
# Dart AOT summary and retained string pools
|
||||
|
||||
Continues [#2016](https://github.com/morluto/rea/issues/2016) and
|
||||
[#2455](https://github.com/morluto/rea/pull/2455). The selected analyst question
|
||||
asks for shipped LocalSend target/ABI/library identity, every nullable snapshot
|
||||
observation, string-pool lower bounds and returned counts, and original coverage
|
||||
and limitations. It does not require individual observed strings.
|
||||
|
||||
## Compatibility and ownership
|
||||
|
||||
MCP `inspect_dart_aot` accepts explicit `detail: "summary"`. Omitted and complete
|
||||
requests preserve the complete result and original provider inputs. The CLI
|
||||
remains complete. ABI omission and explicit ABI selection retain their original
|
||||
meaning; the provider never receives the delivery field. Missing retention,
|
||||
invalid detail and pre-cancellation fail before provider work.
|
||||
|
||||
The existing application workflow retains the complete original Evidence, then
|
||||
returns a distinct derived summary linked to its parent ID. It preserves target
|
||||
and libapp digests, every snapshot section and nullable fact, original pool and
|
||||
overall coverage, lower-bound counts and limitations. `returned_counts` reports
|
||||
the lengths of the producer-returned arrays; it does not upgrade lower bounds
|
||||
to a complete snapshot inventory. The analysis and original source retention
|
||||
are unchanged. No new engine, persistent cache or plugin SDK is introduced.
|
||||
|
||||
Read exact retained strings using `inspect_analysis_view`, the parent ID, and
|
||||
`view: {kind: "dart-aot", collection: "package_uris", offset: 0, limit: 64}`.
|
||||
Other collections are `dart_uris` and `class_like_tokens`. Follow the returned
|
||||
next offset. Pages preserve source order, ABI/library identity and partial pool
|
||||
coverage without opening the APK again. Page exhaustion describes retained
|
||||
strings, not the entire snapshot. Strings remain byte-pattern observations,
|
||||
rather than recovered typed class/function semantics. Missing historical
|
||||
subjects remain explicitly unknown; conflicting recorded target digests fail.
|
||||
|
||||
## Frozen runtime and real SDK pairs
|
||||
|
||||
The official LocalSend 1.18.2 arm64 APK acquisition, size and SHA-256 are pinned
|
||||
in `corpus.json`. No APK installation, target execution or version-dataset
|
||||
lookup occurred. Source runtime: `811034a7283c9751a3ecbff33e8b2f28bec55793`;
|
||||
compiled dist/bridge file-table SHA-256:
|
||||
`dabbb63536c5862be839ecdc0f3eaad05b29c2a3816f57041528d30f754311be`.
|
||||
The previous runtime is `28c84e78cf2fbfde4aceed345b773c59eb889f68`, digest
|
||||
`5332dda13981f043e146b3601ebec1f380d9f698280ca53d75786b638a912e11`.
|
||||
Its production sources were verified byte-equal to main f254 at acquisition.
|
||||
Subsequent test-only changes and main's SAZ addition do not relabel these pins.
|
||||
|
||||
Node is 24.18.0 and the SDK client/server are 2.3.1. Each workflow starts a fresh
|
||||
server and validates the selected live advertised schema. Artifact bytes,
|
||||
provider environment/search-path fingerprints, driver and locked dependencies
|
||||
stay equal. Host page caches are not flushed. Heavy tasks run serially under
|
||||
the unchanged CPU, memory, task and host guards.
|
||||
|
||||
| Trial | AOT reply bytes | SDK workflow seconds | Payload CPU seconds | Kernel peak bytes |
|
||||
| -------------- | --------------: | -------------------: | ------------------: | ----------------: |
|
||||
| sdk-complete-1 | 151,341 | 5.139 | 6.819 | 691,441,664 |
|
||||
| sdk-summary-1 | 12,037 | 5.219 | 6.608 | 639,430,656 |
|
||||
| sdk-summary-2 | 12,037 | 5.064 | 6.405 | 640,868,352 |
|
||||
| sdk-complete-2 | 151,341 | 5.128 | 6.468 | 633,614,336 |
|
||||
|
||||
Both pairs use one successful public tool call and pass settings/fact comparison,
|
||||
including all snapshot fields, coverage, original limitations and all counts.
|
||||
Reply bytes fall 92.05%. Whole SDK time stays approximately 5.1 seconds; these
|
||||
trials do not establish engine speed, CPU or memory savings. Payload CPU includes
|
||||
driver/catalog work beyond the SDK workflow timer. Catalog JSON grows from
|
||||
2,506,213 bytes on the previous runtime to 2,514,896 (about 0.35%).
|
||||
|
||||
A fresh old-runtime complete request passes comparison against candidate
|
||||
complete, including identical 151,341-byte replies. This is scoped compatibility
|
||||
evidence, not a guarantee for every historical release or third-party client.
|
||||
|
||||
## Real old Evidence continuation
|
||||
|
||||
Fifteen successful public MCP calls import genuine old-runtime AOT Evidence,
|
||||
project retained summary, reconstruct all 500 package URIs, 216 Dart URIs and
|
||||
2,000 class-like tokens, compare inline portable summary, and export the original
|
||||
record. The APK is absent during all these operations. Original string order,
|
||||
lower bounds, partial coverage, nullable snapshot facts, subject and parent ID
|
||||
remain intact; the original exported record is deeply equal to its source.
|
||||
|
||||
The first private verification attempt used a nonexistent receipt filename and
|
||||
failed before import or artifact relocation. That driver error is retained;
|
||||
the corrected attempt selects the fresh old-runtime record. It is not a REA
|
||||
defect or a successful migration trial.
|
||||
|
||||
## Actual Codex task outcomes
|
||||
|
||||
Four serial trials use the same frozen candidate in complete/summary/summary/
|
||||
complete order. Requested configuration is Codex CLI 0.161.0, `gpt-5.6-terra`
|
||||
high, one exact enabled tool (`inspect_dart_aot`), and identical optional owned
|
||||
context capture/discovery guidance. This requested alias does not certify the
|
||||
server-resolved model. Temporary configuration points to the modified frozen
|
||||
REA MCP; all copied credential profiles are removed and target bytes remain
|
||||
unchanged. The source question is fixed; equal treatment instructions choose
|
||||
detail and explain the summary carrier and parent reference.
|
||||
|
||||
| Trial | Input | Cached | Uncached | Output | Seconds | MCP attempts | Failed attempts | Facts |
|
||||
| ---------------- | -----: | -----: | -------: | -----: | ------: | -----------: | --------------: | ----- |
|
||||
| model-complete-1 | 74,641 | 50,176 | 24,465 | 2,765 | 116.898 | 3 | 1 | pass |
|
||||
| model-summary-1 | 38,253 | 22,016 | 16,237 | 1,449 | 88.904 | 1 | 0 | pass |
|
||||
| model-summary-2 | 38,363 | 22,016 | 16,347 | 1,515 | 55.190 | 1 | 0 | pass |
|
||||
| model-complete-2 | 66,585 | 38,144 | 28,441 | 2,217 | 79.180 | 2 | 0 | pass |
|
||||
|
||||
Both pairs pass checks for every selected producer fact, exact nullable
|
||||
observations, target digest, observed response Evidence IDs, original limitations,
|
||||
artifact preservation and profile cleanup. The grader compares the reported
|
||||
facts with producer observations; it is not an independent Dart deserializer.
|
||||
Total input falls 48.75% / 42.38%, uncached input 33.63% / 42.52%, reported output
|
||||
47.59% / 31.66%, and whole-task time 23.95% / 30.30%. Usage is the final aggregate
|
||||
reported by the actual CLI, one usage record per trial; cached tokens are not
|
||||
subtracted from total input. Reported output includes reasoning output (1,262,
|
||||
321, 383 and 709 tokens respectively).
|
||||
|
||||
The first complete trial initially supplied `artifact_path` instead of the
|
||||
advertised `path`, corrected it, then repeated a successful complete call.
|
||||
The second complete trial made two successful calls. Both summary trials made
|
||||
one successful call. All attempts, discovery and correction costs remain
|
||||
included. The paired whole-task improvement therefore includes actual model
|
||||
decisions and the convenience of explicit returned counts; it does not isolate
|
||||
serialization as the sole cause or establish engine acceleration. Two pairs on
|
||||
one app/question/model configuration support this scope, not a universal gain.
|
||||
|
||||
Payload CPU seconds / kernel peak bytes are respectively 12.556 / 876,937,216;
|
||||
9.213 / 785,272,832; 9.108 / 793,939,968; and 13.164 / 803,209,216. Model payload
|
||||
observations verify owned cleanup and zero phase limit events, with no guard
|
||||
aborts. Whole-scope final counters remain unknown, so every strict all-selected
|
||||
resource grade remains false even though the separate factual grade passes.
|
||||
|
||||
## Resource and verification scope
|
||||
|
||||
SDK and migration payload-exit observations verify owned cleanup and zero
|
||||
observed memory/pids limit events, with peaks below 692 MB. Missing whole-scope
|
||||
terminal counters remain unknown; the strict whole-resource grader stays false.
|
||||
One-CPU quotas are experiment controls rather than CPU-efficiency claims.
|
||||
|
||||
Production-provider fixture tests cover explicit ABI, old complete defaults,
|
||||
actual SDK-converted schemas, exact pages after APK removal, portable records,
|
||||
nullable/partial facts, malformed inputs, target digest conflicts and early
|
||||
refusals. CLI/MCP acceptance covers original report equality, duplicate-member
|
||||
refusals and unsupported snapshot kinds. Fixture successes are distinguished
|
||||
from the real LocalSend SDK/migration workflows. Other Flutter apps, architectures,
|
||||
SDK layouts, typed class recovery and runtime behavior remain unverified here.
|
||||
Raw replies, binaries, model traces and temporary credentials stay outside Git.
|
||||
|
||||
## Integration with the newer main
|
||||
|
||||
The rebased verification runtime is `63984ce0898bd7997e6d9b138e6d96d0a24f2b09`
|
||||
on main `a2d8b94dd50dab8d966239dd63ab84718aa8b4b4`, with compiled file-table
|
||||
SHA-256 `19c8ccdd3e99bb46a5c54f4edd8c6b2d2eb4f3a4870b3c129061d38145382b68`.
|
||||
Targeted Flutter/SAZ/shared-view integration passes 35 tests; one opposite
|
||||
runtime-capacity branch is skipped because this host enforces decoder memory.
|
||||
Documentation checks and two README conformance tests pass.
|
||||
|
||||
Fresh real complete/summary SDK checks on this runtime match the earlier selected
|
||||
facts and settings, with unchanged 151,341 / 12,037-byte AOT replies. Fifteen
|
||||
old-Evidence migration calls again preserve every original string and record
|
||||
with the source APK absent. The real one-shot CLI complete result also matches
|
||||
the previous-runtime normalized report, subject, parameters and original ID.
|
||||
An initial CLI-only controller check lacked an owned resource receipt; it is
|
||||
retained and excluded from resource/performance claims, then repeated in the
|
||||
bounded owned scope. These checks establish integration, rather than relabeling
|
||||
the earlier paired model/SDK measurements as the rebased runtime.
|
||||
@@ -23,25 +23,6 @@ connecting. Dossier relationship coverage remains unknown when direct callers
|
||||
are unavailable, while standalone callee coverage retains its own observed state.
|
||||
It preserves the attached GUI database.
|
||||
|
||||
The later verification follow-up rejects native callee successes without an
|
||||
explicit truncation marker, checks positive procedure inventory/search and
|
||||
compares normalized function results. String and xref correctness require
|
||||
independent positive oracles; runs without those oracles label them unverified.
|
||||
Earlier reports established contract validity for these operations and did not
|
||||
by themselves establish string/xref semantic correctness.
|
||||
|
||||
The follow-up passed eight production checks with a known CRT literal confirmed
|
||||
in the unchanged fixture bytes and a reference source address independently
|
||||
identified from `main` assembly matching the C source. A loopback response-only
|
||||
proxy in front of the real IDA Pro provider reproduced the earlier verifier
|
||||
passing empty function inventories and xrefs. The corrected verifier rejected
|
||||
those replies with positive oracles, empty string results and missing native
|
||||
callee truncation markers. The comparison used verifier source `d1aaeee40`
|
||||
with the same current adapter runtime; it is a verifier comparison, not an
|
||||
engine performance comparison. Only response payloads were modified; the original
|
||||
input digest stayed unchanged, the target was never executed, and the attached
|
||||
GUI database was preserved.
|
||||
|
||||
The real application was a digest-verified, unchanged copy of Windows
|
||||
`whoami.exe`: 94,208 bytes, 243 recognized functions, and 314 upstream
|
||||
C-string observations. The selected 1,741-byte function had 20 resolved
|
||||
|
||||
@@ -1,75 +0,0 @@
|
||||
# Latest-main efficiency continuation
|
||||
|
||||
Continues [#2016](https://github.com/morluto/rea/issues/2016). The 2026-10-13
|
||||
fetch resolved main to `f254f5ac2b804b353a711264bb178f43fdf07867`, the same
|
||||
revision as the preceding Android conclusion. Newer capabilities below were
|
||||
added during that earlier cycle; they are additional measurement scopes, not
|
||||
new commits after that conclusion.
|
||||
|
||||
| Capability | Existing controls | Next evidence needed |
|
||||
| ----------------------------- | ---------------------------------------------------------------------------------------- | ------------------------------------------------------------------------------------------- |
|
||||
| Flutter / Dart AOT (#1582) | Explicit ABI, bounded string observations, partial coverage | Real shipped snapshot/count question; opt-in delivery only if unrelated strings dominate |
|
||||
| SQLite (#2271) | Compact inventory, selected table/columns, row limit | Real application database and model workflow before adding another selector |
|
||||
| TShark (#2318) | Fields, filter, decode-as, pass, default 50 matching rows, paging, explicit null for all | Real public capture and repeated task cost; paging repeats dissection |
|
||||
| sigrok (#2339) | Decoder/channels/annotation selection, default 50 display lines, paging | Real public capture; display-line count is not annotation count and paging repeats decoding |
|
||||
| Retained unknown head results | Existing retained paging | Reuse the existing view rather than duplicate its implementation |
|
||||
|
||||
Attached IDA, Frida and other live runtime workflows involve separate authority
|
||||
and lifecycle questions and are outside this static parsing continuation.
|
||||
Plugin SDKs and cross-session engine caches remain deferred until an observed
|
||||
need and benefit justify them.
|
||||
|
||||
## First selected scope: Dart AOT
|
||||
|
||||
The official LocalSend 1.18.2 arm64 APK is pinned in `corpus.json`. The initial
|
||||
real public SDK baseline inspected actual bytes without executing/installing
|
||||
the APK. Its complete default AOT reply was 151,341 compact client-result JSON
|
||||
bytes (70,487 normalized bytes), with 500 package URIs, 216 Dart URIs and 2,000
|
||||
class-like tokens. String-pool and overall coverage were partial. A second
|
||||
explicit arm64 request returned the same normalized facts.
|
||||
|
||||
These are exploratory first/warm calls, not an optimization pair. The frozen
|
||||
runtime source is `28c84e78cf2fbfde4aceed345b773c59eb889f68`, with production
|
||||
source bytes verified equal to main f254 at baseline acquisition. Its compiled
|
||||
file-table digest is
|
||||
`5332dda13981f043e146b3601ebec1f380d9f698280ca53d75786b638a912e11`;
|
||||
the receipt is not relabeled as a newer build.
|
||||
|
||||
The candidate adds explicit MCP `detail: "summary"` and retained pool pages.
|
||||
Omitted/complete requests and the CLI preserve the old complete path. Analysis,
|
||||
ABI selection and original Evidence stay intact. Summary retains target/libapp
|
||||
identity, exact nullable snapshot observations, lower bounds, returned counts,
|
||||
coverage and limitations. Pages preserve original string order and source
|
||||
coverage without rescanning. No engine cache, provider protocol or third-party
|
||||
plugin API is introduced.
|
||||
|
||||
Follow-up measurements must compare identical selected facts, portable old
|
||||
Evidence and actual model tasks. Reply bytes do not establish token or latency
|
||||
improvements. Whole-scope final counters remain unknown if their cgroup has
|
||||
disappeared, even when the narrower payload-exit observation is verified.
|
||||
Raw records, binaries and model traces stay in the private lab outside Git.
|
||||
Heavy work remains serial under the unchanged one-CPU, 3 GiB early-stop / 4 GiB
|
||||
hard memory, no-swap and host-availability guards.
|
||||
|
||||
## Main advanced during the experiment
|
||||
|
||||
Main subsequently advanced to `a2d8b94dd50dab8d966239dd63ab84718aa8b4b4`,
|
||||
adding native Fiddler SAZ parsing. Its web-network capture contract already
|
||||
offers opt-in summary and retained capture pages, archive-member coordinates
|
||||
and exact exposed encoded bytes. It decodes all records before ordinal
|
||||
selection and rejects malformed/oversized inputs without partial success.
|
||||
Measure real public SAZ artifacts using these controls before adding another
|
||||
API or changing decoding or credential-redaction semantics. SAZ performance
|
||||
remains unverified in this Flutter continuation.
|
||||
|
||||
The Flutter cohorts keep their original frozen runtime; subsequent integration
|
||||
onto this newer main does not relabel earlier measurement receipts.
|
||||
|
||||
Main advanced again to `bb154d106` during CI, adding retained aioquic 1.5.0
|
||||
qlog 0.3 JSON parsing and qlog views. The existing capture summary/page path
|
||||
already applies. Qlog's trace-scoped STREAM interval unions and endpoint loss
|
||||
declarations have separate semantics: they do not recover bodies, prove network
|
||||
loss or establish PCAP correlation. Measure genuine supported recordings and
|
||||
existing retained views before adding delivery or caching. Other qlog layouts
|
||||
and qlog performance remain unverified in the Flutter experiment. Shared-view
|
||||
integration is checked after rebasing; earlier runtime receipts remain pinned.
|
||||
@@ -28,7 +28,6 @@ const { values } = parseArgs({
|
||||
"javascript-question": { type: "string", default: "inventory" },
|
||||
"managed-question": { type: "string", default: "inventory" },
|
||||
schemas: { type: "string", default: "default" },
|
||||
"sqlite-selection": { type: "string", default: "all" },
|
||||
},
|
||||
});
|
||||
if (
|
||||
@@ -44,11 +43,6 @@ if (
|
||||
) ||
|
||||
!["inventory", "selected"].includes(values["javascript-question"]) ||
|
||||
!["default", "selected"].includes(values.schemas) ||
|
||||
!["all", "columns"].includes(values["sqlite-selection"]) ||
|
||||
(values.artifact !== "qgis-world-map.gpkg" &&
|
||||
values["sqlite-selection"] !== "all") ||
|
||||
(values.artifact === "qgis-world-map.gpkg" &&
|
||||
values.delivery !== "complete") ||
|
||||
!["inventory", "identity"].includes(values["managed-question"]) ||
|
||||
(!["sharex.dll", "sharex.helpers.dll"].includes(values.artifact) &&
|
||||
values["managed-question"] !== "inventory") ||
|
||||
@@ -524,54 +518,6 @@ const inspectEvmTarget = async () => {
|
||||
};
|
||||
|
||||
const workflows = {
|
||||
"qgis-world-map.gpkg": async () => {
|
||||
const columns = ["fid", "NAME", "ISO_A3"];
|
||||
const input = {
|
||||
path: values.path,
|
||||
table: "countries",
|
||||
row_limit: 1,
|
||||
...(values["sqlite-selection"] === "columns" ? { columns } : {}),
|
||||
};
|
||||
const definition = catalogDefinitions.get("inspect_sqlite_database");
|
||||
if (
|
||||
definition === undefined ||
|
||||
!new Ajv2020({ strict: false, validateFormats: false }).validate(
|
||||
definition.inputSchema,
|
||||
input,
|
||||
)
|
||||
)
|
||||
throw new Error(
|
||||
"Selected SQLite request is not advertised by this runtime",
|
||||
);
|
||||
const inspected = await call("inspect_sqlite_database", input);
|
||||
const report = normalized(inspected);
|
||||
if (report.rows === null || report.rows.table !== "countries")
|
||||
throw new Error("Runtime returned no selected country sample");
|
||||
const indexes = columns.map((column) => {
|
||||
const index = report.rows.columns.indexOf(column);
|
||||
if (index < 0)
|
||||
throw new Error(`Missing requested SQLite column ${column}`);
|
||||
return index;
|
||||
});
|
||||
return {
|
||||
artifact_sha256: targetSha(inspected),
|
||||
artifact: report.artifact,
|
||||
wal: report.wal,
|
||||
engine: report.engine,
|
||||
database_encoding: report.database_encoding,
|
||||
schema: report.schema,
|
||||
rows: {
|
||||
...report.rows,
|
||||
columns,
|
||||
values: report.rows.values.map((row) =>
|
||||
indexes.map((index) => row[index]),
|
||||
),
|
||||
},
|
||||
producer_limitations: report.limitations,
|
||||
limitations: inspected.limitations,
|
||||
evidence_ids: [inspected.evidence_id],
|
||||
};
|
||||
},
|
||||
"obsidian.asar": async () => {
|
||||
if (values["javascript-question"] === "selected") {
|
||||
const inspected = await call("analyze_javascript_application", {
|
||||
@@ -720,40 +666,7 @@ const workflows = {
|
||||
}
|
||||
},
|
||||
"newpipe.apk": async () => {
|
||||
const packageInput = {
|
||||
path: values.path,
|
||||
...(values.delivery === "summary" ? { detail: "summary" } : {}),
|
||||
};
|
||||
const definition = catalogDefinitions.get("inspect_android_package");
|
||||
if (
|
||||
definition === undefined ||
|
||||
!new Ajv2020({ strict: false, validateFormats: false }).validate(
|
||||
definition.inputSchema,
|
||||
packageInput,
|
||||
)
|
||||
)
|
||||
throw new Error(
|
||||
"Selected Android delivery is not advertised by this runtime",
|
||||
);
|
||||
const pkg = await call("inspect_android_package", packageInput);
|
||||
const result = normalized(pkg);
|
||||
const report = values.delivery === "summary" ? result.summary : result;
|
||||
if (
|
||||
values.delivery === "summary" &&
|
||||
(result.kind !== "summary" ||
|
||||
result.parent_operation !== "inspect_android_package")
|
||||
)
|
||||
throw new Error("Runtime returned no retained Android package summary");
|
||||
const { manifest, ...declarations } = report;
|
||||
const manifestObservation =
|
||||
values.delivery === "summary"
|
||||
? manifest
|
||||
: {
|
||||
status: manifest.status,
|
||||
reported_total_bytes: manifest.reported_total_bytes,
|
||||
text_code_units: manifest.text.length,
|
||||
text_included: false,
|
||||
};
|
||||
const pkg = await call("inspect_android_package", { path: values.path });
|
||||
const found = await call("search_android_classes", {
|
||||
path: values.path,
|
||||
query: "MainActivity",
|
||||
@@ -764,12 +677,9 @@ const workflows = {
|
||||
});
|
||||
return {
|
||||
artifact_sha256: targetSha(pkg),
|
||||
package_name: report.package_name,
|
||||
version_name: report.version_name,
|
||||
version_code: report.version_code,
|
||||
package_declarations: declarations,
|
||||
manifest_observation: manifestObservation,
|
||||
package_limitations: pkg.limitations,
|
||||
package_name: normalized(pkg).package_name,
|
||||
version_name: normalized(pkg).version_name,
|
||||
version_code: normalized(pkg).version_code,
|
||||
matches: normalized(found).matches,
|
||||
coverage: normalized(found).coverage,
|
||||
onCreate: normalized(cls).methods.filter(
|
||||
@@ -780,54 +690,6 @@ const workflows = {
|
||||
},
|
||||
"sharex.dll": inspectManagedTarget,
|
||||
"sharex.helpers.dll": inspectManagedTarget,
|
||||
"localsend-arm64.apk": async () => {
|
||||
const input = {
|
||||
path: values.path,
|
||||
...(values.delivery === "summary" ? { detail: "summary" } : {}),
|
||||
};
|
||||
const definition = catalogDefinitions.get("inspect_dart_aot");
|
||||
if (
|
||||
definition === undefined ||
|
||||
!new Ajv2020({ strict: false, validateFormats: false }).validate(
|
||||
definition.inputSchema,
|
||||
input,
|
||||
)
|
||||
)
|
||||
throw new Error(
|
||||
"Selected Dart AOT delivery is not advertised by this runtime",
|
||||
);
|
||||
const inspected = await call("inspect_dart_aot", input);
|
||||
const result = normalized(inspected);
|
||||
if (
|
||||
values.delivery === "summary" &&
|
||||
(result.kind !== "summary" ||
|
||||
result.parent_operation !== "inspect_dart_aot")
|
||||
)
|
||||
throw new Error("Runtime returned no retained Dart AOT summary");
|
||||
const report = values.delivery === "summary" ? result.summary : result;
|
||||
const { package_uris, dart_uris, class_like_tokens, ...pool } =
|
||||
report.string_pool;
|
||||
return {
|
||||
artifact_sha256: targetSha(inspected),
|
||||
target: report.target,
|
||||
abi: report.abi,
|
||||
libapp: report.libapp,
|
||||
string_pool:
|
||||
values.delivery === "summary"
|
||||
? pool
|
||||
: {
|
||||
...pool,
|
||||
returned_counts: {
|
||||
package_uris: package_uris.length,
|
||||
dart_uris: dart_uris.length,
|
||||
class_like_tokens: class_like_tokens.length,
|
||||
},
|
||||
},
|
||||
coverage: report.coverage,
|
||||
limitations: inspected.limitations,
|
||||
evidence_ids: [inspected.evidence_id],
|
||||
};
|
||||
},
|
||||
"openwrt.bin": async () => {
|
||||
const info = await call("inspect_firmware_regions", { path: values.path });
|
||||
return {
|
||||
@@ -956,10 +818,6 @@ const report = {
|
||||
)
|
||||
? values["managed-question"]
|
||||
: null,
|
||||
sqlite_selection:
|
||||
values.artifact === "qgis-world-map.gpkg"
|
||||
? values["sqlite-selection"]
|
||||
: null,
|
||||
provider_settings_sha256: sha(JSON.stringify(selectedProviders)),
|
||||
provider_search_path_sha256: sha(
|
||||
selectedProviders.PATH ?? process.env.PATH ?? "",
|
||||
|
||||
@@ -1,209 +0,0 @@
|
||||
# Observe the client boundary before claiming token savings
|
||||
|
||||
Continues [#2016](https://github.com/morluto/rea/issues/2016) after the managed
|
||||
summary [PR #2413](https://github.com/morluto/rea/pull/2413) merged as
|
||||
`82cfcee19f18b0eeae9a330ba04e0411cdf85225`. That opt-in view has verified smaller
|
||||
delivery and complete-default migration, while its original real-model cohort
|
||||
does not establish token savings. This follow-up measures why raw reply bytes
|
||||
and aggregate model usage cannot be treated as interchangeable observations.
|
||||
|
||||
## Concrete diagnostic observation
|
||||
|
||||
An individual real Codex CLI 0.161.0 control uses frozen runtime
|
||||
`ae8051302b5834322fa00cfa31c968ae74ab6ed9`, the unchanged ShareX identity question,
|
||||
requested `gpt-5.6-terra` high and the same two enabled REA tools. A private
|
||||
diagnostic copy removes the original runner's explicit `--ephemeral` flag.
|
||||
Authentication/profile cleanup still runs; only selected tool/usage items are
|
||||
retained after filtering the owned rollout. Its source rollout SHA-256 is
|
||||
`d4df41d6187880d177f00b7533d85ad032c9c4ec502a39e7d5a566180e10461b` and the retained
|
||||
filtered-item SHA-256 is
|
||||
`0d5b4fb67c5674d1ba14ac32ae37e9a72b0368f4d9f5f9f81eb4d13193cda260`.
|
||||
The original whole-copy is removed; account metadata, world state, messages and
|
||||
internal passthrough are not retained in the filtered receipt.
|
||||
|
||||
Despite the requested `direct` configuration label, the observed client uses
|
||||
three JavaScript `exec` calls. First it filters `ALL_TOOLS` with a broad
|
||||
`/REA|reverse|artifact|managed|assembly|metadata/i` expression and prints matching
|
||||
metadata. The client reports truncation of a 164,005-token original output.
|
||||
This is the client's output measurement, not billed input or a complete inventory.
|
||||
Next it invokes complete managed inspection but selects requested normalized
|
||||
identity/classification fields before printing. Finally it invokes native-boundary
|
||||
inspection and prints selected fields. The actual original complete MCP replies
|
||||
remain available in the separate public-event transcript.
|
||||
|
||||
The persisted custom-tool output values are 41,704 / 2,154 / 13,489 UTF-8 bytes.
|
||||
These are the serialized recorded output **values**, not raw wire bytes or exact
|
||||
submitted model requests. The trace reports four per-response usage observations:
|
||||
|
||||
| Response | Input | Cached input | Output |
|
||||
| -------- | -----: | -----------: | -----: |
|
||||
| 1 | 10,400 | 0 | 132 |
|
||||
| 2 | 19,992 | 9,984 | 456 |
|
||||
| 3 | 21,242 | 19,200 | 251 |
|
||||
| 4 | 24,799 | 20,224 | 1,535 |
|
||||
|
||||
Their totals match public turn usage: 76,433 input, 49,408 cached, 27,025 uncached
|
||||
and 2,374 output, with 61.436 seconds observed wall time. Two MCP calls alone do
|
||||
not describe the client's discovery/execution rounds. This proves the observed
|
||||
control can project a complete result before printing it; it does not establish
|
||||
that every earlier control/candidate did the same, or attribute every token
|
||||
difference to discovery. The earlier `direct` label specifies requested client
|
||||
configuration, not a verified absence of an executor.
|
||||
|
||||
Initial transcript-capture attempts retained empty source lists because the
|
||||
original runner intentionally passed `--ephemeral`. A first private flag-removal
|
||||
edit missed its newline and failed; that candidate remains an unsuccessful
|
||||
capture attempt. The later corrected control is an individual diagnostic,
|
||||
not a comparable pair with that candidate. Other exploratory aggregates remain
|
||||
private and are not silently folded into the original four-trial cohort.
|
||||
|
||||
## Reproducible optional capture
|
||||
|
||||
`agent-trial.py --capture-tool-context` omits `--ephemeral` only for that explicitly
|
||||
selected temporary trial. Its default is unchanged. The profile still disappears
|
||||
in `finally`, including when capture fails. The capture reads only its owned
|
||||
`sessions/*.jsonl` records, rejects symlink sources, and retains:
|
||||
|
||||
- Custom/function tool calls and replies, preserving call IDs and exact values.
|
||||
- Per-response token counts and cumulative counts, with original response IDs.
|
||||
- Client token-count events, retaining explicit unknown `info: null`.
|
||||
|
||||
It excludes session/account metadata, world state, user/developer messages,
|
||||
encrypted reasoning, internal passthrough and unknown nested usage fields. It
|
||||
does not copy authentication, configuration or the ambient environment. Receipts
|
||||
record source/retained digests, event counts, malformed-line failures and missing
|
||||
rollouts as unavailable. Capture is an observation of persisted client items,
|
||||
not proof of the exact request accepted by a remote model service.
|
||||
|
||||
Run the same frozen runtime, question, tool selection and capture mode on both
|
||||
sides. Preserve source/settings hashes and separate requested versus observed
|
||||
behavior. Use the existing resource wrapper with unchanged one CPU, 4 GiB hard
|
||||
memory, 3 GiB early-stop, no swap and task/host safeguards. Final physical counters
|
||||
remain unknown when transient cgroups disappear; this instrumentation does not
|
||||
repair that measurement limitation.
|
||||
|
||||
The focused Python tests run through the existing CI `test:python` gate.
|
||||
They cover account/ambient exclusion while preserving caller data, malformed and
|
||||
missing records, foreign symlinks, and capture failure without copied-credential
|
||||
leakage. The cleanup test simulates a CLI and establishes only cleanup semantics;
|
||||
it is not real-model/provider evidence.
|
||||
|
||||
## An explicit discovery-guidance experiment
|
||||
|
||||
`--guide-enabled-tools` is another opt-in experiment flag. It requires a nonempty
|
||||
`--enabled-tools` list and adds the exact corresponding `mcp__rea__...` function
|
||||
names to the temporary developer instructions, requesting only exact-name
|
||||
metadata discovery. It preserves the analyst question, operation order, tool
|
||||
selection and provider inputs. The default instruction is unchanged. Missing or
|
||||
invalid selected tools fail before creating an output/profile. The test gate
|
||||
also verifies the new prerequisite without acquiring a profile.
|
||||
|
||||
Compare guided and unguided runs on the **same** frozen REA runtime with matching
|
||||
capture mode and requested facts. A smaller discovery response or additional
|
||||
hint is not itself a task/token success: grade answers, count all response usage,
|
||||
preserve failed/truncated runs and repeat both orders before recommending this
|
||||
guidance. This is a caller-side experiment, not a new REA tool or provider preset.
|
||||
|
||||
## First committed capture pair
|
||||
|
||||
Checkpoint `9ebdcc458c399b9bdecaaca2ef47422888231181` runs the unchanged question
|
||||
against frozen control `ae8051302b5834322fa00cfa31c968ae74ab6ed9` and candidate
|
||||
`8bc1601ca51e417ca472d90ea0367e9418a1a0f2`, both with capture enabled and no tool
|
||||
guidance. Both captures succeed with 10 retained events, unchanged source bytes,
|
||||
removed profiles, two successful MCP calls and passing selected factual checks.
|
||||
Full grader gates remain false because final physical resource counters are
|
||||
unavailable; factual subsets do not override that limitation.
|
||||
|
||||
| Side | Input | Cached | Uncached | Output | Wall seconds |
|
||||
| ----------------- | -----: | -----: | -------: | -----: | -----------: |
|
||||
| Complete control | 52,656 | 27,136 | 25,520 | 2,015 | 57.736 |
|
||||
| Summary candidate | 56,655 | 29,184 | 27,471 | 1,534 | 55.055 |
|
||||
|
||||
Both clients make two executor calls and three response-usage observations.
|
||||
First they print broad discovered metadata, with truncation. Then each executor
|
||||
sequentially performs both MCP operations, preserving selected-target dependency
|
||||
order. The control prints a 2,086-byte output value; the candidate prints 22,770
|
||||
bytes. Their discovery output values are 41,723 and 41,675 bytes. These are
|
||||
recorded serialized values and remain distinct from raw MCP envelopes, billed
|
||||
tokens and exact submitted requests. Both requested modes are `direct`; the
|
||||
actual executor use is separately observed.
|
||||
|
||||
The candidate's smaller raw metadata reply does not result in a smaller printed
|
||||
client value in this pair. Candidate input/uncached tokens remain higher. The
|
||||
observed projection and round counts are useful constraints for the next
|
||||
experiment; this one pair does not attribute all usage differences to either
|
||||
formatting or discovery, or establish a reliable speedup.
|
||||
|
||||
## Same-runtime guided discovery, repeated in both orders
|
||||
|
||||
Checkpoint `e20bd0e2a905f06bc8c56fe04b0e61f3da88636a` runs four actual Codex trials
|
||||
in unguided/guided/guided/unguided order. All use the **same** frozen candidate
|
||||
runtime, artifact, original question, requested model/reasoning, two selected
|
||||
tools, provider settings and capture mode. Only the explicit discovery-guidance
|
||||
treatment changes. Every trial selects artifact summary and makes the same two
|
||||
successful MCP calls in dependency order; source bytes stay unchanged, captures
|
||||
succeed and profiles are removed.
|
||||
|
||||
| Trial | Input | Cached | Uncached | Output | Seconds | Observed responses |
|
||||
| ---------- | ------: | -----: | -------: | -----: | ------: | -----------------: |
|
||||
| Unguided 1 | 77,251 | 50,432 | 26,819 | 1,931 | 62.066 | 4 |
|
||||
| Guided 1 | 39,175 | 23,040 | 16,135 | 1,763 | 55.658 | 3 |
|
||||
| Guided 2 | 58,336 | 38,144 | 20,192 | 1,626 | 50.685 | 4 |
|
||||
| Unguided 2 | 103,301 | 72,704 | 30,597 | 1,983 | 60.336 | 5 |
|
||||
|
||||
Both guided discovery output values repeat at 12,336 bytes without truncation,
|
||||
versus 41,709 bytes with truncation on both unguided trials. The recorded
|
||||
executor/output usage explains observable discovery and round differences; it
|
||||
does not certify exact remote request contents or attribute every token to the
|
||||
hint. CPU samples are 6.303–6.554 seconds and peak family memory 684,519,424–
|
||||
712,028,160 bytes, with no guard abort. Final resource counters remain unknown.
|
||||
These samples do not establish a memory or CPU improvement.
|
||||
|
||||
Unguided 1 omits `classification.container` and fails the selected factual gate;
|
||||
it is not a fully acceptable comparison answer. Guided 1 and Unguided 2 pass
|
||||
that gate. Guided 2 initially fails exact coverage-object equality because it
|
||||
adds `module_ref_count: 0` and `pinvoke_import_count: 0` to the explicitly named
|
||||
native scope. Both numbers exactly match the producer's returned arrays. The
|
||||
grader now explicitly verifies only these two known additional counts, including
|
||||
integer type, while still requiring all original coverage facts. Unknown extra
|
||||
claims, conflicting aliases, wrong counts, boolean/string counts and omitted
|
||||
issues continue to fail. Source coverage remains unchanged; returned-row counts
|
||||
do not establish global absence. Original failure receipts remain preserved;
|
||||
the regrade separately records its new source hash. Guided 2 then passes selected
|
||||
facts, but every **full** gate still fails unknown final physical resource checks.
|
||||
|
||||
The second comparison has two factually acceptable answers: observed guided input
|
||||
falls about 43.5%, uncached input about 34.0%, and wall time about 16.0%. The first
|
||||
comparison has an incomplete unguided answer and is reported without counting it
|
||||
as equivalent completed work. Two trials per treatment on one question/application
|
||||
remain a preliminary signal, not a general default recommendation. The hint stays
|
||||
opt-in; wider questions/domains, count/coverage representation and client round
|
||||
behavior need further verification before promoting it into general guidance.
|
||||
|
||||
## Real Android follow-up: the primary outcomes are mixed
|
||||
|
||||
Checkpoint `22834c7d73056e2480b426848f58c31af0c307bc` checks the pinned real
|
||||
NewPipe 0.29.1 APK using actual configured JADX 0.7.1/Java, the original Android
|
||||
question and the same frozen candidate runtime. First a fresh SDK workflow
|
||||
validates three live advertised operations and produces the comparison facts:
|
||||
package/version identity, every case-sensitive MainActivity match and all
|
||||
reported onCreate entries, preserving signatures, overload indices and null DEX
|
||||
descriptors. It takes 26.961 seconds; the owned scope samples 1,234,735,104 bytes.
|
||||
|
||||
Both subsequent actual Codex trials use the same three selected tool names,
|
||||
capture mode, model/reasoning, question and provider settings. Only discovery
|
||||
guidance changes. Each makes three successful MCP calls and five observed model
|
||||
responses, passes selected facts against the fresh actual producer, preserves
|
||||
source bytes and removes its temporary profile. No APK execution is requested.
|
||||
|
||||
| Trial | Input | Cached | Uncached | Output | Wall seconds | Sampled peak bytes |
|
||||
| -------- | -----: | -----: | -------: | -----: | -----------: | -----------------: |
|
||||
| Unguided | 99,913 | 80,640 | 19,273 | 1,527 | 66.797 | 1,405,829,120 |
|
||||
| Guided | 89,220 | 62,464 | 26,756 | 2,142 | 76.936 | 1,345,576,960 |
|
||||
|
||||
Total input falls about 10.7%, but uncached input increases and wall time is
|
||||
longer. One pair does not demonstrate improved Android performance or memory.
|
||||
No guard abort occurs; final counters remain unknown and full resource gates
|
||||
remain false. This second domain is a concrete counterexample to generalizing
|
||||
the favorable managed comparison. Keep both flags optional and continue
|
||||
task-specific experiments before changing installed/default agent guidance.
|
||||
@@ -1,113 +0,0 @@
|
||||
# Process trace validation
|
||||
|
||||
A 6,000-event directed cycle previously overflowed the JavaScript stack inside
|
||||
the schema refinement. Cycle detection now uses iterative topological traversal.
|
||||
Cyclic inputs retain independent declaration diagnostics without expanding all
|
||||
event pairs. Unordered declarations retain group membership, with one diagnostic
|
||||
per overlapping or conflicting group, instead of allocating a pair set and
|
||||
repeating the same error for every pair.
|
||||
|
||||
A unique topological order proves that every event pair is ordered, allowing
|
||||
rank comparisons without retaining transitive closure. Other acyclic graphs
|
||||
retain only one origin's forward and backward reachability sets at a time.
|
||||
Complete pair validation preserves the missing count and first declaration-order
|
||||
missing pair. General partial orders still require quadratic pair examination
|
||||
and repeated graph traversal; they trade CPU time for bounded retained state.
|
||||
|
||||
## Initial cycle fix comparison
|
||||
|
||||
Flameox ran three randomized paired blocks (seed 917), each limited to 20 seconds
|
||||
and 512 MiB. Node 24.18.0 used a 384-MiB old-space limit on macOS arm64. Each
|
||||
process validated the same 2,500-event acyclic chain four times, then checked the
|
||||
known 6,000-event cycle failure with per-event not-before constraints and one
|
||||
unordered group containing every event. All six executions passed the embedded answer
|
||||
digest and expected rejection checks.
|
||||
|
||||
The baseline source is from `bb540826d`; the candidate is the initial cycle fix
|
||||
in `10935b7b1`, which still memoized reachability sets for every queried origin.
|
||||
Both modules had TypeScript annotations removed with Node's identical built-in
|
||||
transform and used the same copied runtime dependencies. This isolates schema
|
||||
validation rather than comparing complete packaged CLI/MCP processes.
|
||||
|
||||
| Median measurement | Baseline | Candidate |
|
||||
| -------------------------------------------- | -------: | --------: |
|
||||
| First validation elapsed milliseconds | 335.80 | 177.25 |
|
||||
| Warm validation elapsed milliseconds | 313.36 | 165.23 |
|
||||
| First validation CPU milliseconds | 366.85 | 218.39 |
|
||||
| Warm validation CPU milliseconds | 335.32 | 194.08 |
|
||||
| Whole-process elapsed milliseconds | 1,344.13 | 787.00 |
|
||||
| Process CPU milliseconds before final report | 1,457.67 | 941.05 |
|
||||
| Peak process-family MiB | 328.36 | 395.52 |
|
||||
|
||||
The input is identical: 233,095 JSON bytes, estimated at 77,010 tokens by tokenx
|
||||
1.3.0. The valid parsed result digest is
|
||||
`28bd99ce83f0da8e45600ef20f114cb52bb26b5f5e6bfc1601ca3e712eaf3147`.
|
||||
Actual agent tokens, catalog injection, transport, model reasoning and provider
|
||||
costs were not measured. This is a component measurement, not an end-to-end
|
||||
investigation speed claim.
|
||||
|
||||
First validation excludes module import and fixture preparation; warm runs reuse
|
||||
the process but create fresh per-validation graph state. Whole-process elapsed
|
||||
includes startup, imports, all four validations, the cyclic-input check, token
|
||||
estimation and reporting. CPU includes startup through metrics publication;
|
||||
peak RSS covers the complete single-process workload, with no children. Host
|
||||
caches were not flushed. Peak memory increased in this cohort. Its retained
|
||||
valid-order closure still required quadratic memory, prompting the follow-up.
|
||||
Three pairs describe this fixture only.
|
||||
|
||||
Preserved Flameox evidence:
|
||||
`d6211639446e8b6ec2e82636913eaf471def96673e28f03e9c7f98bec07f8e13`;
|
||||
analysis `e663b6bd8f5693975542d5b5e2b18437b3c167a0be939bb7386eb68549936231`.
|
||||
An earlier cohort lost modules during another checkout build; its three failed
|
||||
executions and timing results are excluded. The successful cohort uses an
|
||||
isolated runtime copy. Source-module SHA-256 values are
|
||||
`a7729faa2183b0e493b9ac4fc55f6feaee5b2e5294be13d1b29b57a44b899788`
|
||||
(baseline) and `725409ce84902125941251037a8a214ccc3c1eec577e484c164c361ca580d693`
|
||||
(candidate).
|
||||
|
||||
## Bounded retention follow-up
|
||||
|
||||
Flameox compared `10935b7b1` with the rank/streaming implementation in three
|
||||
randomized paired blocks (seed 624), under the same host, Node, heap, memory and
|
||||
20-second execution bounds. Each execution validated the chain above four times,
|
||||
then a 1,200-event partial order with 600 unordered two-event layers and all four
|
||||
edges between consecutive layers four times, then the same cyclic failure.
|
||||
All six executions passed both parsed-answer digests and the cycle diagnostic.
|
||||
Runtime dependencies were copied and isolated from concurrent checkout builds.
|
||||
|
||||
| Median measurement | Memoized closure | Rank/streaming |
|
||||
| ---------------------------------------- | ---------------: | -------------: |
|
||||
| Chain first elapsed milliseconds | 166.11 | 11.37 |
|
||||
| Chain warm elapsed milliseconds | 154.25 | 5.32 |
|
||||
| Chain first CPU milliseconds | 210.13 | 24.38 |
|
||||
| Chain warm CPU milliseconds | 184.76 | 16.84 |
|
||||
| Partial order first elapsed milliseconds | 49.44 | 116.54 |
|
||||
| Partial order warm elapsed milliseconds | 50.67 | 110.29 |
|
||||
| Partial order first CPU milliseconds | 72.47 | 137.69 |
|
||||
| Partial order warm CPU milliseconds | 70.65 | 121.77 |
|
||||
| Capture process elapsed milliseconds | 901.24 | 557.30 |
|
||||
| Process CPU milliseconds before report | 1,101.12 | 665.03 |
|
||||
| Peak process-family MiB | 391.13 | 127.72 |
|
||||
|
||||
First samples exclude module import and fixture preparation. Partial-order first
|
||||
samples follow four chain validations, so they are first use of that fixture
|
||||
within an already running process. Warm medians pool the three subsequent samples
|
||||
from each of three processes. CPU and peak RSS cover the combined workload;
|
||||
capture elapsed additionally includes Flameox capture startup and overhead.
|
||||
Host caches were not flushed. The partial-order fixture is slower after this
|
||||
change; these results establish a retention tradeoff, not universal acceleration.
|
||||
|
||||
The partial-order input is 165,590 JSON bytes, estimated at 52,783 tokens by tokenx
|
||||
1.3.0; its parsed-answer SHA-256 is
|
||||
`41d06e593813e497221c36793bf00d5fece7055081895b5f6c123ba6ad9a8227`.
|
||||
Chain bytes, token estimate and answer digest remain unchanged. Actual agent
|
||||
tokens, transport, catalog injection, model reasoning and provider costs remain
|
||||
unmeasured. Both cohorts are component measurements, not complete investigations.
|
||||
|
||||
Preserved evidence:
|
||||
`e29086af99afd8e67cbbd92e43d960ea40f73b4d318ea0cbca60f493575462b8`;
|
||||
analysis `086133516f2acf031032d357a3ddb1ac611ce4f12556a24065a2becd567c5f7b`.
|
||||
The baseline module SHA-256 is
|
||||
`725409ce84902125941251037a8a214ccc3c1eec577e484c164c361ca580d693`;
|
||||
the candidate module SHA-256 is
|
||||
`2109f1096406e9ecac8bbf4f7ae8abb5113404790a9382487285d2831fcddf26`.
|
||||
@@ -1 +0,0 @@
|
||||
Statically inspect the shipped Flutter APK at {{artifact_path}} using only the registered REA inspect_dart_aot tool. Use its default ABI selection. Report target identity, chosen ABI, every libapp ELF/snapshot field exactly as reported including null, original string-pool coverage, all three counts ending in _at_least, printable_run_count, and returned_counts for package_uris, dart_uris and class_like_tokens. Compute returned_counts from the returned arrays if needed. Preserve original overall coverage and producer limitations exactly, including order. Counts ending in _at_least are lower bounds and class-like tokens are byte-pattern observations, not recovered typed classes. Do not return individual strings or infer Dart SDK versions, class semantics, runtime behavior or complete inventory. Final answer must be JSON with artifact_sha256, target, abi, libapp, string_pool, coverage, limitations, evidence_ids. Use actual response Evidence IDs. Do not execute the APK, use shell or host file tools, access the network, or call other agents. Stop when these facts are supported.
|
||||
@@ -1 +0,0 @@
|
||||
Statically inspect the supplied QGIS world-map GeoPackage at {{artifact_path}} using only the registered REA inspect_sqlite_database tool. Select the ordinary countries table with row_limit 1 and its default selected_table schema scope. Report the complete returned schema exactly as reported, including SQL, every declared column, indexes, views, triggers, completeness and explicit nulls. For the one returned sample, report only fid, NAME and ISO_A3 in that order, preserving the original tagged SQLite cells exactly: decimal integer strings, text values with bytes_hex and encoding, and SQL null. Preserve row_limit, returned_rows, truncated and order; row order is unspecified and this is not a complete country inventory. Preserve original artifact identity, wal including null, engine, database_encoding, both normalized-result producer limitations and outer Evidence limitations exactly including order. Do not return geometry blobs or unrequested sample cells, interpret boundaries/political labels as current facts, or infer missing values. Final JSON fields: artifact_sha256, artifact, wal, engine, database_encoding, schema, rows, producer_limitations, limitations, evidence_ids. Include real response Evidence IDs. Do not use shell or host file tools, network, other agents or execute QGIS. Stop once these facts are supported.
|
||||
@@ -1,103 +0,0 @@
|
||||
# Resource counters at payload completion
|
||||
|
||||
Continues [#2016](https://github.com/morluto/rea/issues/2016) from merged main
|
||||
`4f4f6cd7b5d7a400b90772a138d7b9f942c2a556`. A transient cgroup can disappear
|
||||
before the existing supervisor reads terminal counters. Earlier reports keep
|
||||
those counters unknown; sampled zero events are not final no-OOM proof.
|
||||
|
||||
An optional `resource-run.py --observe-payload-exit -- COMMAND...` adds one small
|
||||
observer inside the same owned scope. It waits for the direct payload, records
|
||||
kernel `memory.peak`, CPU and memory/task events, and reports remaining processes
|
||||
before acknowledging completion to the outer supervisor. The observer remains
|
||||
alive until receipt acknowledgement, bounded by the existing ten-second cleanup
|
||||
interval. Payload stdio and process exit status remain observable.
|
||||
|
||||
The receipt phase is **payload-exited-observer-alive**. The supervisor validates
|
||||
the owned-unit token, numeric fields, cgroup identity, live observer membership,
|
||||
payload exit status and absence of additional processes before marking that
|
||||
observation verified. Wrong-owner, malformed, missing or inconsistent receipts
|
||||
stay unknown; lingering actors stay explicit and cannot certify cleanup.
|
||||
Unexpected metadata is omitted rather than copying an inherited environment.
|
||||
|
||||
This is not a final whole-scope counter: the observer still has to exit. Existing
|
||||
`resource_events_final` and `resource_counters_verified` retain their original
|
||||
meaning and unknown state. The grader's existing full resource gate is unchanged.
|
||||
Earlier runs and source/runtime hashes are not relabeled. Observer CPU/memory and
|
||||
acknowledgement time are included in this new measurement mode; comparable runs
|
||||
must use the same mode. Default commands do not start an observer or add fields.
|
||||
|
||||
One CPU, the unchanged 3 GiB early-stop/4 GiB hard ceiling, no swap, task limits
|
||||
and host-available-memory safeguards remain in force. No resource limit is raised.
|
||||
The opt-in mode requires at least two task slots for observer plus payload;
|
||||
smaller caller-selected ceilings fail before process acquisition. Default mode
|
||||
continues to accept a one-task ceiling.
|
||||
Cleanup uses the uniquely owned systemd scope, without signaling a process merely
|
||||
because a recorded PID exists. Failed scope cleanup retains the named owner.
|
||||
|
||||
## Focused verification
|
||||
|
||||
Five semantic Python cases cover acquisition-free capacity rejection, nonzero exit/kernel facts, missing or malformed
|
||||
receipts, wrong ownership, integer types, contradictory cleanup, lingering actors,
|
||||
foreign symlinks and exclusion of unrelated metadata. They join the existing
|
||||
Python gate; simulated receipts do not establish actual cgroup behavior.
|
||||
|
||||
Actual Linux cgroup/systemd probes additionally verify:
|
||||
|
||||
- Default mode keeps its receipt shape and success status.
|
||||
- Success and exit-code 3 preserve the payload outcome and verify a sole observer.
|
||||
- A bounded 16 MiB Node allocation yields a kernel peak, including work that the
|
||||
100 ms sampler can miss.
|
||||
- A payload leaving a child reports both actors and refuses verification; the
|
||||
supervisor retires the owned scope.
|
||||
- A caller-selected task ceiling of 4 triggers the existing task-limit early stop
|
||||
with exit 125 and an unverified observation.
|
||||
- Interrupting a confirmed-live owned controller preserves failure and retires
|
||||
its scope; missing completion counters are not replaced with zeros.
|
||||
|
||||
These are metering/lifecycle probes, not a new model/provider performance claim.
|
||||
Actual REA workflows and repeated observer-overhead measurements remain necessary
|
||||
before relying on the new mode for domain comparisons. Raw receipts remain in
|
||||
the private experiment lab outside Git.
|
||||
|
||||
## Actual REA and model observations
|
||||
|
||||
Checkpoint `d1f2cfe76df28e6effe973123f2e19313f6d0d4b` repeats real SDK workflows
|
||||
against the unchanged frozen candidate `8bc1601ca51e417ca472d90ea0367e9418a1a0f2`
|
||||
(runtime file-table SHA-256
|
||||
`9e7380f537301bf0cfe2926f5619011af848af7c220750e75189498e65d825e1`).
|
||||
The resource supervisor changes; the compiled REA/provider algorithms do not.
|
||||
Managed pairs use default/observer/observer/default order with the same question,
|
||||
settings, two public calls and identical selected facts. Raw receipts remain
|
||||
private and new measurements do not replace historical resource unknowns.
|
||||
|
||||
| Workflow | SDK milliseconds | Scope seconds | Sampled peak bytes | Kernel peak at payload exit | Payload CPU microseconds |
|
||||
| -------------------- | ---------------: | ------------: | -----------------: | --------------------------: | -----------------------: |
|
||||
| Managed default 1 | 5,168.485 | 11.814 | 525,873,152 | unknown | unknown |
|
||||
| Managed observer 1 | 4,156.708 | 5.358 | 527,777,792 | 535,724,032 | 5,195,457 |
|
||||
| Managed observer 2 | 3,810.362 | 5.056 | 538,742,784 | 539,529,216 | 4,818,497 |
|
||||
| Managed default 2 | 4,263.993 | 5.360 | 526,032,896 | unknown | unknown |
|
||||
| SQLite WASM observer | 6,733.216 | 8.087 | 777,199,616 | 777,199,616 | 7,830,130 |
|
||||
| NewPipe APK observer | 23,162.195 | 24.600 | 1,286,586,368 | 1,287,548,928 | 23,965,627 |
|
||||
|
||||
The WASM and APK runs use actual configured WABT and JADX/Java. Every observer
|
||||
receipt verifies a sole remaining observer, successful payload exit and the
|
||||
expected owned group. No guard abort occurs. The initial default scope timing is
|
||||
an outlier relative to its SDK workflow and later scopes; its cause is not
|
||||
established. Two managed pairs are insufficient to characterize observer overhead
|
||||
or establish a speed/memory improvement. Kernel peak and CPU include the observer.
|
||||
|
||||
One actual Codex CLI 0.161.0 trial uses the original managed question, exact-name
|
||||
guidance, context capture and requested `gpt-5.6-terra` high. It passes selected
|
||||
facts, preserves source bytes, removes its profile and makes three successful MCP
|
||||
calls (including an additional artifact inspection). Reported usage is 61,173
|
||||
input, 48,128 cached, 13,045 uncached and 2,678 output tokens; wall time is 125.798
|
||||
seconds. The payload-exit witness records 812,896,256 kernel peak bytes and
|
||||
8,566,029 CPU microseconds with only the observer alive and zero recorded
|
||||
memory/task limit events at that phase. This confirms the completed model/MCP
|
||||
payload boundary, not a token/time benefit or final whole-scope no-OOM proof.
|
||||
Its full existing grader remains false for unknown terminal physical counters.
|
||||
|
||||
The subsequent review adds supervisor/helper source SHA-256 to opt-in receipts
|
||||
before process acquisition, without adding those fields to default receipts.
|
||||
This distinguishes measurement implementations independently of frozen runtime
|
||||
identity and keeps the observer's phase explicit.
|
||||
@@ -1,18 +1,14 @@
|
||||
"""Run one owned experiment in a bounded, transient Linux systemd scope."""
|
||||
|
||||
import argparse
|
||||
import hashlib
|
||||
import json
|
||||
import os
|
||||
from pathlib import Path
|
||||
import subprocess
|
||||
import sys
|
||||
import tempfile
|
||||
import time
|
||||
import uuid
|
||||
|
||||
from resource_payload import read_observation
|
||||
|
||||
|
||||
def available_bytes():
|
||||
for line in Path('/proc/meminfo').read_text().splitlines():
|
||||
@@ -68,14 +64,10 @@ def stop_owned_scope(unit, process, group):
|
||||
def main():
|
||||
parser = argparse.ArgumentParser()
|
||||
parser.add_argument('--task-ceiling', type=int, default=192)
|
||||
parser.add_argument('--observe-payload-exit', action='store_true',
|
||||
help='Observe payload-exit counters before the cgroup observer exits')
|
||||
parser.add_argument('command', nargs=argparse.REMAINDER)
|
||||
options = parser.parse_args()
|
||||
if options.task_ceiling <= 0:
|
||||
parser.error('--task-ceiling must be positive')
|
||||
if options.observe_payload_exit and options.task_ceiling < 2:
|
||||
parser.error('--observe-payload-exit requires capacity for the observer and payload (at least 2 tasks)')
|
||||
args = options.command
|
||||
if args and args[0] == '--':
|
||||
args = args[1:]
|
||||
@@ -86,41 +78,22 @@ def main():
|
||||
raise SystemExit('Refusing experiment: less than 8 GiB available')
|
||||
unit = 'rea-efficiency-' + uuid.uuid4().hex + '.scope'
|
||||
cpu = max(os.sched_getaffinity(0))
|
||||
receipt_root = tempfile.TemporaryDirectory(prefix='rea-payload-counters-') if options.observe_payload_exit else None
|
||||
receipt_path = Path(receipt_root.name) / 'observation.json' if receipt_root else None
|
||||
release_path = Path(receipt_root.name) / 'release' if receipt_root else None
|
||||
payload = args if receipt_root is None else [
|
||||
sys.executable, str(Path(__file__).with_name('resource_payload.py')),
|
||||
str(receipt_path), str(release_path), unit, *args,
|
||||
]
|
||||
command = [
|
||||
'systemd-run', '--user', '--scope', '--unit=' + unit,
|
||||
'-p', 'MemoryMax=4G', '-p', 'MemoryHigh=3G', '-p', 'MemorySwapMax=0',
|
||||
'-p', 'CPUQuota=100%', '-p', 'TasksMax=' + str(options.task_ceiling),
|
||||
'taskset', '-c', str(cpu), *payload,
|
||||
'taskset', '-c', str(cpu), *args,
|
||||
]
|
||||
observer_sources = {
|
||||
name: hashlib.sha256(Path(__file__).with_name(name).read_bytes()).hexdigest()
|
||||
for name in ['resource-run.py', 'resource_payload.py']
|
||||
} if options.observe_payload_exit else None
|
||||
try:
|
||||
process = subprocess.Popen(command)
|
||||
except BaseException:
|
||||
if receipt_root is not None:
|
||||
receipt_root.cleanup()
|
||||
raise
|
||||
process = subprocess.Popen(command)
|
||||
peak = 0
|
||||
peak_tasks = 0
|
||||
events = {}
|
||||
cpu_stats = {}
|
||||
abort = None
|
||||
final_events = None
|
||||
payload_observation = None
|
||||
payload_group = None
|
||||
code = None
|
||||
group = None
|
||||
started = time.monotonic()
|
||||
try:
|
||||
group = None
|
||||
while process.poll() is None:
|
||||
if group is None:
|
||||
reply = subprocess.run(
|
||||
@@ -131,18 +104,6 @@ def main():
|
||||
path = reply.stdout.strip()
|
||||
if path:
|
||||
group = Path('/sys/fs/cgroup') / path.lstrip('/')
|
||||
if receipt_path is not None and payload_observation is None and group is not None:
|
||||
candidate = read_observation(receipt_path, unit)
|
||||
if candidate is not None:
|
||||
payload_observation = candidate
|
||||
if candidate['control_group'] == str(group.relative_to('/sys/fs/cgroup')):
|
||||
try:
|
||||
actors = [int(x) for x in (group / 'cgroup.procs').read_text().splitlines()]
|
||||
if candidate['observer_pid'] in actors:
|
||||
payload_group = group
|
||||
except (OSError, ValueError):
|
||||
pass
|
||||
release_path.touch(exist_ok=False)
|
||||
current = group / 'memory.current' if group else None
|
||||
if current and current.exists():
|
||||
try:
|
||||
@@ -171,8 +132,6 @@ def main():
|
||||
# Read while the owned group still exists, before wait/cleanup can remove it.
|
||||
final_events = final_resource_events(group)
|
||||
code = process.wait()
|
||||
if receipt_path is not None and payload_observation is None:
|
||||
payload_observation = read_observation(receipt_path, unit)
|
||||
except BaseException:
|
||||
stop_owned_scope(unit, process, group)
|
||||
raise
|
||||
@@ -191,22 +150,7 @@ def main():
|
||||
'resource_events_final': final_events,
|
||||
'resource_counters_verified': final_events is not None,
|
||||
'cpu_stat_last_observed': cpu_stats,
|
||||
**({
|
||||
'payload_resource_observation': payload_observation,
|
||||
'payload_resource_observation_verified': (
|
||||
payload_observation is not None
|
||||
and payload_observation['payload_cleanup_verified']
|
||||
and payload_group is not None and abort is None
|
||||
and code is not None
|
||||
and (payload_observation['payload_exit_code'] if payload_observation['payload_exit_code'] >= 0
|
||||
else 128 - payload_observation['payload_exit_code']) == code
|
||||
),
|
||||
'payload_observation_scope': 'Counters at payload exit while observer remains alive; not final whole-scope counters.',
|
||||
'payload_observer_sources_sha256': observer_sources,
|
||||
} if options.observe_payload_exit else {}),
|
||||
}), file=sys.stderr)
|
||||
if receipt_root is not None:
|
||||
receipt_root.cleanup()
|
||||
raise SystemExit(125 if abort else code)
|
||||
|
||||
|
||||
|
||||
@@ -1,114 +0,0 @@
|
||||
"""Observe a finished payload while its owned cgroup observer is still alive."""
|
||||
|
||||
import json
|
||||
import os
|
||||
from pathlib import Path
|
||||
import subprocess
|
||||
import sys
|
||||
import time
|
||||
|
||||
|
||||
def pairs(path):
|
||||
values = {}
|
||||
for line in path.read_text().splitlines():
|
||||
name, value = line.split()
|
||||
number = int(value)
|
||||
if number < 0 or name in values:
|
||||
raise ValueError('Invalid kernel counter')
|
||||
values[name] = number
|
||||
return values
|
||||
|
||||
|
||||
def snapshot(group, token, code):
|
||||
actors = [int(line) for line in (group / 'cgroup.procs').read_text().splitlines()]
|
||||
observer = os.getpid()
|
||||
return {
|
||||
'phase': 'payload-exited-observer-alive', 'ownership_token': token,
|
||||
'payload_exit_code': code, 'observer_pid': observer,
|
||||
'remaining_processes': actors, 'payload_cleanup_verified': actors == [observer],
|
||||
'resource_events': {name: pairs(group / name)
|
||||
for name in ['memory.events', 'pids.events']},
|
||||
'cpu_stat': pairs(group / 'cpu.stat'),
|
||||
'memory_peak_bytes': int((group / 'memory.peak').read_text()),
|
||||
'control_group': str(group.relative_to('/sys/fs/cgroup')),
|
||||
}
|
||||
|
||||
|
||||
def read_observation(path, token):
|
||||
"""Validate the observer receipt; missing/malformed witnesses stay unknown."""
|
||||
try:
|
||||
if path.is_symlink():
|
||||
return None
|
||||
value = json.loads(path.read_text())
|
||||
if not isinstance(value, dict) or value.get('ownership_token') != token:
|
||||
return None
|
||||
if value.get('phase') != 'payload-exited-observer-alive':
|
||||
return None
|
||||
if not isinstance(value.get('control_group'), str) or not value['control_group']:
|
||||
return None
|
||||
for name in ['payload_exit_code', 'observer_pid', 'memory_peak_bytes']:
|
||||
if type(value.get(name)) is not int:
|
||||
return None
|
||||
if value['observer_pid'] <= 0 or value['memory_peak_bytes'] < 0:
|
||||
return None
|
||||
actors = value.get('remaining_processes')
|
||||
if not isinstance(actors, list) or any(type(x) is not int or x <= 0 for x in actors):
|
||||
return None
|
||||
if type(value.get('payload_cleanup_verified')) is not bool:
|
||||
return None
|
||||
if value['payload_cleanup_verified'] != (actors == [value['observer_pid']]):
|
||||
return None
|
||||
required = {'memory.events': ['high', 'max', 'oom', 'oom_kill'],
|
||||
'pids.events': ['max']}
|
||||
events = value.get('resource_events')
|
||||
if not isinstance(events, dict):
|
||||
return None
|
||||
for name, keys in required.items():
|
||||
record = events.get(name)
|
||||
if not isinstance(record, dict) or any(key not in record for key in keys):
|
||||
return None
|
||||
if any(type(x) is not int or x < 0 for x in record.values()):
|
||||
return None
|
||||
cpu = value.get('cpu_stat')
|
||||
if not isinstance(cpu, dict) or 'usage_usec' not in cpu:
|
||||
return None
|
||||
if any(type(x) is not int or x < 0 for x in cpu.values()):
|
||||
return None
|
||||
names = ['phase', 'ownership_token', 'payload_exit_code', 'observer_pid',
|
||||
'remaining_processes', 'payload_cleanup_verified',
|
||||
'cpu_stat', 'memory_peak_bytes', 'control_group']
|
||||
return {**{name: value[name] for name in names},
|
||||
'resource_events': {name: events[name] for name in required}}
|
||||
except (OSError, ValueError, TypeError):
|
||||
return None
|
||||
|
||||
|
||||
def main():
|
||||
output, release, token = Path(sys.argv[1]), Path(sys.argv[2]), sys.argv[3]
|
||||
command = sys.argv[4:]
|
||||
if not command:
|
||||
raise SystemExit('Missing explicit payload command')
|
||||
child = subprocess.Popen(command)
|
||||
code = child.wait()
|
||||
paths = [line[3:] for line in Path('/proc/self/cgroup').read_text().splitlines()
|
||||
if line.startswith('0::')]
|
||||
try:
|
||||
if len(paths) != 1:
|
||||
raise ValueError('Expected one unified cgroup')
|
||||
group = Path('/sys/fs/cgroup') / paths[0].lstrip('/')
|
||||
observation = snapshot(group, token, code)
|
||||
with os.fdopen(os.open(output, os.O_WRONLY | os.O_CREAT | os.O_EXCL, 0o600),
|
||||
'w') as file:
|
||||
json.dump(observation, file)
|
||||
# Keep the owner alive until its supervisor acknowledges the receipt.
|
||||
# Bound a broken supervisor by the existing ten-second cleanup interval.
|
||||
deadline = time.monotonic() + 10
|
||||
while not release.exists() and time.monotonic() < deadline:
|
||||
time.sleep(0.02)
|
||||
except (OSError, ValueError) as error:
|
||||
print('Payload counter observation unavailable: ' + type(error).__name__, file=sys.stderr)
|
||||
raise SystemExit(code if code >= 0 else 128 - code)
|
||||
|
||||
|
||||
if __name__ == '__main__':
|
||||
main()
|
||||
@@ -52,24 +52,9 @@ def named_scope(value, names):
|
||||
return {'conflicting_reported_scopes': selected}
|
||||
|
||||
|
||||
def scope_with_verified_counts(value, expected_scope, returned_counts):
|
||||
"""Validate explicit extra row counts; never erase unknown or conflicting facts."""
|
||||
if not isinstance(value, dict):
|
||||
return value, {}
|
||||
scope = dict(value)
|
||||
checks = {}
|
||||
for name, expected in returned_counts.items():
|
||||
if name in scope:
|
||||
reported = scope[name]
|
||||
checks[name] = type(reported) is int and reported == expected
|
||||
if name not in expected_scope:
|
||||
del scope[name]
|
||||
return scope, checks
|
||||
|
||||
|
||||
def main():
|
||||
parser = argparse.ArgumentParser()
|
||||
parser.add_argument('--domain', choices=['wasm', 'evm', 'android', 'flutter-aot', 'sqlite', 'managed', 'managed-nonempty', 'firmware', 'inventory', 'javascript', 'native', 'browser'], required=True)
|
||||
parser.add_argument('--domain', choices=['wasm', 'evm', 'android', 'managed', 'managed-nonempty', 'firmware', 'inventory', 'javascript', 'native', 'browser'], required=True)
|
||||
parser.add_argument('--trial', type=Path, required=True)
|
||||
parser.add_argument('--reference', type=Path)
|
||||
parser.add_argument('--resource-log', type=Path, required=True)
|
||||
@@ -133,14 +118,6 @@ def main():
|
||||
for key, expected in {'artifact_bytes': n['artifact']['bytes'], 'bytecode_sha256': n['bytecode']['sha256'], 'bytecode_bytes': n['bytecode']['bytes'], 'functions': n['functions'], 'evidence_kind': n['evidence_kind'], 'discovery_completeness': n['discovery_completeness'], 'runtime_execution': n['runtime_execution'], 'bytecode_kind': n['bytecode']['kind'], 'hardfork': n['bytecode']['hardfork'], 'deployment_authenticity': n['bytecode']['deployment_authenticity']}.items():
|
||||
check(key, answer.get(key), expected)
|
||||
check('evm_original_limitations', answer.get('limitations'), n['limitations'])
|
||||
elif domain == 'sqlite':
|
||||
for key in ['artifact', 'wal', 'engine', 'database_encoding', 'schema', 'rows', 'producer_limitations', 'limitations']:
|
||||
# Missing is not SQL/JSON null; booleans are not numeric counters.
|
||||
check(key, (key in answer, json.dumps(answer.get(key), sort_keys=True)),
|
||||
(True, json.dumps(reference[key], sort_keys=True)))
|
||||
elif domain == 'flutter-aot':
|
||||
for key in ['target', 'abi', 'libapp', 'string_pool', 'coverage', 'limitations']:
|
||||
check(key, answer.get(key), reference[key])
|
||||
elif domain == 'android':
|
||||
for key in ['package_name', 'version_name', 'version_code', 'matches']:
|
||||
check(key, answer.get(key), reference[key])
|
||||
@@ -157,13 +134,7 @@ def main():
|
||||
for key in ['module_refs', 'pinvoke_imports']:
|
||||
check(key, answer.get('native_boundaries', {}).get(key), reference['boundaries'][key])
|
||||
check('artifact_coverage', named_scope(answer.get('coverage'), ['artifact', 'managed_artifact', 'managed_metadata']), n['coverage'])
|
||||
boundary_scope, counts = scope_with_verified_counts(
|
||||
named_scope(answer.get('coverage'), ['native_boundaries', 'native_boundary_declarations']),
|
||||
reference['boundaries']['coverage'],
|
||||
{'module_ref_count': len(reference['boundaries']['module_refs']),
|
||||
'pinvoke_import_count': len(reference['boundaries']['pinvoke_imports'])})
|
||||
check('native_boundaries_coverage', boundary_scope, reference['boundaries']['coverage'])
|
||||
checks.update({'native_coverage_' + name: valid for name, valid in counts.items()})
|
||||
check('native_boundaries_coverage', named_scope(answer.get('coverage'), ['native_boundaries', 'native_boundary_declarations']), reference['boundaries']['coverage'])
|
||||
elif domain == 'managed-nonempty':
|
||||
n = reference['boundaries']
|
||||
check('module_mvid', answer.get('module_mvid'), n['module']['mvid'])
|
||||
|
||||
@@ -1,181 +0,0 @@
|
||||
# SQLite existing-control measurements
|
||||
|
||||
Continues [#2016](https://github.com/morluto/rea/issues/2016) after the Flutter
|
||||
lane. The measured main runtime is pinned to
|
||||
`172407787f1842dedbcd27b5385177595f786ce4`. Its only post-Flutter
|
||||
commit repairs Windows transient runtime admission (#2467); this Linux round
|
||||
does not establish Windows performance. No production/API change is proposed
|
||||
merely because another summary or cache could be added.
|
||||
|
||||
Before PR integration, main advanced to
|
||||
`bb540826d65316c164d2de8ba4ef10f81a8ad073`. Its five intervening commits cover
|
||||
MCP archive contracts/documentation, an advertised-schema inventory test,
|
||||
pwntools cleanup identity, concurrent Mach-O slice inspection, and transient
|
||||
DMG verification retries. None changes the SQLite selector. Rebase and current
|
||||
main verification do not relabel the frozen measurements below.
|
||||
|
||||
The committed post-format driver passes a real SDK smoke against the frozen
|
||||
runtime. After rebase, a fresh build, real all/selected-column SDK pair and docs
|
||||
check pass on the updated main. Selected facts match each other and the frozen
|
||||
runtime; artifact bytes remain unchanged. These are integration checks, not
|
||||
additional model performance pairs.
|
||||
|
||||
## Real application data and question
|
||||
|
||||
Use QGIS's bundled `world_map.gpkg`, unmodified from official immutable source
|
||||
commit `e1223b8e9e71fc50ee995ed556f711c54ccc101b`. `corpus.json` pins its URL,
|
||||
12,914,688-byte size, Git blob `c9ff80228dff0de93c9acdef16a97545ba360244`, and
|
||||
SHA-256 `01d293159d1b77bd9212b5252587853f61aa9e25b2387135f34afaba8d057190`.
|
||||
Streaming acquisition matches the upstream blob. The upstream resource install
|
||||
list includes `data/*`; [its README](https://github.com/qgis/QGIS/blob/e1223b8e9e71fc50ee995ed556f711c54ccc101b/resources/data/README_world_map.md)
|
||||
records data provenance. This is shipped application data, not a generated REA
|
||||
fixture. QGIS is neither installed nor executed.
|
||||
|
||||
The source question asks for the complete returned `countries` table schema
|
||||
and one sample's `fid`, `NAME`, `ISO_A3` tagged cells, in that order. It preserves
|
||||
database/WAL identity, engine/encoding, exact original SQL and columns, integer
|
||||
strings, text bytes, nulls, row limit/count, unspecified order, truncation and
|
||||
both producer/outer limitations. It does not require geometry blobs or a full
|
||||
country inventory. Neither political labels nor the sampled ordering are
|
||||
inferred to be current or globally exhaustive.
|
||||
|
||||
SQLite already defaults to compact schema inventory without a table, detailed
|
||||
selected-table schema with a table, and exposes exact `columns`. Selecting
|
||||
columns avoids constructing unrelated cells without changing the requested
|
||||
table schema. Thus compare existing all-visible columns against exact columns
|
||||
on the same main runtime, rather than changing an old user's default or adding
|
||||
a new delivery mechanism. Inventory scope cannot substitute for the detailed
|
||||
schema requested by this question.
|
||||
|
||||
## Public SDK observations
|
||||
|
||||
Frozen runtime: main `172407787f1842dedbcd27b5385177595f786ce4`, compiled
|
||||
dist/bridge file-table SHA-256
|
||||
`72a4ac6c6db491c455f3e4a798f8f52ed5850c08831e7cdc9f25c1525a5a1d11`.
|
||||
Node 24.18.0, SDK client/server 2.3.1, observed SQLite 3.53.1, WAL null. Driver,
|
||||
provider settings/search-path fingerprints, artifact and locked dependencies
|
||||
remain equal. Each workflow starts a fresh server and validates the selected
|
||||
actual advertised schema. Host page caches are not flushed.
|
||||
|
||||
The initial default inventory returns 26 table entries, including explicit
|
||||
virtual/shadow classifications, no rows and `not_requested` column details:
|
||||
27,185 compact client-result JSON bytes. Selecting `countries` reveals eight
|
||||
columns, including a geometry blob. Its one-row full reply is 485,277 bytes.
|
||||
The selected request retains every requested declared-schema field and exact
|
||||
tagged sample values while omitting unrelated sample cells.
|
||||
|
||||
| Trial | Reply bytes | SDK workflow seconds | Payload CPU seconds | Kernel peak bytes |
|
||||
| ------------- | ----------: | -------------------: | ------------------: | ----------------: |
|
||||
| sdk-all-1 | 485,277 | 11.820 | 12.755 | 562,884,608 |
|
||||
| sdk-columns-1 | 18,509 | 14.017 | 13.715 | 557,510,656 |
|
||||
| sdk-columns-2 | 18,509 | 15.826 | 14.162 | 548,343,808 |
|
||||
| sdk-all-2 | 485,277 | 5.679 | 7.310 | 561,704,960 |
|
||||
|
||||
Both pairs make one successful call, pass settings/selected-fact comparison,
|
||||
retain complete original schema and all requested typed cells, and preserve
|
||||
source bytes. Reply bytes fall about 96.2%. These observations **do not show SDK
|
||||
speed or CPU improvement**: selected workflows are slower in both pairs and
|
||||
timing varies substantially. No cause is inferred from these data. Payload CPU
|
||||
includes runner/catalog work outside the SDK workflow timer. Memory changes
|
||||
are small and do not establish a general reduction. Raw replies and the exact
|
||||
pre-format driver source are archived privately.
|
||||
|
||||
Reproduce with `measure.mjs --artifact qgis-world-map.gpkg` and
|
||||
`--sqlite-selection all|columns`, using the same `--runtime-root`, `--revision`,
|
||||
artifact path and `--schemas selected`. `--delivery` stays `complete`; this is
|
||||
an existing request selection, not a new summary API. Original caller arguments
|
||||
and schemas remain in the private receipts. The source question is
|
||||
`questions/sqlite-qgis.txt` and the selected factual grader is
|
||||
`review-model.py --domain sqlite`.
|
||||
|
||||
## Decision and scope
|
||||
|
||||
The initial four actual Codex attempts never executed SQLite: the client rejected
|
||||
the tool because its private snapshot writes require approval and the isolated
|
||||
driver lacked this exact tool's approval override. Every factual grade fails;
|
||||
these are failed client attempts, not completed-task performance comparisons.
|
||||
All profiles are removed. The existing experiment-only per-tool approval list
|
||||
now includes `inspect_sqlite_database`; each corrected trial exposes only that
|
||||
exact enabled tool. REA annotations, target authority and global Codex configuration
|
||||
are unchanged. The [official configuration reference](https://learn.chatgpt.com/docs/config-file/config-reference)
|
||||
documents the per-tool override. Corrected cohorts use fresh output directories
|
||||
and retain the original failures separately.
|
||||
|
||||
Actual repeated Codex comparisons determine the task token/time benefit before
|
||||
crediting smaller replies. An existing selector that answers the question is
|
||||
evidence against adding another production mechanism. Keep negative outcomes
|
||||
and unavailable coverage, including failure/retry costs and profile cleanup.
|
||||
|
||||
Four corrected serial trials use Codex CLI 0.161.0, requested `gpt-5.6-terra`
|
||||
high, one enabled tool, identical owned context/discovery capture, and the same
|
||||
frozen main runtime. The requested alias is not a verified server-resolved model.
|
||||
Equal treatment instructions select the existing all-visible or exact-column
|
||||
request; the source question and requested schema/sample facts stay fixed.
|
||||
|
||||
| Corrected trial | Input | Cached | Uncached | Output | Seconds | MCP calls | Facts |
|
||||
| ------------------------ | -----: | -----: | -------: | -----: | ------: | --------: | ----- |
|
||||
| approved-model-all-1 | 88,131 | 52,480 | 35,651 | 3,369 | 84.007 | 2 | pass |
|
||||
| approved-model-columns-1 | 37,340 | 20,992 | 16,348 | 3,006 | 87.514 | 1 | pass |
|
||||
| approved-model-columns-2 | 56,148 | 36,096 | 20,052 | 3,298 | 97.466 | 2 | pass |
|
||||
| approved-model-all-2 | 88,340 | 52,480 | 35,860 | 3,084 | 113.847 | 2 | pass |
|
||||
|
||||
Both pairs pass every selected producer fact, exact SQL/schema/null/tagged
|
||||
cells, observed response Evidence IDs, target-byte preservation and profile
|
||||
cleanup. The grader checks producer observations, not independent geometry
|
||||
semantics. Actual events contain only the chosen MCP tool and agent messages;
|
||||
no shell or other agent execution appears. Usage is the final aggregate actually
|
||||
reported by the CLI, one usage record per trial; cached input remains included
|
||||
in total input. Output includes 853 / 357 / 523 / 664 reasoning tokens.
|
||||
|
||||
Total input falls **57.63% / 36.44%**, uncached input **54.14% / 44.08%**.
|
||||
Time is mixed: columns are **4.17% slower** in pair 1 and **14.39% faster** in
|
||||
pair 2. Output is 10.77% lower / 6.94% higher. Repeated calls remain counted;
|
||||
pair 1 has two all-column calls versus one selected call, while pair 2 has two
|
||||
calls on both sides. This supports scoped token savings from using the existing
|
||||
selector, not a dependable speedup or a new API requirement. Client context and
|
||||
usage are observed separately from raw SDK reply bytes.
|
||||
|
||||
Model payload CPU seconds / kernel peaks are 7.596 / 763,838,464;
|
||||
7.772 / 761,143,296; 8.409 / 762,597,376; and 11.759 / 774,025,216. CPU is mixed
|
||||
and memory differences are small. Payload cleanup/limit observations pass;
|
||||
missing terminal counters keep every strict whole-resource grade false.
|
||||
|
||||
The original blocked attempts remain separate and never provide comparison
|
||||
denominators. They each have one failed call, no SQLite result and failed facts:
|
||||
|
||||
| Blocked trial | Input | Cached | Uncached | Output | Seconds |
|
||||
| --------------- | -----: | -----: | -------: | -----: | ------: |
|
||||
| model-all-1 | 35,290 | 29,952 | 5,338 | 798 | 59.881 |
|
||||
| model-columns-1 | 35,356 | 22,016 | 13,340 | 670 | 44.764 |
|
||||
| model-columns-2 | 35,034 | 20,992 | 14,042 | 639 | 30.007 |
|
||||
| model-all-2 | 35,104 | 20,992 | 14,112 | 673 | 25.132 |
|
||||
|
||||
**Decision: no production/API change.** Existing column selection materially
|
||||
reduces unnecessary delivery and actual model input while retaining the complete
|
||||
requested schema and exact cells. Existing documentation already recommends
|
||||
table/column selection. No additional summary, schema-scope default change,
|
||||
automatic field omission, plugin layer or cross-session cache is justified by
|
||||
these results. Preserve the negative/mixed time, output and CPU findings.
|
||||
|
||||
Real one-shot CLI inventory, all-column sample and exact-column sample match
|
||||
the corresponding full MCP normalized results, subjects, parameters and IDs;
|
||||
the source digest remains unchanged. An independent Python binding using SQLite
|
||||
3.40.1 opens this immutable artifact read-only and agrees with the exact stored
|
||||
table SQL, eight declared columns and selected tagged sample cells. This is a
|
||||
second engine/binding observation of this file, not a general row-order or
|
||||
geometry-semantics guarantee. The six existing context/driver regression tests
|
||||
pass; Python compilation and JavaScript syntax checks pass. No new product test
|
||||
or production implementation is added for this measurement-only finding.
|
||||
|
||||
Manual review tightens the SQLite grader to distinguish missing fields from
|
||||
explicit null and preserve JSON scalar types. Regrading all four stored model
|
||||
answers still passes every selected fact; deliberate omission of `wal` and a
|
||||
boolean substituted for numeric `row_limit` both fail. Original transcripts,
|
||||
usage and previous review receipts stay intact; no model trial is rerun.
|
||||
|
||||
Heavy tasks remain serial under one CPU, unchanged 3 GiB early stop / 4 GiB hard
|
||||
memory, no swap, owned task scopes and host guards. SDK payload observations
|
||||
verify cleanup and zero phase limit events; final whole-scope counters remain
|
||||
unknown. This does not establish live/WAL atomicity, all SQLite applications,
|
||||
other runtimes/platforms or geospatial geometry semantics. Other packet/signal
|
||||
and capture lanes remain incremental follow-ups using their existing controls.
|
||||
@@ -1,175 +0,0 @@
|
||||
"""Distinct capture/cleanup failures; simulated CLI is not real-model evidence."""
|
||||
|
||||
import importlib.util
|
||||
import io
|
||||
import json
|
||||
import os
|
||||
import runpy
|
||||
import sys
|
||||
from pathlib import Path
|
||||
import tempfile
|
||||
import unittest
|
||||
from unittest.mock import Mock, patch
|
||||
|
||||
from codex_context import capture_tool_context, selected_event
|
||||
|
||||
|
||||
class ManagedCoverageTests(unittest.TestCase):
|
||||
def test_verifies_extra_counts_and_preserves_unknown_fields(self):
|
||||
review = runpy.run_path(str(Path(__file__).with_name('review-model.py')))
|
||||
project = review['scope_with_verified_counts']
|
||||
expected = {'state': 'partial', 'issues': ['unreturned rows remain unknown']}
|
||||
original = {**expected, 'module_ref_count': 0, 'pinvoke_import_count': 2}
|
||||
scope, checks = project(original, expected, {'module_ref_count': 0, 'pinvoke_import_count': 2})
|
||||
self.assertEqual(scope, expected)
|
||||
self.assertTrue(all(checks.values()))
|
||||
self.assertEqual(original['pinvoke_import_count'], 2)
|
||||
for count in [3, '2', True]:
|
||||
scope, checks = project({**expected, 'pinvoke_import_count': count}, expected, {'pinvoke_import_count': 2})
|
||||
self.assertFalse(checks['pinvoke_import_count'])
|
||||
_, checks = project({**expected, 'module_ref_count': False}, {**expected, 'module_ref_count': 0}, {'module_ref_count': 0})
|
||||
self.assertFalse(checks['module_ref_count'])
|
||||
scope, _ = project({**expected, 'unsupported_claim': True}, expected, {})
|
||||
self.assertNotEqual(scope, expected)
|
||||
scope, _ = project({'state': 'partial', 'module_ref_count': 0}, expected, {'module_ref_count': 0})
|
||||
self.assertNotEqual(scope, expected)
|
||||
ambiguous = review['named_scope']({'native_boundaries': expected, 'native_boundary_declarations': {'state': 'complete'}}, ['native_boundaries', 'native_boundary_declarations'])
|
||||
scope, _ = project(ambiguous, expected, {'module_ref_count': 0})
|
||||
self.assertNotEqual(scope, expected)
|
||||
|
||||
|
||||
class ContextCaptureTests(unittest.TestCase):
|
||||
def test_filters_ambient_account_and_nested_usage_state(self):
|
||||
with tempfile.TemporaryDirectory() as directory:
|
||||
root = Path(directory)
|
||||
home = root / 'home'
|
||||
sessions = home / 'sessions'
|
||||
sessions.mkdir(parents=True)
|
||||
output = root / 'output'
|
||||
output.mkdir()
|
||||
events = [
|
||||
{'type': 'world_state', 'payload': {'state': {'env': 'ambient-marker'}}},
|
||||
{'type': 'session_meta', 'payload': {'creator_account_id': 'account-marker'}},
|
||||
{'type': 'response_item', 'payload': {
|
||||
'type': 'custom_tool_call_output', 'call_id': 'original-call',
|
||||
'output': 'caller-selected evidence and paths',
|
||||
'internal_chat_message_metadata_passthrough': 'private-marker'}},
|
||||
{'type': 'token_usage_record', 'payload': {
|
||||
'response_id': 'original-response', 'usage': {
|
||||
'input_tokens': 12, 'cached_input_tokens': 4,
|
||||
'environment': 'nested-ambient-marker'},
|
||||
'transport_auth': 'auth-marker'}},
|
||||
]
|
||||
(sessions / 'rollout.jsonl').write_text(''.join(json.dumps(x) + '\n' for x in events))
|
||||
(home / 'auth.json').write_text('copied-credential-marker')
|
||||
receipt = capture_tool_context(home, output)
|
||||
text = (output / 'codex-tool-context.jsonl').read_text()
|
||||
self.assertEqual(receipt['status'], 'captured')
|
||||
self.assertEqual(receipt['retained_events'], 2)
|
||||
for marker in ['ambient-marker', 'account-marker', 'private-marker',
|
||||
'auth-marker', 'copied-credential-marker']:
|
||||
self.assertNotIn(marker, text)
|
||||
self.assertIn('caller-selected evidence and paths', text)
|
||||
self.assertIn('original-response', text)
|
||||
self.assertEqual((output / 'codex-tool-context.jsonl').stat().st_mode & 0o777, 0o600)
|
||||
|
||||
def test_missing_rollouts_are_unknown_and_malformed_lines_remain_partial(self):
|
||||
with tempfile.TemporaryDirectory() as directory:
|
||||
root = Path(directory)
|
||||
output = root / 'missing'
|
||||
output.mkdir()
|
||||
self.assertEqual(capture_tool_context(root / 'home', output)['status'], 'unavailable')
|
||||
sessions = root / 'home' / 'sessions'
|
||||
sessions.mkdir(parents=True)
|
||||
(sessions / 'rollout.jsonl').write_text('not-json\n' + json.dumps({
|
||||
'type': 'event_msg', 'payload': {'type': 'token_count', 'info': None}}) + '\n')
|
||||
partial = root / 'partial'
|
||||
partial.mkdir()
|
||||
receipt = capture_tool_context(root / 'home', partial)
|
||||
self.assertEqual(receipt['status'], 'partial')
|
||||
self.assertEqual(receipt['errors'][0]['line'], 1)
|
||||
self.assertEqual(receipt['retained_events'], 1)
|
||||
with self.assertRaises(ValueError):
|
||||
selected_event({'type': 'token_usage_record', 'payload': {'usage': {'input_tokens': True}}})
|
||||
with self.assertRaises(ValueError):
|
||||
selected_event({'type': {'environment': 'unexpected'}, 'payload': {}})
|
||||
with self.assertRaises(ValueError):
|
||||
selected_event({'type': 'response_item', 'timestamp': {'environment': 'unexpected'}, 'payload': {}})
|
||||
unknown = selected_event({'type': 'event_msg', 'payload': {'type': 'token_count', 'info': {'model_context_window': None}}})
|
||||
self.assertIsNone(unknown['payload']['info']['model_context_window'])
|
||||
|
||||
def test_capture_failure_still_removes_trial_credentials_and_profile(self):
|
||||
spec = importlib.util.spec_from_file_location('agent_trial', Path(__file__).with_name('agent-trial.py'))
|
||||
agent = importlib.util.module_from_spec(spec)
|
||||
spec.loader.exec_module(agent)
|
||||
with tempfile.TemporaryDirectory() as directory:
|
||||
root = Path(directory)
|
||||
runtime = root / 'runtime'
|
||||
(runtime / 'scripts').mkdir(parents=True)
|
||||
(runtime / 'scripts' / 'rea.mjs').write_text('')
|
||||
(runtime / 'package-lock.json').write_text('{}')
|
||||
auth_home = root / 'source-auth'
|
||||
auth_home.mkdir()
|
||||
(auth_home / 'auth.json').write_text('synthetic-credential')
|
||||
question = root / 'question.txt'
|
||||
question.write_text('Observe the declared fixture.')
|
||||
output = root / 'trial'
|
||||
child = Mock(stdin=io.StringIO())
|
||||
child.wait.return_value = 0
|
||||
arguments = ['agent-trial.py', '--runtime-root', str(runtime), '--revision', 'fixture',
|
||||
'--prompt', str(question), '--output', str(output), '--capture-tool-context']
|
||||
with patch.dict(os.environ, {'CODEX_HOME': str(auth_home)}, clear=True), \
|
||||
patch.object(sys, 'argv', arguments), \
|
||||
patch.object(agent.shutil, 'which', return_value='/fixture/node'), \
|
||||
patch.object(agent.subprocess, 'check_output', return_value='v24.18.0\n'), \
|
||||
patch.object(agent.subprocess, 'Popen', return_value=child), \
|
||||
patch.object(agent, 'capture_tool_context', side_effect=OSError('fixture capture failure')), \
|
||||
patch('builtins.print'):
|
||||
with self.assertRaisesRegex(OSError, 'fixture capture failure'):
|
||||
agent.main()
|
||||
self.assertFalse(list(output.glob('profile-*')))
|
||||
self.assertTrue(json.loads((output / 'cleanup.json').read_text())['profile_removed'])
|
||||
self.assertEqual((auth_home / 'auth.json').read_text(), 'synthetic-credential')
|
||||
|
||||
def test_refuses_foreign_session_directory_and_symlink_records(self):
|
||||
with tempfile.TemporaryDirectory() as directory:
|
||||
root = Path(directory)
|
||||
home = root / 'home'
|
||||
home.mkdir()
|
||||
foreign = root / 'foreign'
|
||||
foreign.mkdir()
|
||||
(foreign / 'rollout.jsonl').write_text('private marker')
|
||||
(home / 'sessions').symlink_to(foreign, target_is_directory=True)
|
||||
output = root / 'directory-result'
|
||||
output.mkdir()
|
||||
receipt = capture_tool_context(home, output)
|
||||
self.assertEqual(receipt['status'], 'partial')
|
||||
self.assertEqual(receipt['retained_events'], 0)
|
||||
(home / 'sessions').unlink()
|
||||
(home / 'sessions').mkdir()
|
||||
(home / 'sessions' / 'linked.jsonl').symlink_to(foreign / 'rollout.jsonl')
|
||||
output = root / 'file-result'
|
||||
output.mkdir()
|
||||
receipt = capture_tool_context(home, output)
|
||||
self.assertEqual(receipt['status'], 'partial')
|
||||
self.assertEqual(receipt['errors'][0]['reason'], 'not_an_owned_regular_file')
|
||||
self.assertEqual((foreign / 'rollout.jsonl').read_text(), 'private marker')
|
||||
|
||||
def test_guidance_requires_selected_tools_before_acquiring_a_profile(self):
|
||||
spec = importlib.util.spec_from_file_location('agent_trial', Path(__file__).with_name('agent-trial.py'))
|
||||
agent = importlib.util.module_from_spec(spec)
|
||||
spec.loader.exec_module(agent)
|
||||
with tempfile.TemporaryDirectory() as directory:
|
||||
root = Path(directory)
|
||||
output = root / 'trial'
|
||||
arguments = ['agent-trial.py', '--runtime-root', str(root), '--revision', 'fixture',
|
||||
'--prompt', str(root / 'question'), '--output', str(output), '--guide-enabled-tools']
|
||||
with patch.object(sys, 'argv', arguments), patch.object(sys, 'stderr', io.StringIO()):
|
||||
with self.assertRaises(SystemExit) as raised:
|
||||
agent.main()
|
||||
self.assertEqual(raised.exception.code, 2)
|
||||
self.assertFalse(output.exists())
|
||||
|
||||
|
||||
if __name__ == '__main__':
|
||||
unittest.main()
|
||||
@@ -1,103 +0,0 @@
|
||||
"""Receipt semantics; real systemd/cgroup workflows are verified separately."""
|
||||
|
||||
import json
|
||||
import importlib.util
|
||||
import io
|
||||
from pathlib import Path
|
||||
import sys
|
||||
import tempfile
|
||||
import unittest
|
||||
from unittest.mock import patch
|
||||
|
||||
from resource_payload import read_observation
|
||||
|
||||
|
||||
def receipt():
|
||||
return {
|
||||
'phase': 'payload-exited-observer-alive', 'ownership_token': 'own-unit',
|
||||
'payload_exit_code': 3, 'observer_pid': 100, 'remaining_processes': [100],
|
||||
'payload_cleanup_verified': True, 'memory_peak_bytes': 123,
|
||||
'control_group': 'user.slice/own-unit.scope',
|
||||
'resource_events': {'memory.events': {'high': 0, 'max': 0, 'oom': 0, 'oom_kill': 0},
|
||||
'pids.events': {'max': 0}},
|
||||
'cpu_stat': {'usage_usec': 1000},
|
||||
}
|
||||
|
||||
|
||||
class PayloadObservationTests(unittest.TestCase):
|
||||
def test_observer_capacity_failure_precedes_any_process_acquisition(self):
|
||||
spec = importlib.util.spec_from_file_location('resource_run', Path(__file__).with_name('resource-run.py'))
|
||||
module = importlib.util.module_from_spec(spec)
|
||||
spec.loader.exec_module(module)
|
||||
arguments = ['resource-run.py', '--observe-payload-exit', '--task-ceiling', '1', '--', 'payload']
|
||||
with patch.object(sys, 'argv', arguments), patch.object(sys, 'stderr', io.StringIO()), \
|
||||
patch.object(module.subprocess, 'Popen') as spawn:
|
||||
with self.assertRaises(SystemExit) as failure:
|
||||
module.main()
|
||||
self.assertEqual(failure.exception.code, 2)
|
||||
spawn.assert_not_called()
|
||||
|
||||
def test_preserves_nonzero_status_kernel_peak_and_nonzero_events(self):
|
||||
with tempfile.TemporaryDirectory() as directory:
|
||||
path = Path(directory) / 'receipt.json'
|
||||
value = receipt()
|
||||
value['resource_events']['memory.events']['oom'] = 1
|
||||
path.write_text(json.dumps(value))
|
||||
observed = read_observation(path, 'own-unit')
|
||||
self.assertEqual(observed['payload_exit_code'], 3)
|
||||
self.assertEqual(observed['memory_peak_bytes'], 123)
|
||||
self.assertEqual(observed['resource_events']['memory.events']['oom'], 1)
|
||||
|
||||
def test_rejects_missing_malformed_wrong_owner_and_inconsistent_cleanup(self):
|
||||
with tempfile.TemporaryDirectory() as directory:
|
||||
path = Path(directory) / 'receipt.json'
|
||||
self.assertIsNone(read_observation(path, 'own-unit'))
|
||||
path.write_text('incomplete-json')
|
||||
self.assertIsNone(read_observation(path, 'own-unit'))
|
||||
cases = []
|
||||
for key, invalid in [('ownership_token', 'other-unit'), ('observer_pid', True),
|
||||
('memory_peak_bytes', -1), ('remaining_processes', [100, 101]),
|
||||
('payload_cleanup_verified', 'true'), ('phase', 'scope-exited')]:
|
||||
value = receipt()
|
||||
value[key] = invalid
|
||||
cases.append(value)
|
||||
value = receipt()
|
||||
del value['resource_events']['memory.events']['oom']
|
||||
cases.append(value)
|
||||
value = receipt()
|
||||
value['cpu_stat']['usage_usec'] = False
|
||||
cases.append(value)
|
||||
for value in cases:
|
||||
with self.subTest(value=value):
|
||||
path.write_text(json.dumps(value))
|
||||
self.assertIsNone(read_observation(path, 'own-unit'))
|
||||
|
||||
def test_retains_lingering_actor_facts_without_certifying_cleanup(self):
|
||||
with tempfile.TemporaryDirectory() as directory:
|
||||
path = Path(directory) / 'receipt.json'
|
||||
value = receipt()
|
||||
value['remaining_processes'].append(101)
|
||||
value['payload_cleanup_verified'] = False
|
||||
path.write_text(json.dumps(value))
|
||||
observed = read_observation(path, 'own-unit')
|
||||
self.assertEqual(observed['remaining_processes'], [100, 101])
|
||||
self.assertFalse(observed['payload_cleanup_verified'])
|
||||
|
||||
def test_excludes_unrelated_metadata_and_foreign_symlinks(self):
|
||||
with tempfile.TemporaryDirectory() as directory:
|
||||
path = Path(directory) / 'receipt.json'
|
||||
value = receipt()
|
||||
value['environment'] = {'ambient': 'excluded'}
|
||||
value['resource_events']['unrelated'] = {'ambient': 'excluded'}
|
||||
path.write_text(json.dumps(value))
|
||||
observed = read_observation(path, 'own-unit')
|
||||
self.assertNotIn('environment', observed)
|
||||
self.assertNotIn('unrelated', observed['resource_events'])
|
||||
link = Path(directory) / 'linked.json'
|
||||
link.symlink_to(path)
|
||||
self.assertIsNone(read_observation(link, 'own-unit'))
|
||||
self.assertEqual(json.loads(path.read_text()), value)
|
||||
|
||||
|
||||
if __name__ == '__main__':
|
||||
unittest.main()
|
||||
@@ -1,69 +0,0 @@
|
||||
# Windows empty-profile startup verification
|
||||
|
||||
Follow-up to [#2345](https://github.com/morluto/rea/pull/2345), including
|
||||
@gefrezim's diagnosis of the import-time Windows home lookup.
|
||||
|
||||
## Source and boundary
|
||||
|
||||
Baseline: main `172407787f1842dedbcd27b5385177595f786ce4`. Verification used
|
||||
the real Windows 11 10.0.22631.0 host, official Windows x64 Node 24.18.0,
|
||||
locked production dependencies and REA's compiled public CLI / SDK 2.3.1 MCP
|
||||
server. No IDA or Ghidra engine was used. Runtime copies and compact receipts
|
||||
live outside the checkout; no account profile path or ambient environment is
|
||||
recorded here.
|
||||
|
||||
The tested dispatcher SHA-256 is
|
||||
`526105418604cc6e5a202a6275b700814e27450bfaffd45e7510530ba669de8d`.
|
||||
Only the dispatcher changed in the deployed runtime. It treats an empty Windows
|
||||
`USERPROFILE` as unset before dependency imports. Nonempty selections continue
|
||||
to reach the existing home resolver; no additional lookup or fallback owner is
|
||||
introduced.
|
||||
|
||||
## Real Windows observations
|
||||
|
||||
With `HOME` empty in each case, the baseline produced:
|
||||
|
||||
| USERPROFILE selection | `--version` | `--help` | MCP discovery |
|
||||
| --------------------------- | ----------------------- | ----------------------- | ------------- |
|
||||
| Unset | Exit 0 | Exit 0 | Healthy |
|
||||
| Empty | Exit 1, `uv_os_homedir` | Exit 1, `uv_os_homedir` | Healthy |
|
||||
| Nonempty test-owned profile | Exit 0 | Exit 0 | Healthy |
|
||||
|
||||
The corrected CLI passed all six invocations with no stderr. Version output
|
||||
remained 6 bytes and help output 15,497 bytes. Real setup dry runs with empty
|
||||
and nonempty profile selections both exited 0, planned their configuration
|
||||
under the expected home, preserved existing configuration bytes and created no
|
||||
configuration under the working directory. No installation was performed.
|
||||
|
||||
MCP was already healthy in the baseline; this change does not claim to repair
|
||||
an MCP startup failure. Complete baseline discovery was 187 tools and 2,545,790
|
||||
serialized bytes, SHA-256
|
||||
`1e6bbca7f62852134eb703ea098f5a302d1fe333b8433475429f6fc1b1aba18f`.
|
||||
All three corrected MCP controls also passed with no stderr and the same
|
||||
catalogue bytes and digest.
|
||||
|
||||
The existing `homeDirectoryFallback` acceptance test exercises the import-time
|
||||
failure through the public setup dry run. Adding it to the Windows curated lane
|
||||
makes that regression execute on the affected platform. No duplicate startup
|
||||
test was retained. Nine related tests passed, including the existing MCP doctor
|
||||
and curated-lane path checks; Linux passing alone does not prove Windows behavior.
|
||||
Review caught a missing package-scope registration for the newly listed test;
|
||||
the original CI shard failed that ownership invariant. The path is now also
|
||||
registered in `scripts/ci/scopes.mjs`, and all 84 scope checks plus the two
|
||||
curated-path checks pass. Runtime source and its tested digest are unchanged.
|
||||
|
||||
## Efficiency and resource limits
|
||||
|
||||
Heavy host probes ran serially at BelowNormal priority, with one CPU and a
|
||||
512 MiB CLI/server heap setting (256 MiB for the probe parent). Heap settings do
|
||||
not bound total process memory. An exit-time `process.resourceUsage()` observer
|
||||
recorded individual corrected CLI invocations: CPU time ranged from 7.968 to
|
||||
9.874 seconds and peak working set from 299,956 to 301,852 KiB. These figures
|
||||
exclude the probe parent and any observer overhead outside the CLI process.
|
||||
The six observed wall times ranged from 8.656 to 10.961 seconds.
|
||||
|
||||
The baseline did not use that resource observer, and cold/warm caches were not
|
||||
normalized. These observations establish functional behavior and bounded probe
|
||||
scope; no CPU, memory or latency improvement is claimed. The fix adds one
|
||||
constant-time environment check, no filesystem lookup, engine call, retry or
|
||||
cache. Output bytes are not model tokens; actual model usage was not measured.
|
||||
@@ -1,107 +0,0 @@
|
||||
# Windows runtime admission retry verification
|
||||
|
||||
Scope: [#2257](https://github.com/morluto/rea/issues/2257). Related initial
|
||||
diagnosis: [#2266](https://github.com/morluto/rea/pull/2266).
|
||||
|
||||
## Revisions and real input
|
||||
|
||||
The baseline is `4f4f6cd7b5d7a400b90772a138d7b9f942c2a556`.
|
||||
The candidate was developed from
|
||||
`4773c152bc5f299fa682575bb8d1efea7587c7bc`; relevant runtime, native and
|
||||
dependency-lock sources are identical between those two revisions.
|
||||
These measurements precede integration of subsequent main changes.
|
||||
|
||||
The host ran Windows 11 10.0.22631.0, official Windows x64 Node 24.18.0,
|
||||
and locked production dependencies. The real application input was the official
|
||||
npm 11.16.0 launcher distribution's `bin` directory. REA inspected that source;
|
||||
it did not execute the application as an analysis target. Runtime copies,
|
||||
raw replies and test executables remain outside the checkout. No IDA or Ghidra
|
||||
engine was involved in this native-runtime verification.
|
||||
|
||||
## Correctness and recovery
|
||||
|
||||
A test-owned directory handle requesting `FILE_ADD_FILE` produced an actual
|
||||
kernel sharing violation (Win32 32) during native runtime-parent admission.
|
||||
Releasing that handle restored admission. Before the fix, public CLI analysis
|
||||
reported a permanent `unsupported_provider` failure with `retryable: false`.
|
||||
The corrected CLI preserves `capability_unavailable` and the reason, with
|
||||
`category: unavailable` and `retryable: true`.
|
||||
|
||||
Normal CLI analysis and post-conflict recovery produced the same canonical
|
||||
normalized result before and after the correction: 535,733 compact JSON bytes,
|
||||
SHA-256 `a24d3c2d9897cccc5ba70e9ee4dce03da88f033a939fe87457136fc5b3a3e2db`.
|
||||
The complete successful CLI reply remained 537,124 bytes.
|
||||
|
||||
A single real SDK 2.3.1 stdio MCP connection first completed analysis, then
|
||||
encountered the same kernel conflict after native authority caching, then
|
||||
recovered successfully when the handle was released. Its final receipt passed
|
||||
and found no residual runtime directories. The native producer supplies
|
||||
`runtimeAllocation: "not-started"` only when parent admission failed before
|
||||
directory creation. The adapter requires that fact and exact numeric codes
|
||||
32/33; permission failures, opaque error text and unknown allocation state
|
||||
remain nonretryable. Incomplete cleanup also prevents retry.
|
||||
|
||||
The native verifier additionally reproduces a real sharing conflict using an
|
||||
owned runtime's DELETE lease, verifies the original error and allocation fact,
|
||||
and confirms no child directory was allocated. This case runs unconditionally
|
||||
in the Windows native verifier, without the optional process-boundary fixture.
|
||||
The full verifier passed with 20 positive controls. Its optional independently
|
||||
built process-boundary fixture was not supplied in this run.
|
||||
|
||||
The related focused suite passed 99 tests across seven files, including worker
|
||||
ownership, cancellation, cleanup, error projection, loader behavior and adapter
|
||||
boundaries. Source-map and WABT acquisition-failure tests use injected failures;
|
||||
they establish disposition propagation, not real engine execution.
|
||||
|
||||
Thirty baseline native self-tests passed with no residual directories.
|
||||
Win32 5 from #1701/#2196 was not reproduced on this host; these results do not
|
||||
establish its cause or resolution.
|
||||
|
||||
## Delivery and resource measurements
|
||||
|
||||
One final same-connection MCP trial used one CPU per Node process, BelowNormal
|
||||
priority, a 512 MiB client heap setting and a 768 MiB server heap setting.
|
||||
Heap settings do not bound total process or family memory.
|
||||
|
||||
| Stage | Observed wall time | Serialized reply bytes |
|
||||
| ---------------------------------- | -----------------: | ---------------------: |
|
||||
| Connect | 11,351 ms | Not recorded |
|
||||
| Complete tool discovery, 187 tools | 744 ms | 2,498,686 |
|
||||
| Normal analysis | 12,887 ms | 1,126,797 |
|
||||
| Sharing failure | 265 ms | 878 |
|
||||
| Recovery on the same connection | 5,578 ms | 1,126,797 |
|
||||
|
||||
The earlier warm failure reply was 1,218 bytes. Successful reply sizes and the
|
||||
catalogue digest were unchanged within the tested source comparison:
|
||||
`7bdadddc909f4b2b093f0b3da9f79fafdac879c9d3c147938b8fbce1b52cd726`.
|
||||
These are delivery bytes, not model tokens. Model-visible discovery handling,
|
||||
actual model token usage and total model task cost were not measured.
|
||||
|
||||
A targeted process-generation sampler collected 343 observations over
|
||||
35,630 ms. Its aggregate observed CPU time was a **lower bound** of 26,766 ms:
|
||||
process exits can hide the final CPU tail. Its peak sampled working-set sum was
|
||||
727,244,800 bytes (about 694 MiB). This is a sampled sum, can double-count shared
|
||||
pages and is not an exact physical-memory peak. Only the test-owned Node and
|
||||
directory-holder processes were included; the observer itself was excluded.
|
||||
|
||||
This is one controlled functional trial, with no paired CPU/memory baseline.
|
||||
Cold/warm filesystem caches and host noise were not normalized. No speedup,
|
||||
CPU reduction, memory reduction or model-token savings are claimed. The change
|
||||
adds no analysis retry loop or cache and performs no additional engine calls.
|
||||
Existing successful native authority caching remains intact; failed readiness
|
||||
is retried by a later caller attempt. Retry becomes useful advice only after
|
||||
the transient condition clears and cleanup permits another attempt.
|
||||
|
||||
## Integration replay
|
||||
|
||||
After rebasing onto main `a2d8b94dd`, runtime candidate
|
||||
`2c7a09eaf3ffe26667b40081f1cf0fd2ce44a146` again passed the 99 related tests,
|
||||
static and documentation gates, real Windows CLI and same-connection MCP
|
||||
normal/conflict/recovery sequence. Both workflows found no residual directories;
|
||||
the CLI normalized-result digest above still matched. The MCP success and error
|
||||
reply sizes remained 1,126,797 and 878 bytes respectively. Upstream Android/SAZ
|
||||
contract changes increased complete discovery to 2,517,904 bytes, digest
|
||||
`d14588eab7404ad129907eb34a45a0db0d43233c4de829f76babd59723bed199`.
|
||||
This later catalogue is not evidence of a delivery-size change caused by the
|
||||
runtime-admission fix. Resource sampling above belongs to the earlier pinned
|
||||
candidate; aggregate resources were not resampled for this integration replay.
|
||||
+1
-1
@@ -167,7 +167,7 @@ main() {
|
||||
[ "$installed_version" = "$version" ] || fail "installed version $installed_version does not match $version. Reinstall the requested version, then retry."
|
||||
|
||||
printf 'REA %s is installed.\n' "$version"
|
||||
if [ "$start_setup" = true ] && [ -r /dev/tty ] && [ -w /dev/tty ] && [ -t 1 ] && [ -t 2 ]; then
|
||||
if [ "$start_setup" = true ] && [ -r /dev/tty ] && [ -w /dev/tty ] && [ -t 1 ]; then
|
||||
printf 'Starting REA setup...\n'
|
||||
"$install_bin" setup </dev/tty >/dev/tty
|
||||
else
|
||||
|
||||
@@ -1,480 +0,0 @@
|
||||
GNU LIBRARY GENERAL PUBLIC LICENSE
|
||||
Version 2, June 1991
|
||||
|
||||
Copyright (C) 1991 Free Software Foundation, Inc.
|
||||
<https://fsf.org/>
|
||||
Everyone is permitted to copy and distribute verbatim copies
|
||||
of this license document, but changing it is not allowed.
|
||||
|
||||
[This is the first released version of the library GPL. It is
|
||||
numbered 2 because it goes with version 2 of the ordinary GPL.]
|
||||
|
||||
Preamble
|
||||
|
||||
The licenses for most software are designed to take away your
|
||||
freedom to share and change it. By contrast, the GNU General Public
|
||||
Licenses are intended to guarantee your freedom to share and change
|
||||
free software--to make sure the software is free for all its users.
|
||||
|
||||
This license, the Library General Public License, applies to some
|
||||
specially designated Free Software Foundation software, and to any
|
||||
other libraries whose authors decide to use it. You can use it for
|
||||
your libraries, too.
|
||||
|
||||
When we speak of free software, we are referring to freedom, not
|
||||
price. Our General Public Licenses are designed to make sure that you
|
||||
have the freedom to distribute copies of free software (and charge for
|
||||
this service if you wish), that you receive source code or can get it
|
||||
if you want it, that you can change the software or use pieces of it
|
||||
in new free programs; and that you know you can do these things.
|
||||
|
||||
To protect your rights, we need to make restrictions that forbid
|
||||
anyone to deny you these rights or to ask you to surrender the rights.
|
||||
These restrictions translate to certain responsibilities for you if
|
||||
you distribute copies of the library, or if you modify it.
|
||||
|
||||
For example, if you distribute copies of the library, whether gratis
|
||||
or for a fee, you must give the recipients all the rights that we gave
|
||||
you. You must make sure that they, too, receive or can get the source
|
||||
code. If you link a program with the library, you must provide
|
||||
complete object files to the recipients so that they can relink them
|
||||
with the library, after making changes to the library and recompiling
|
||||
it. And you must show them these terms so they know their rights.
|
||||
|
||||
Our method of protecting your rights has two steps: (1) copyright
|
||||
the library, and (2) offer you this license which gives you legal
|
||||
permission to copy, distribute and/or modify the library.
|
||||
|
||||
Also, for each distributor's protection, we want to make certain
|
||||
that everyone understands that there is no warranty for this free
|
||||
library. If the library is modified by someone else and passed on, we
|
||||
want its recipients to know that what they have is not the original
|
||||
version, so that any problems introduced by others will not reflect on
|
||||
the original authors' reputations.
|
||||
|
||||
Finally, any free program is threatened constantly by software
|
||||
patents. We wish to avoid the danger that companies distributing free
|
||||
software will individually obtain patent licenses, thus in effect
|
||||
transforming the program into proprietary software. To prevent this,
|
||||
we have made it clear that any patent must be licensed for everyone's
|
||||
free use or not licensed at all.
|
||||
|
||||
Most GNU software, including some libraries, is covered by the ordinary
|
||||
GNU General Public License, which was designed for utility programs. This
|
||||
license, the GNU Library General Public License, applies to certain
|
||||
designated libraries. This license is quite different from the ordinary
|
||||
one; be sure to read it in full, and don't assume that anything in it is
|
||||
the same as in the ordinary license.
|
||||
|
||||
The reason we have a separate public license for some libraries is that
|
||||
they blur the distinction we usually make between modifying or adding to a
|
||||
program and simply using it. Linking a program with a library, without
|
||||
changing the library, is in some sense simply using the library, and is
|
||||
analogous to running a utility program or application program. However, in
|
||||
a textual and legal sense, the linked executable is a combined work, a
|
||||
derivative of the original library, and the ordinary General Public License
|
||||
treats it as such.
|
||||
|
||||
Because of this blurred distinction, using the ordinary General
|
||||
Public License for libraries did not effectively promote software
|
||||
sharing, because most developers did not use the libraries. We
|
||||
concluded that weaker conditions might promote sharing better.
|
||||
|
||||
However, unrestricted linking of non-free programs would deprive the
|
||||
users of those programs of all benefit from the free status of the
|
||||
libraries themselves. This Library General Public License is intended to
|
||||
permit developers of non-free programs to use free libraries, while
|
||||
preserving your freedom as a user of such programs to change the free
|
||||
libraries that are incorporated in them. (We have not seen how to achieve
|
||||
this as regards changes in header files, but we have achieved it as regards
|
||||
changes in the actual functions of the Library.) The hope is that this
|
||||
will lead to faster development of free libraries.
|
||||
|
||||
The precise terms and conditions for copying, distribution and
|
||||
modification follow. Pay close attention to the difference between a
|
||||
"work based on the library" and a "work that uses the library". The
|
||||
former contains code derived from the library, while the latter only
|
||||
works together with the library.
|
||||
|
||||
Note that it is possible for a library to be covered by the ordinary
|
||||
General Public License rather than by this special one.
|
||||
|
||||
GNU LIBRARY GENERAL PUBLIC LICENSE
|
||||
TERMS AND CONDITIONS FOR COPYING, DISTRIBUTION AND MODIFICATION
|
||||
|
||||
0. This License Agreement applies to any software library which
|
||||
contains a notice placed by the copyright holder or other authorized
|
||||
party saying it may be distributed under the terms of this Library
|
||||
General Public License (also called "this License"). Each licensee is
|
||||
addressed as "you".
|
||||
|
||||
A "library" means a collection of software functions and/or data
|
||||
prepared so as to be conveniently linked with application programs
|
||||
(which use some of those functions and data) to form executables.
|
||||
|
||||
The "Library", below, refers to any such software library or work
|
||||
which has been distributed under these terms. A "work based on the
|
||||
Library" means either the Library or any derivative work under
|
||||
copyright law: that is to say, a work containing the Library or a
|
||||
portion of it, either verbatim or with modifications and/or translated
|
||||
straightforwardly into another language. (Hereinafter, translation is
|
||||
included without limitation in the term "modification".)
|
||||
|
||||
"Source code" for a work means the preferred form of the work for
|
||||
making modifications to it. For a library, complete source code means
|
||||
all the source code for all modules it contains, plus any associated
|
||||
interface definition files, plus the scripts used to control compilation
|
||||
and installation of the library.
|
||||
|
||||
Activities other than copying, distribution and modification are not
|
||||
covered by this License; they are outside its scope. The act of
|
||||
running a program using the Library is not restricted, and output from
|
||||
such a program is covered only if its contents constitute a work based
|
||||
on the Library (independent of the use of the Library in a tool for
|
||||
writing it). Whether that is true depends on what the Library does
|
||||
and what the program that uses the Library does.
|
||||
|
||||
1. You may copy and distribute verbatim copies of the Library's
|
||||
complete source code as you receive it, in any medium, provided that
|
||||
you conspicuously and appropriately publish on each copy an
|
||||
appropriate copyright notice and disclaimer of warranty; keep intact
|
||||
all the notices that refer to this License and to the absence of any
|
||||
warranty; and distribute a copy of this License along with the
|
||||
Library.
|
||||
|
||||
You may charge a fee for the physical act of transferring a copy,
|
||||
and you may at your option offer warranty protection in exchange for a
|
||||
fee.
|
||||
|
||||
2. You may modify your copy or copies of the Library or any portion
|
||||
of it, thus forming a work based on the Library, and copy and
|
||||
distribute such modifications or work under the terms of Section 1
|
||||
above, provided that you also meet all of these conditions:
|
||||
|
||||
a) The modified work must itself be a software library.
|
||||
|
||||
b) You must cause the files modified to carry prominent notices
|
||||
stating that you changed the files and the date of any change.
|
||||
|
||||
c) You must cause the whole of the work to be licensed at no
|
||||
charge to all third parties under the terms of this License.
|
||||
|
||||
d) If a facility in the modified Library refers to a function or a
|
||||
table of data to be supplied by an application program that uses
|
||||
the facility, other than as an argument passed when the facility
|
||||
is invoked, then you must make a good faith effort to ensure that,
|
||||
in the event an application does not supply such function or
|
||||
table, the facility still operates, and performs whatever part of
|
||||
its purpose remains meaningful.
|
||||
|
||||
(For example, a function in a library to compute square roots has
|
||||
a purpose that is entirely well-defined independent of the
|
||||
application. Therefore, Subsection 2d requires that any
|
||||
application-supplied function or table used by this function must
|
||||
be optional: if the application does not supply it, the square
|
||||
root function must still compute square roots.)
|
||||
|
||||
These requirements apply to the modified work as a whole. If
|
||||
identifiable sections of that work are not derived from the Library,
|
||||
and can be reasonably considered independent and separate works in
|
||||
themselves, then this License, and its terms, do not apply to those
|
||||
sections when you distribute them as separate works. But when you
|
||||
distribute the same sections as part of a whole which is a work based
|
||||
on the Library, the distribution of the whole must be on the terms of
|
||||
this License, whose permissions for other licensees extend to the
|
||||
entire whole, and thus to each and every part regardless of who wrote
|
||||
it.
|
||||
|
||||
Thus, it is not the intent of this section to claim rights or contest
|
||||
your rights to work written entirely by you; rather, the intent is to
|
||||
exercise the right to control the distribution of derivative or
|
||||
collective works based on the Library.
|
||||
|
||||
In addition, mere aggregation of another work not based on the Library
|
||||
with the Library (or with a work based on the Library) on a volume of
|
||||
a storage or distribution medium does not bring the other work under
|
||||
the scope of this License.
|
||||
|
||||
3. You may opt to apply the terms of the ordinary GNU General Public
|
||||
License instead of this License to a given copy of the Library. To do
|
||||
this, you must alter all the notices that refer to this License, so
|
||||
that they refer to the ordinary GNU General Public License, version 2,
|
||||
instead of to this License. (If a newer version than version 2 of the
|
||||
ordinary GNU General Public License has appeared, then you can specify
|
||||
that version instead if you wish.) Do not make any other change in
|
||||
these notices.
|
||||
|
||||
Once this change is made in a given copy, it is irreversible for
|
||||
that copy, so the ordinary GNU General Public License applies to all
|
||||
subsequent copies and derivative works made from that copy.
|
||||
|
||||
This option is useful when you wish to copy part of the code of
|
||||
the Library into a program that is not a library.
|
||||
|
||||
4. You may copy and distribute the Library (or a portion or
|
||||
derivative of it, under Section 2) in object code or executable form
|
||||
under the terms of Sections 1 and 2 above provided that you accompany
|
||||
it with the complete corresponding machine-readable source code, which
|
||||
must be distributed under the terms of Sections 1 and 2 above on a
|
||||
medium customarily used for software interchange.
|
||||
|
||||
If distribution of object code is made by offering access to copy
|
||||
from a designated place, then offering equivalent access to copy the
|
||||
source code from the same place satisfies the requirement to
|
||||
distribute the source code, even though third parties are not
|
||||
compelled to copy the source along with the object code.
|
||||
|
||||
5. A program that contains no derivative of any portion of the
|
||||
Library, but is designed to work with the Library by being compiled or
|
||||
linked with it, is called a "work that uses the Library". Such a
|
||||
work, in isolation, is not a derivative work of the Library, and
|
||||
therefore falls outside the scope of this License.
|
||||
|
||||
However, linking a "work that uses the Library" with the Library
|
||||
creates an executable that is a derivative of the Library (because it
|
||||
contains portions of the Library), rather than a "work that uses the
|
||||
library". The executable is therefore covered by this License.
|
||||
Section 6 states terms for distribution of such executables.
|
||||
|
||||
When a "work that uses the Library" uses material from a header file
|
||||
that is part of the Library, the object code for the work may be a
|
||||
derivative work of the Library even though the source code is not.
|
||||
Whether this is true is especially significant if the work can be
|
||||
linked without the Library, or if the work is itself a library. The
|
||||
threshold for this to be true is not precisely defined by law.
|
||||
|
||||
If such an object file uses only numerical parameters, data
|
||||
structure layouts and accessors, and small macros and small inline
|
||||
functions (ten lines or less in length), then the use of the object
|
||||
file is unrestricted, regardless of whether it is legally a derivative
|
||||
work. (Executables containing this object code plus portions of the
|
||||
Library will still fall under Section 6.)
|
||||
|
||||
Otherwise, if the work is a derivative of the Library, you may
|
||||
distribute the object code for the work under the terms of Section 6.
|
||||
Any executables containing that work also fall under Section 6,
|
||||
whether or not they are linked directly with the Library itself.
|
||||
|
||||
6. As an exception to the Sections above, you may also compile or
|
||||
link a "work that uses the Library" with the Library to produce a
|
||||
work containing portions of the Library, and distribute that work
|
||||
under terms of your choice, provided that the terms permit
|
||||
modification of the work for the customer's own use and reverse
|
||||
engineering for debugging such modifications.
|
||||
|
||||
You must give prominent notice with each copy of the work that the
|
||||
Library is used in it and that the Library and its use are covered by
|
||||
this License. You must supply a copy of this License. If the work
|
||||
during execution displays copyright notices, you must include the
|
||||
copyright notice for the Library among them, as well as a reference
|
||||
directing the user to the copy of this License. Also, you must do one
|
||||
of these things:
|
||||
|
||||
a) Accompany the work with the complete corresponding
|
||||
machine-readable source code for the Library including whatever
|
||||
changes were used in the work (which must be distributed under
|
||||
Sections 1 and 2 above); and, if the work is an executable linked
|
||||
with the Library, with the complete machine-readable "work that
|
||||
uses the Library", as object code and/or source code, so that the
|
||||
user can modify the Library and then relink to produce a modified
|
||||
executable containing the modified Library. (It is understood
|
||||
that the user who changes the contents of definitions files in the
|
||||
Library will not necessarily be able to recompile the application
|
||||
to use the modified definitions.)
|
||||
|
||||
b) Accompany the work with a written offer, valid for at
|
||||
least three years, to give the same user the materials
|
||||
specified in Subsection 6a, above, for a charge no more
|
||||
than the cost of performing this distribution.
|
||||
|
||||
c) If distribution of the work is made by offering access to copy
|
||||
from a designated place, offer equivalent access to copy the above
|
||||
specified materials from the same place.
|
||||
|
||||
d) Verify that the user has already received a copy of these
|
||||
materials or that you have already sent this user a copy.
|
||||
|
||||
For an executable, the required form of the "work that uses the
|
||||
Library" must include any data and utility programs needed for
|
||||
reproducing the executable from it. However, as a special exception,
|
||||
the source code distributed need not include anything that is normally
|
||||
distributed (in either source or binary form) with the major
|
||||
components (compiler, kernel, and so on) of the operating system on
|
||||
which the executable runs, unless that component itself accompanies
|
||||
the executable.
|
||||
|
||||
It may happen that this requirement contradicts the license
|
||||
restrictions of other proprietary libraries that do not normally
|
||||
accompany the operating system. Such a contradiction means you cannot
|
||||
use both them and the Library together in an executable that you
|
||||
distribute.
|
||||
|
||||
7. You may place library facilities that are a work based on the
|
||||
Library side-by-side in a single library together with other library
|
||||
facilities not covered by this License, and distribute such a combined
|
||||
library, provided that the separate distribution of the work based on
|
||||
the Library and of the other library facilities is otherwise
|
||||
permitted, and provided that you do these two things:
|
||||
|
||||
a) Accompany the combined library with a copy of the same work
|
||||
based on the Library, uncombined with any other library
|
||||
facilities. This must be distributed under the terms of the
|
||||
Sections above.
|
||||
|
||||
b) Give prominent notice with the combined library of the fact
|
||||
that part of it is a work based on the Library, and explaining
|
||||
where to find the accompanying uncombined form of the same work.
|
||||
|
||||
8. You may not copy, modify, sublicense, link with, or distribute
|
||||
the Library except as expressly provided under this License. Any
|
||||
attempt otherwise to copy, modify, sublicense, link with, or
|
||||
distribute the Library is void, and will automatically terminate your
|
||||
rights under this License. However, parties who have received copies,
|
||||
or rights, from you under this License will not have their licenses
|
||||
terminated so long as such parties remain in full compliance.
|
||||
|
||||
9. You are not required to accept this License, since you have not
|
||||
signed it. However, nothing else grants you permission to modify or
|
||||
distribute the Library or its derivative works. These actions are
|
||||
prohibited by law if you do not accept this License. Therefore, by
|
||||
modifying or distributing the Library (or any work based on the
|
||||
Library), you indicate your acceptance of this License to do so, and
|
||||
all its terms and conditions for copying, distributing or modifying
|
||||
the Library or works based on it.
|
||||
|
||||
10. Each time you redistribute the Library (or any work based on the
|
||||
Library), the recipient automatically receives a license from the
|
||||
original licensor to copy, distribute, link with or modify the Library
|
||||
subject to these terms and conditions. You may not impose any further
|
||||
restrictions on the recipients' exercise of the rights granted herein.
|
||||
You are not responsible for enforcing compliance by third parties to
|
||||
this License.
|
||||
|
||||
11. If, as a consequence of a court judgment or allegation of patent
|
||||
infringement or for any other reason (not limited to patent issues),
|
||||
conditions are imposed on you (whether by court order, agreement or
|
||||
otherwise) that contradict the conditions of this License, they do not
|
||||
excuse you from the conditions of this License. If you cannot
|
||||
distribute so as to satisfy simultaneously your obligations under this
|
||||
License and any other pertinent obligations, then as a consequence you
|
||||
may not distribute the Library at all. For example, if a patent
|
||||
license would not permit royalty-free redistribution of the Library by
|
||||
all those who receive copies directly or indirectly through you, then
|
||||
the only way you could satisfy both it and this License would be to
|
||||
refrain entirely from distribution of the Library.
|
||||
|
||||
If any portion of this section is held invalid or unenforceable under any
|
||||
particular circumstance, the balance of the section is intended to apply,
|
||||
and the section as a whole is intended to apply in other circumstances.
|
||||
|
||||
It is not the purpose of this section to induce you to infringe any
|
||||
patents or other property right claims or to contest validity of any
|
||||
such claims; this section has the sole purpose of protecting the
|
||||
integrity of the free software distribution system which is
|
||||
implemented by public license practices. Many people have made
|
||||
generous contributions to the wide range of software distributed
|
||||
through that system in reliance on consistent application of that
|
||||
system; it is up to the author/donor to decide if he or she is willing
|
||||
to distribute software through any other system and a licensee cannot
|
||||
impose that choice.
|
||||
|
||||
This section is intended to make thoroughly clear what is believed to
|
||||
be a consequence of the rest of this License.
|
||||
|
||||
12. If the distribution and/or use of the Library is restricted in
|
||||
certain countries either by patents or by copyrighted interfaces, the
|
||||
original copyright holder who places the Library under this License may add
|
||||
an explicit geographical distribution limitation excluding those countries,
|
||||
so that distribution is permitted only in or among countries not thus
|
||||
excluded. In such case, this License incorporates the limitation as if
|
||||
written in the body of this License.
|
||||
|
||||
13. The Free Software Foundation may publish revised and/or new
|
||||
versions of the Library General Public License from time to time.
|
||||
Such new versions will be similar in spirit to the present version,
|
||||
but may differ in detail to address new problems or concerns.
|
||||
|
||||
Each version is given a distinguishing version number. If the Library
|
||||
specifies a version number of this License which applies to it and
|
||||
"any later version", you have the option of following the terms and
|
||||
conditions either of that version or of any later version published by
|
||||
the Free Software Foundation. If the Library does not specify a
|
||||
license version number, you may choose any version ever published by
|
||||
the Free Software Foundation.
|
||||
|
||||
14. If you wish to incorporate parts of the Library into other free
|
||||
programs whose distribution conditions are incompatible with these,
|
||||
write to the author to ask for permission. For software which is
|
||||
copyrighted by the Free Software Foundation, write to the Free
|
||||
Software Foundation; we sometimes make exceptions for this. Our
|
||||
decision will be guided by the two goals of preserving the free status
|
||||
of all derivatives of our free software and of promoting the sharing
|
||||
and reuse of software generally.
|
||||
|
||||
NO WARRANTY
|
||||
|
||||
15. BECAUSE THE LIBRARY IS LICENSED FREE OF CHARGE, THERE IS NO
|
||||
WARRANTY FOR THE LIBRARY, TO THE EXTENT PERMITTED BY APPLICABLE LAW.
|
||||
EXCEPT WHEN OTHERWISE STATED IN WRITING THE COPYRIGHT HOLDERS AND/OR
|
||||
OTHER PARTIES PROVIDE THE LIBRARY "AS IS" WITHOUT WARRANTY OF ANY
|
||||
KIND, EITHER EXPRESSED OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE
|
||||
IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR
|
||||
PURPOSE. THE ENTIRE RISK AS TO THE QUALITY AND PERFORMANCE OF THE
|
||||
LIBRARY IS WITH YOU. SHOULD THE LIBRARY PROVE DEFECTIVE, YOU ASSUME
|
||||
THE COST OF ALL NECESSARY SERVICING, REPAIR OR CORRECTION.
|
||||
|
||||
16. IN NO EVENT UNLESS REQUIRED BY APPLICABLE LAW OR AGREED TO IN
|
||||
WRITING WILL ANY COPYRIGHT HOLDER, OR ANY OTHER PARTY WHO MAY MODIFY
|
||||
AND/OR REDISTRIBUTE THE LIBRARY AS PERMITTED ABOVE, BE LIABLE TO YOU
|
||||
FOR DAMAGES, INCLUDING ANY GENERAL, SPECIAL, INCIDENTAL OR
|
||||
CONSEQUENTIAL DAMAGES ARISING OUT OF THE USE OR INABILITY TO USE THE
|
||||
LIBRARY (INCLUDING BUT NOT LIMITED TO LOSS OF DATA OR DATA BEING
|
||||
RENDERED INACCURATE OR LOSSES SUSTAINED BY YOU OR THIRD PARTIES OR A
|
||||
FAILURE OF THE LIBRARY TO OPERATE WITH ANY OTHER SOFTWARE), EVEN IF
|
||||
SUCH HOLDER OR OTHER PARTY HAS BEEN ADVISED OF THE POSSIBILITY OF SUCH
|
||||
DAMAGES.
|
||||
|
||||
END OF TERMS AND CONDITIONS
|
||||
|
||||
How to Apply These Terms to Your New Libraries
|
||||
|
||||
If you develop a new library, and you want it to be of the greatest
|
||||
possible use to the public, we recommend making it free software that
|
||||
everyone can redistribute and change. You can do so by permitting
|
||||
redistribution under these terms (or, alternatively, under the terms of the
|
||||
ordinary General Public License).
|
||||
|
||||
To apply these terms, attach the following notices to the library. It is
|
||||
safest to attach them to the start of each source file to most effectively
|
||||
convey the exclusion of warranty; and each file should have at least the
|
||||
"copyright" line and a pointer to where the full notice is found.
|
||||
|
||||
<one line to give the library's name and a brief idea of what it does.>
|
||||
Copyright (C) <year> <name of author>
|
||||
|
||||
This library is free software; you can redistribute it and/or
|
||||
modify it under the terms of the GNU Library General Public
|
||||
License as published by the Free Software Foundation; either
|
||||
version 2 of the License, or (at your option) any later version.
|
||||
|
||||
This library is distributed in the hope that it will be useful,
|
||||
but WITHOUT ANY WARRANTY; without even the implied warranty of
|
||||
MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the GNU
|
||||
Library General Public License for more details.
|
||||
|
||||
You should have received a copy of the GNU Library General Public
|
||||
License along with this library; if not, see <https://www.gnu.org/licenses/>.
|
||||
|
||||
Also add information on how to contact you by electronic and paper mail.
|
||||
|
||||
You should also get your employer (if you work as a programmer) or your
|
||||
school, if any, to sign a "copyright disclaimer" for the library, if
|
||||
necessary. Here is a sample; alter the names:
|
||||
|
||||
Yoyodyne, Inc., hereby disclaims all copyright interest in the
|
||||
library `Frob' (a library for tweaking knobs) written by James Random Hacker.
|
||||
|
||||
<signature of Moe Ghoul>, 1 April 1990
|
||||
Moe Ghoul, President of Vice
|
||||
|
||||
That's all there is to it!
|
||||
+13
-27
@@ -4,20 +4,19 @@ Start with [THIRD_PARTY_NOTICES.md](../THIRD_PARTY_NOTICES.md) for the distincti
|
||||
between distributed material and separately obtained tools. These files retain
|
||||
upstream texts; they do not change [REA's MIT license](../LICENSE).
|
||||
|
||||
| Files | Provenance and scope |
|
||||
| ------------------------------------------------------ | ----------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
|
||||
| `npm-dependencies.txt` | Every package path in the root lockfile, with its exact version, declared license, scope, download URL, and integrity. Includes development and optional platform entries. |
|
||||
| `npm-runtime-notices.txt` | Original license, copyright, and NOTICE texts collected from integrity-verified locked runtime npm archives across all platforms; also the license of Rolldown's generated runtime helpers. The archive manifest's name and version are checked. |
|
||||
| `nativeaot-parser-MIT.txt` | Original Washi notice for derived NativeAOT parser code; source revision is recorded in the parser and the root notices. |
|
||||
| `dotnet-runtime-MIT.txt` | Original .NET Foundation MIT text from the NativeAOT reference revision `a3b2d40328be0be3f8dd43f0e5cc925b8827b044`. |
|
||||
| `ghidra-12.1.4-{LICENSE,NOTICE,DISCLAIMER}.txt` | Unchanged top-level documents from `Ghidra_12.1.4_build`. Ghidra is not bundled; these reference copies do not replace its component and GPL support-program notices. The US-government-specific disclaimer applies to Ghidra, not to REA. |
|
||||
| `cfworker-MIT.txt`, `xterm-MIT.txt` | Original notices missing from their published runtime npm archives, recovered from the releases' upstream Git revisions. They are included in the corresponding runtime entries. |
|
||||
| `Apache-2.0.txt`, `MIT-template.txt` | Standard license texts for explicitly documented upstream notice gaps. The MIT placeholders are not an attribution to an inferred author or year. |
|
||||
| `frida-17.23.2-COPYING.txt`, `LGPL-2.0.txt` | Unchanged licensing supplements for the optional Frida dependency: tagged Frida wxWindows notice and GNU Library GPL v2 text. The npm archive and tagged Node binding omit a standalone license/copyright document; these texts do not recover binding or prebuild-component attribution. |
|
||||
| `MinGW-w64-runtime.txt` | Upstream's combined runtime copyright and license notices, snapshot from v12.0.0, for the statically linked Windows addon. This is a notice snapshot, not a pin of the compiler used in release CI. |
|
||||
| `GPL-3.0.txt`, `GCC-Runtime-Library-Exception-3.1.txt` | Unchanged GPLv3 and GCC runtime exception texts from GCC 14.2.0. The exception permits eligible compiled combinations under its conditions; the runtime keeps its own license. This snapshot does not assert that every release uses GCC 14.2.0. |
|
||||
| `Node-22.19.0-LICENSE.txt` | The original Node 22.19.0 license and third-party notices. The Windows addon uses Node-API headers from that release; the complete Node runtime and all components listed in this reference document are not bundled. |
|
||||
| `upstream-sources.json` | Source URLs and SHA-256 digests for the new unchanged reference and supplemental texts. These digests identify the preserved local texts. |
|
||||
| Files | Provenance and scope |
|
||||
| ------------------------------------------------------ | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ |
|
||||
| `npm-dependencies.txt` | Every package path in the root lockfile, with its exact version, declared license, scope, download URL, and integrity. Includes development and optional platform entries. |
|
||||
| `npm-runtime-notices.txt` | Original license, copyright, and NOTICE texts collected from integrity-verified locked runtime npm archives across all platforms; also the license of Rolldown's generated runtime helpers. The archive manifest's name and version are checked. |
|
||||
| `nativeaot-parser-MIT.txt` | Original Washi notice for derived NativeAOT parser code; source revision is recorded in the parser and the root notices. |
|
||||
| `dotnet-runtime-MIT.txt` | Original .NET Foundation MIT text from the NativeAOT reference revision `a3b2d40328be0be3f8dd43f0e5cc925b8827b044`. |
|
||||
| `ghidra-12.1.4-{LICENSE,NOTICE,DISCLAIMER}.txt` | Unchanged top-level documents from `Ghidra_12.1.4_build`. Ghidra is not bundled; these reference copies do not replace its component and GPL support-program notices. The US-government-specific disclaimer applies to Ghidra, not to REA. |
|
||||
| `cfworker-MIT.txt`, `xterm-MIT.txt` | Original notices missing from their published runtime npm archives, recovered from the releases' upstream Git revisions. They are included in the corresponding runtime entries. |
|
||||
| `Apache-2.0.txt`, `MIT-template.txt` | Standard license texts for explicitly documented upstream notice gaps. The MIT placeholders are not an attribution to an inferred author or year. |
|
||||
| `MinGW-w64-runtime.txt` | Upstream's combined runtime copyright and license notices, snapshot from v12.0.0, for the statically linked Windows addon. This is a notice snapshot, not a pin of the compiler used in release CI. |
|
||||
| `GPL-3.0.txt`, `GCC-Runtime-Library-Exception-3.1.txt` | Unchanged GPLv3 and GCC runtime exception texts from GCC 14.2.0. The exception permits eligible compiled combinations under its conditions; the runtime keeps its own license. This snapshot does not assert that every release uses GCC 14.2.0. |
|
||||
| `Node-22.19.0-LICENSE.txt` | The original Node 22.19.0 license and third-party notices. The Windows addon uses Node-API headers from that release; the complete Node runtime and all components listed in this reference document are not bundled. |
|
||||
| `upstream-sources.json` | Source URLs and SHA-256 digests for the new unchanged reference and supplemental texts. These digests identify the preserved local texts. |
|
||||
|
||||
Additional preserved originals live at
|
||||
[evmole/LICENSE](../third_party/evmole/LICENSE),
|
||||
@@ -41,10 +40,6 @@ only license and author metadata: their missing original copyright documents
|
||||
remain explicitly identified in the runtime texts. Do not describe those
|
||||
entries as complete recovered attribution.
|
||||
|
||||
`frida@17.23.2` also lacks an original standalone notice in its npm archive and
|
||||
tagged Node source. Its declared license and the preserved licensing supplements
|
||||
are recorded explicitly without inferring a copyright holder or year.
|
||||
|
||||
These records do not establish the legal accuracy of upstream metadata or
|
||||
prove that every upstream source-file attribution has been supplied in an
|
||||
archive. Review and refresh them when dependencies change; compare reference
|
||||
@@ -57,12 +52,3 @@ runtime/component notices with the retained snapshots and update them if they
|
||||
differ. Do not assume that a compiler change leaves redistribution requirements
|
||||
unchanged. Preserve applicable originals with any additionally bundled engine;
|
||||
top-level reference copies alone may not cover its entire distribution.
|
||||
|
||||
Generate the exact locked inventory with `npm run licenses:generate`. After
|
||||
refreshing verified runtime notices, update their header fingerprint to the
|
||||
generator's reported `runtime_dependency_fingerprint`, then run
|
||||
`npm run licenses:check`; `docs:check` also runs this check. It compares the
|
||||
inventory, runtime package identities,
|
||||
license declarations, archive URLs/integrity, runtime dependency fingerprint,
|
||||
and preserved reference digests. It does not verify legal completeness or
|
||||
replace inspection of original upstream notices.
|
||||
@@ -1,50 +0,0 @@
|
||||
wxWindows Library Licence, Version 3.1
|
||||
======================================
|
||||
|
||||
Copyright (c) 1998-2005 Julian Smart, Robert Roebling et al
|
||||
|
||||
Everyone is permitted to copy and distribute verbatim copies
|
||||
of this licence document, but changing it is not allowed.
|
||||
|
||||
WXWINDOWS LIBRARY LICENCE
|
||||
TERMS AND CONDITIONS FOR COPYING, DISTRIBUTION AND MODIFICATION
|
||||
|
||||
This library is free software; you can redistribute it and/or modify it
|
||||
under the terms of the GNU Library General Public Licence as published by
|
||||
the Free Software Foundation; either version 2 of the Licence, or (at your
|
||||
option) any later version.
|
||||
|
||||
This library is distributed in the hope that it will be useful, but WITHOUT
|
||||
ANY WARRANTY; without even the implied warranty of MERCHANTABILITY or
|
||||
FITNESS FOR A PARTICULAR PURPOSE. See the GNU Library General Public
|
||||
Licence for more details.
|
||||
|
||||
You should have received a copy of the GNU Library General Public Licence
|
||||
along with this software, usually in a file named COPYING.LIB. If not,
|
||||
write to the Free Software Foundation, Inc., 51 Franklin Street, Fifth
|
||||
Floor, Boston, MA 02110-1301 USA.
|
||||
|
||||
EXCEPTION NOTICE
|
||||
|
||||
1. As a special exception, the copyright holders of this library give
|
||||
permission for additional uses of the text contained in this release of the
|
||||
library as licenced under the wxWindows Library Licence, applying either
|
||||
version 3.1 of the Licence, or (at your option) any later version of the
|
||||
Licence as published by the copyright holders of version 3.1 of the Licence
|
||||
document.
|
||||
|
||||
2. The exception is that you may use, copy, link, modify and distribute
|
||||
under your own terms, binary object code versions of works based on the
|
||||
Library.
|
||||
|
||||
3. If you copy code from files distributed under the terms of the GNU
|
||||
General Public Licence or the GNU Library General Public Licence into a
|
||||
copy of this library, as this licence permits, the exception does not apply
|
||||
to the code that you add in this way. To avoid misleading anyone as to the
|
||||
status of such modified files, you must delete this exception notice from
|
||||
such code and/or adjust the licensing conditions notice accordingly.
|
||||
|
||||
4. If you write modifications of your own for this library, it is your
|
||||
choice whether to permit this exception to apply to your modifications. If
|
||||
you do not wish that, you must delete the exception notice from such code
|
||||
and/or adjust the licensing conditions notice accordingly.
|
||||
@@ -2,7 +2,7 @@ REA npm dependency inventory
|
||||
Prepared from the root package-lock.json; refresh this inventory when locked dependencies change.
|
||||
License identifiers are upstream lockfile declarations, not a legal assessment.
|
||||
Runtime includes transitive and optional platform packages; development includes build, test and website tooling.
|
||||
Locked package entries: 586; runtime: 174.
|
||||
Locked package entries: 561; runtime: 148.
|
||||
Full runtime copyright/license/NOTICE texts: npm-runtime-notices.txt.
|
||||
|
||||
@algolia/abtesting@1.25.0 | development | MIT
|
||||
@@ -1375,31 +1375,11 @@ base64-js@1.5.1 | runtime | MIT
|
||||
Package: https://www.npmjs.com/package/base64-js/v/1.5.1
|
||||
Archive: https://registry.npmjs.org/base64-js/-/base64-js-1.5.1.tgz
|
||||
Integrity: sha512-AKpaYlHn8t4SVbOHCy+b5+KKgvR4vrsD8vbvrbiQJps7fKDTkjkDry6ji0rUJjC0kzbNePLwzxq8iypo41qeWA==
|
||||
bindings@1.5.0 | runtime, optional | MIT
|
||||
Lockfile path: node_modules/bindings
|
||||
Package: https://www.npmjs.com/package/bindings/v/1.5.0
|
||||
Archive: https://registry.npmjs.org/bindings/-/bindings-1.5.0.tgz
|
||||
Integrity: sha512-p2q/t/mhvuOj/UeLlV6566GD/guowlr0hHxClI0W9m7MWYkL1F0hLo+0Aexs9HSPCtR1SXQ0TD3MMKrXZajbiQ==
|
||||
birpc@2.9.0 | development | MIT
|
||||
Lockfile path: node_modules/birpc
|
||||
Package: https://www.npmjs.com/package/birpc/v/2.9.0
|
||||
Archive: https://registry.npmjs.org/birpc/-/birpc-2.9.0.tgz
|
||||
Integrity: sha512-KrayHS5pBi69Xi9JmvoqrIgYGDkD6mcSe/i6YKi3w5kekCLzrX4+nawcXqrj2tIp50Kw/mT/s3p+GVK0A0sKxw==
|
||||
bl@4.1.0 | runtime, optional | MIT
|
||||
Lockfile path: node_modules/bl
|
||||
Package: https://www.npmjs.com/package/bl/v/4.1.0
|
||||
Archive: https://registry.npmjs.org/bl/-/bl-4.1.0.tgz
|
||||
Integrity: sha512-1W07cM9gS6DcLperZfFSj+bWLtaPGSOHWhPiGzXmvVJbRLdG82sH/Kn8EtW1VqWVA54AKf2h5k5BbnIbwF3h6w==
|
||||
buffer@5.7.1 | runtime, optional | MIT
|
||||
Lockfile path: node_modules/bl/node_modules/buffer
|
||||
Package: https://www.npmjs.com/package/buffer/v/5.7.1
|
||||
Archive: https://registry.npmjs.org/buffer/-/buffer-5.7.1.tgz
|
||||
Integrity: sha512-EHcyIPBQ4BSGlvjB16k5KgAJ27CIsHY/2JBmCRReo48y9rQ3MaUzWX3KVlBa4U7MyX02HdVj0K7C3WaB3ju7FQ==
|
||||
readable-stream@3.6.2 | runtime, optional | MIT
|
||||
Lockfile path: node_modules/bl/node_modules/readable-stream
|
||||
Package: https://www.npmjs.com/package/readable-stream/v/3.6.2
|
||||
Archive: https://registry.npmjs.org/readable-stream/-/readable-stream-3.6.2.tgz
|
||||
Integrity: sha512-9u/sniCrY3D5WdsERHzHE4G2YCXqoG5FTHUiCC4SIbr6XcLZBY05ya9EKjYek9O5xOAwjGq+1JdGBAS7Q9ScoA==
|
||||
brace-expansion@5.0.12 | runtime | MIT
|
||||
Lockfile path: node_modules/brace-expansion
|
||||
Package: https://www.npmjs.com/package/brace-expansion/v/5.0.12
|
||||
@@ -1450,11 +1430,6 @@ character-entities-legacy@3.0.0 | development | MIT
|
||||
Package: https://www.npmjs.com/package/character-entities-legacy/v/3.0.0
|
||||
Archive: https://registry.npmjs.org/character-entities-legacy/-/character-entities-legacy-3.0.0.tgz
|
||||
Integrity: sha512-RpPp0asT/6ufRm//AJVwpViZbGM/MkjQFxJccQRHmISF/22NBtsHqAWmL+/pmkPWoIUJdWyeVleTl1wydHATVQ==
|
||||
chownr@1.1.4 | runtime, optional | ISC
|
||||
Lockfile path: node_modules/chownr
|
||||
Package: https://www.npmjs.com/package/chownr/v/1.1.4
|
||||
Archive: https://registry.npmjs.org/chownr/-/chownr-1.1.4.tgz
|
||||
Integrity: sha512-jJ0bqzaylmJtVnNgzTeSOs8DPavpbYgEr/b0YL8/2GO3xJEhInFmhKMUnEJQjZumK7KXGFhUy89PrsJWlakBVg==
|
||||
clean-git-ref@2.0.1 | runtime | Apache-2.0
|
||||
Lockfile path: node_modules/clean-git-ref
|
||||
Package: https://www.npmjs.com/package/clean-git-ref/v/2.0.1
|
||||
@@ -1510,11 +1485,6 @@ decompress-response@6.0.0 | runtime | MIT
|
||||
Package: https://www.npmjs.com/package/decompress-response/v/6.0.0
|
||||
Archive: https://registry.npmjs.org/decompress-response/-/decompress-response-6.0.0.tgz
|
||||
Integrity: sha512-aW35yZM6Bb/4oJlZncMH2LCoZtJXTRxES17vE3hoRiowU2kWHaJKFkSBDnDR+cm9J+9QhXmREyIfv0pji9ejCQ==
|
||||
deep-extend@0.6.0 | runtime, optional | MIT
|
||||
Lockfile path: node_modules/deep-extend
|
||||
Package: https://www.npmjs.com/package/deep-extend/v/0.6.0
|
||||
Archive: https://registry.npmjs.org/deep-extend/-/deep-extend-0.6.0.tgz
|
||||
Integrity: sha512-LOHxIOaPYdHlJRtCQfDIVZtfw/ufM8+rVj649RIHzcm/vGwQRXFt6OPqIFWsm2XEMrNIEtWR64sY1LEKD2vAOA==
|
||||
define-data-property@1.1.4 | runtime | MIT
|
||||
Lockfile path: node_modules/define-data-property
|
||||
Package: https://www.npmjs.com/package/define-data-property/v/1.1.4
|
||||
@@ -1525,7 +1495,7 @@ dequal@2.0.3 | development | MIT
|
||||
Package: https://www.npmjs.com/package/dequal/v/2.0.3
|
||||
Archive: https://registry.npmjs.org/dequal/-/dequal-2.0.3.tgz
|
||||
Integrity: sha512-0je+qPKHEMohvfRTCEo3CrPG6cAzAYgmzKyxRiYSSDkS6eGJdyVJm7WaYA5ECaAD9wLB2T4EEeymA5aFVcYXCA==
|
||||
detect-libc@2.1.2 | runtime | Apache-2.0
|
||||
detect-libc@2.1.2 | development | Apache-2.0
|
||||
Lockfile path: node_modules/detect-libc
|
||||
Package: https://www.npmjs.com/package/detect-libc/v/2.1.2
|
||||
Archive: https://registry.npmjs.org/detect-libc/-/detect-libc-2.1.2.tgz
|
||||
@@ -1560,11 +1530,6 @@ emoji-regex-xs@1.0.0 | development | MIT
|
||||
Package: https://www.npmjs.com/package/emoji-regex-xs/v/1.0.0
|
||||
Archive: https://registry.npmjs.org/emoji-regex-xs/-/emoji-regex-xs-1.0.0.tgz
|
||||
Integrity: sha512-LRlerrMYoIDrT6jgpeZ2YYl/L8EulRTt5hQcYjy5AInh7HWXKimpqx68aknBFpGL2+/IcogTcaydJEgaTmOpDg==
|
||||
end-of-stream@1.4.5 | runtime, optional | MIT
|
||||
Lockfile path: node_modules/end-of-stream
|
||||
Package: https://www.npmjs.com/package/end-of-stream/v/1.4.5
|
||||
Archive: https://registry.npmjs.org/end-of-stream/-/end-of-stream-1.4.5.tgz
|
||||
Integrity: sha512-ooEGc6HP26xXq/N+GCGOT0JKCLDGrq2bQUZrQ7gyrJiZANJ/8YDTxTpQBXGMn+WbIQXNVpyWymm7KYVICQnyOg==
|
||||
entities@7.0.1 | development | BSD-2-Clause
|
||||
Lockfile path: node_modules/entities
|
||||
Package: https://www.npmjs.com/package/entities/v/7.0.1
|
||||
@@ -1630,11 +1595,6 @@ evmole@0.9.3 | runtime | MIT
|
||||
Package: https://www.npmjs.com/package/evmole/v/0.9.3
|
||||
Archive: https://registry.npmjs.org/evmole/-/evmole-0.9.3.tgz
|
||||
Integrity: sha512-UhO5HMAoEPCupSxvBJPlm/L0Qk/KVJ/OJo3r4EyhXADIEHqU5aTkAzsBfzk4lXGjqxVnaYbh1GPSmZtmSHFnQQ==
|
||||
expand-template@2.0.3 | runtime, optional | (MIT OR WTFPL)
|
||||
Lockfile path: node_modules/expand-template
|
||||
Package: https://www.npmjs.com/package/expand-template/v/2.0.3
|
||||
Archive: https://registry.npmjs.org/expand-template/-/expand-template-2.0.3.tgz
|
||||
Integrity: sha512-XYfuKMvj4O35f/pOXLObndIRvyQ+/+6AhODh+OKWj9S9498pHHn/IMszH+gt0fBCRWMNfk1ZSp5x3AifmnI2vg==
|
||||
expect-type@1.4.0 | development | Apache-2.0
|
||||
Lockfile path: node_modules/expect-type
|
||||
Package: https://www.npmjs.com/package/expect-type/v/1.4.0
|
||||
@@ -1680,11 +1640,6 @@ fdir@6.5.0 | development | MIT
|
||||
Package: https://www.npmjs.com/package/fdir/v/6.5.0
|
||||
Archive: https://registry.npmjs.org/fdir/-/fdir-6.5.0.tgz
|
||||
Integrity: sha512-tIbYtZbucOs0BRGqPJkshJUYdL+SDH7dVM8gjy+ERp3WAUjLEFJE+02kanyHtwjWOnwrKYBiwAmM0p4kLJAnXg==
|
||||
file-uri-to-path@1.0.0 | runtime, optional | MIT
|
||||
Lockfile path: node_modules/file-uri-to-path
|
||||
Package: https://www.npmjs.com/package/file-uri-to-path/v/1.0.0
|
||||
Archive: https://registry.npmjs.org/file-uri-to-path/-/file-uri-to-path-1.0.0.tgz
|
||||
Integrity: sha512-0Zt+s3L7Vf1biwWZ29aARiVYLx7iMGnEUl9x33fbB/j3jR81u/O2LbqK+Bm1CDSNDKVtJ/YjwY7TUd5SkeLQLw==
|
||||
focus-trap@7.8.0 | development | MIT
|
||||
Lockfile path: node_modules/focus-trap
|
||||
Package: https://www.npmjs.com/package/focus-trap/v/7.8.0
|
||||
@@ -1700,16 +1655,6 @@ formatly@0.7.1 | development | MIT
|
||||
Package: https://www.npmjs.com/package/formatly/v/0.7.1
|
||||
Archive: https://registry.npmjs.org/formatly/-/formatly-0.7.1.tgz
|
||||
Integrity: sha512-ESuCEJE0SGgabl9q+zABI8LhJDmF+8nhpuqDzuM48HfJ9QTD5o6PqFJDFZY7w6f8xsh5lixuj5nJsQNvYOWvKQ==
|
||||
frida@17.23.2 | runtime, optional | LGPL-2.0 WITH WxWindows-exception-3.1
|
||||
Lockfile path: node_modules/frida
|
||||
Package: https://www.npmjs.com/package/frida/v/17.23.2
|
||||
Archive: https://registry.npmjs.org/frida/-/frida-17.23.2.tgz
|
||||
Integrity: sha512-gRCmmTUFdEILyHRN1b66erRoXafwsfWTqXyoBBqkSCFX0Ue7Jhvs/KhA3JO0XrgITNlPd91QAGsFvWzh0mhVgg==
|
||||
fs-constants@1.0.0 | runtime, optional | MIT
|
||||
Lockfile path: node_modules/fs-constants
|
||||
Package: https://www.npmjs.com/package/fs-constants/v/1.0.0
|
||||
Archive: https://registry.npmjs.org/fs-constants/-/fs-constants-1.0.0.tgz
|
||||
Integrity: sha512-y6OAwoSIf7FyjMIv94u+b5rdheZEjzR63GTyZJm5qh4Bi+2YgwLCcI/fPFZkL5PSixOt6ZNKm+w+Hfp/Bciwow==
|
||||
fsevents@2.3.3 | development, optional | MIT
|
||||
Lockfile path: node_modules/fsevents
|
||||
Package: https://www.npmjs.com/package/fsevents/v/2.3.3
|
||||
@@ -1740,11 +1685,6 @@ get-tsconfig@4.14.3 | development | MIT
|
||||
Package: https://www.npmjs.com/package/get-tsconfig/v/4.14.3
|
||||
Archive: https://registry.npmjs.org/get-tsconfig/-/get-tsconfig-4.14.3.tgz
|
||||
Integrity: sha512-++QEw4DIY7WGoukz+/+A/8dGYPT9l9yIadnmSgZ8Rjr3YVSVDipQSO9CdnJo9ePqFqUUqh+wk9uIaoiAwsiPkA==
|
||||
github-from-package@0.0.0 | runtime, optional | MIT
|
||||
Lockfile path: node_modules/github-from-package
|
||||
Package: https://www.npmjs.com/package/github-from-package/v/0.0.0
|
||||
Archive: https://registry.npmjs.org/github-from-package/-/github-from-package-0.0.0.tgz
|
||||
Integrity: sha512-SyHy3T1v2NUXn29OsWdxmK6RwHD+vkj3v8en8AOBZ1wBQ/hCAQ5bAQTD02kW4W9tUp/3Qh6J8r9EvntiyCmOOw==
|
||||
glob@13.0.6 | runtime | BlueOak-1.0.0
|
||||
Lockfile path: node_modules/glob
|
||||
Package: https://www.npmjs.com/package/glob/v/13.0.6
|
||||
@@ -1835,11 +1775,6 @@ inherits@2.0.4 | runtime | ISC
|
||||
Package: https://www.npmjs.com/package/inherits/v/2.0.4
|
||||
Archive: https://registry.npmjs.org/inherits/-/inherits-2.0.4.tgz
|
||||
Integrity: sha512-k/vGaX4/Yla3WzyMCvTQOXYeIHvqOKtnqBduzTHpzpQZzAskKMhZ2K+EnBiSM9zGSoIFeMpXKxa4dYeZIQqewQ==
|
||||
ini@1.3.8 | runtime, optional | ISC
|
||||
Lockfile path: node_modules/ini
|
||||
Package: https://www.npmjs.com/package/ini/v/1.3.8
|
||||
Archive: https://registry.npmjs.org/ini/-/ini-1.3.8.tgz
|
||||
Integrity: sha512-JV/yugV2uzW5iMRSiZAyDtQd+nxtUnjeLt0acNdw98kKLrvuRVyB80tsREOE7yvGVgalhZ6RNXCmEHkUKBKxew==
|
||||
is-callable@1.2.7 | runtime | MIT
|
||||
Lockfile path: node_modules/is-callable
|
||||
Package: https://www.npmjs.com/package/is-callable/v/1.2.7
|
||||
@@ -2145,26 +2080,11 @@ mitt@3.0.1 | development | MIT
|
||||
Package: https://www.npmjs.com/package/mitt/v/3.0.1
|
||||
Archive: https://registry.npmjs.org/mitt/-/mitt-3.0.1.tgz
|
||||
Integrity: sha512-vKivATfr97l2/QBCYAkXYDbrIWPM2IIKEl7YPhjCvKlG3kE2gm+uBo6nEXK3M5/Ffh/FLpKExzOQ3JJoJGFKBw==
|
||||
mkdirp-classic@0.5.3 | runtime, optional | MIT
|
||||
Lockfile path: node_modules/mkdirp-classic
|
||||
Package: https://www.npmjs.com/package/mkdirp-classic/v/0.5.3
|
||||
Archive: https://registry.npmjs.org/mkdirp-classic/-/mkdirp-classic-0.5.3.tgz
|
||||
Integrity: sha512-gKLcREMhtuZRwRAfqP3RFW+TK4JqApVBtOIftVgjuABpAtpxhPGaDcfvbhNvD0B8iD1oUr/txX35NjcaY6Ns/A==
|
||||
nanoid@3.3.20 | development | MIT
|
||||
Lockfile path: node_modules/nanoid
|
||||
Package: https://www.npmjs.com/package/nanoid/v/3.3.20
|
||||
Archive: https://registry.npmjs.org/nanoid/-/nanoid-3.3.20.tgz
|
||||
Integrity: sha512-uKdg2G3GNCKQn9byYOpxbGqrT2fGO5KRt5J/8b3pok8rT6qxGWF6hxMyJiEYtAf+FVyYuD9hRaDqX5uPFYJ4ZQ==
|
||||
napi-build-utils@2.0.0 | runtime, optional | MIT
|
||||
Lockfile path: node_modules/napi-build-utils
|
||||
Package: https://www.npmjs.com/package/napi-build-utils/v/2.0.0
|
||||
Archive: https://registry.npmjs.org/napi-build-utils/-/napi-build-utils-2.0.0.tgz
|
||||
Integrity: sha512-GEbrYkbfF7MoNaoh2iGG84Mnf/WZfB0GdGEsM8wz7Expx/LlWf5U8t9nvJKXSp3qr5IsEbK04cBGhol/KwOsWA==
|
||||
node-abi@3.98.0 | runtime, optional | MIT
|
||||
Lockfile path: node_modules/node-abi
|
||||
Package: https://www.npmjs.com/package/node-abi/v/3.98.0
|
||||
Archive: https://registry.npmjs.org/node-abi/-/node-abi-3.98.0.tgz
|
||||
Integrity: sha512-Llh8noNw7s15m+rmIrZnZQbe4gLyasL9loT74rC92PkmwWKeEedKvc7o6pjp8B3MhrYT/Cl846NOYZbz1wmddw==
|
||||
obug@2.2.1 | development | MIT
|
||||
Lockfile path: node_modules/obug
|
||||
Package: https://www.npmjs.com/package/obug/v/2.2.1
|
||||
@@ -2310,11 +2230,6 @@ preact@10.29.8 | development | MIT
|
||||
Package: https://www.npmjs.com/package/preact/v/10.29.8
|
||||
Archive: https://registry.npmjs.org/preact/-/preact-10.29.8.tgz
|
||||
Integrity: sha512-ej2aVZ+vZ8WO7tvlQWRM9N63A0KzF9q4mWJfDUHgYaIofWY9hu74QdnQrjoPMmZi2/nZ5gN0bJCQF49xQqx09Q==
|
||||
prebuild-install@7.1.3 | runtime, optional | MIT
|
||||
Lockfile path: node_modules/prebuild-install
|
||||
Package: https://www.npmjs.com/package/prebuild-install/v/7.1.3
|
||||
Archive: https://registry.npmjs.org/prebuild-install/-/prebuild-install-7.1.3.tgz
|
||||
Integrity: sha512-8Mf2cbV7x1cXPUILADGI3wuhfqWvtiLA1iclTDbFRZkgRQS0NqsPZphna9V+HyTEadheuPmjaJMsbzKQFOzLug==
|
||||
process@0.11.10 | runtime | MIT
|
||||
Lockfile path: node_modules/process
|
||||
Package: https://www.npmjs.com/package/process/v/0.11.10
|
||||
@@ -2330,11 +2245,6 @@ property-information@7.2.0 | development | MIT
|
||||
Package: https://www.npmjs.com/package/property-information/v/7.2.0
|
||||
Archive: https://registry.npmjs.org/property-information/-/property-information-7.2.0.tgz
|
||||
Integrity: sha512-IAtzIB6sUiWaJYrX9smp3V46pBGbBeLFRGdh25kg1334VcBlD8HzhPeNIWQH9zhGmo2itIe25EHt9dQP7G5hmg==
|
||||
pump@3.0.4 | runtime, optional | MIT
|
||||
Lockfile path: node_modules/pump
|
||||
Package: https://www.npmjs.com/package/pump/v/3.0.4
|
||||
Archive: https://registry.npmjs.org/pump/-/pump-3.0.4.tgz
|
||||
Integrity: sha512-VS7sjc6KR7e1ukRFhQSY5LM2uBWAUPiOPa/A3mkKmiMwSmRFUITt0xuj+/lesgnCv+dPIEYlkzrcyXgquIHMcA==
|
||||
pure-rand@8.4.2 | development | MIT
|
||||
Lockfile path: node_modules/pure-rand
|
||||
Package: https://www.npmjs.com/package/pure-rand/v/8.4.2
|
||||
@@ -2345,16 +2255,6 @@ quick-format-unescaped@4.0.4 | runtime | MIT
|
||||
Package: https://www.npmjs.com/package/quick-format-unescaped/v/4.0.4
|
||||
Archive: https://registry.npmjs.org/quick-format-unescaped/-/quick-format-unescaped-4.0.4.tgz
|
||||
Integrity: sha512-tYC1Q1hgyRuHgloV/YXs2w15unPVh8qfu/qCTfhTYamaw7fyhumKa2yGpdSo87vY32rIclj+4fWYQXUMs9EHvg==
|
||||
rc@1.2.8 | runtime, optional | (BSD-2-Clause OR MIT OR Apache-2.0)
|
||||
Lockfile path: node_modules/rc
|
||||
Package: https://www.npmjs.com/package/rc/v/1.2.8
|
||||
Archive: https://registry.npmjs.org/rc/-/rc-1.2.8.tgz
|
||||
Integrity: sha512-y3bGgqKj3QBdxLbLkomlohkvsA8gdAiUQlSBJnBhfn+BPxg4bc62d8TcBW15wavDfgexCgccckhcZvywyQYPOw==
|
||||
strip-json-comments@2.0.1 | runtime, optional | MIT
|
||||
Lockfile path: node_modules/rc/node_modules/strip-json-comments
|
||||
Package: https://www.npmjs.com/package/strip-json-comments/v/2.0.1
|
||||
Archive: https://registry.npmjs.org/strip-json-comments/-/strip-json-comments-2.0.1.tgz
|
||||
Integrity: sha512-4gB8na07fecVVkOI6Rs4e7T6NOTki5EmL7TUduTs6bu3EdnSycntVJ4re8kgZA+wx9IueI2Y11bfbgwtzuE0KQ==
|
||||
readable-stream@4.7.0 | runtime | MIT
|
||||
Lockfile path: node_modules/readable-stream
|
||||
Package: https://www.npmjs.com/package/readable-stream/v/4.7.0
|
||||
@@ -2565,21 +2465,6 @@ tabbable@6.5.0 | development | MIT
|
||||
Package: https://www.npmjs.com/package/tabbable/v/6.5.0
|
||||
Archive: https://registry.npmjs.org/tabbable/-/tabbable-6.5.0.tgz
|
||||
Integrity: sha512-wieBHXygIm7OyQOu5hQlkk62/WyCFYGlWg7L6/ZCUZwx0o398Zkn4pVmMyfYhfMG8kGrj/Krt8eIk6UKC6VzwA==
|
||||
tar-fs@2.1.5 | runtime, optional | MIT
|
||||
Lockfile path: node_modules/tar-fs
|
||||
Package: https://www.npmjs.com/package/tar-fs/v/2.1.5
|
||||
Archive: https://registry.npmjs.org/tar-fs/-/tar-fs-2.1.5.tgz
|
||||
Integrity: sha512-OboTd8mmMhZDNPV+UjQcK9yKAatXu2aJ+r1w4im1Otd4M4fl2hwvdoXUxIYHFTHWK/3y3FarBP70v3vwmGlOxw==
|
||||
tar-stream@2.2.0 | runtime, optional | MIT
|
||||
Lockfile path: node_modules/tar-stream
|
||||
Package: https://www.npmjs.com/package/tar-stream/v/2.2.0
|
||||
Archive: https://registry.npmjs.org/tar-stream/-/tar-stream-2.2.0.tgz
|
||||
Integrity: sha512-ujeqbceABgwMZxEJnk2HDY2DlnUZ+9oEcb1KzTVfYHio0UE6dG71n60d8D2I4qNvleWrrXpmjpt7vZeF1LnMZQ==
|
||||
readable-stream@3.6.2 | runtime, optional | MIT
|
||||
Lockfile path: node_modules/tar-stream/node_modules/readable-stream
|
||||
Package: https://www.npmjs.com/package/readable-stream/v/3.6.2
|
||||
Archive: https://registry.npmjs.org/readable-stream/-/readable-stream-3.6.2.tgz
|
||||
Integrity: sha512-9u/sniCrY3D5WdsERHzHE4G2YCXqoG5FTHUiCC4SIbr6XcLZBY05ya9EKjYek9O5xOAwjGq+1JdGBAS7Q9ScoA==
|
||||
thread-stream@4.2.0 | runtime | MIT
|
||||
Lockfile path: node_modules/thread-stream
|
||||
Package: https://www.npmjs.com/package/thread-stream/v/4.2.0
|
||||
@@ -2630,11 +2515,6 @@ tslib@2.8.1 | development, optional | 0BSD
|
||||
Package: https://www.npmjs.com/package/tslib/v/2.8.1
|
||||
Archive: https://registry.npmjs.org/tslib/-/tslib-2.8.1.tgz
|
||||
Integrity: sha512-oJFu94HQb+KVduSUQL7wnpmqnfmLsOA/nAh6b6EH0wCEoK0/mPeXU6c3wKDV83MkOuHPRHtSXKKU99IBazS/2w==
|
||||
tunnel-agent@0.6.0 | runtime, optional | Apache-2.0
|
||||
Lockfile path: node_modules/tunnel-agent
|
||||
Package: https://www.npmjs.com/package/tunnel-agent/v/0.6.0
|
||||
Archive: https://registry.npmjs.org/tunnel-agent/-/tunnel-agent-0.6.0.tgz
|
||||
Integrity: sha512-McnNiV1l8RYeY8tBgEpuodCC1mLUdbSN+CYBL7kJsJNInOP8UjDDEwdk6Mw60vdLLrr5NHKZhMAOSrR2NZuQ+w==
|
||||
turbo@2.11.7 | development | MIT
|
||||
Lockfile path: node_modules/turbo
|
||||
Package: https://www.npmjs.com/package/turbo/v/2.11.7
|
||||
@@ -2690,11 +2570,6 @@ unist-util-visit-parents@6.0.2 | development | MIT
|
||||
Package: https://www.npmjs.com/package/unist-util-visit-parents/v/6.0.2
|
||||
Archive: https://registry.npmjs.org/unist-util-visit-parents/-/unist-util-visit-parents-6.0.2.tgz
|
||||
Integrity: sha512-goh1s1TBrqSqukSc8wrjwWhL0hiJxgA8m4kFxGlQ+8FYQ3C/m11FcTs4YYem7V664AhHVvgoQLk890Ssdsr2IQ==
|
||||
util-deprecate@1.0.2 | runtime, optional | MIT
|
||||
Lockfile path: node_modules/util-deprecate
|
||||
Package: https://www.npmjs.com/package/util-deprecate/v/1.0.2
|
||||
Archive: https://registry.npmjs.org/util-deprecate/-/util-deprecate-1.0.2.tgz
|
||||
Integrity: sha512-EPD5q1uXyFxJpCrLnCc1nHnq3gOa6DZBocAIiI2TaSCA7VCJ1UJDMagCzIkXNsUYfD1daK//LTEQ8xiIbrHtcw==
|
||||
vfile@6.0.3 | development | MIT
|
||||
Lockfile path: node_modules/vfile
|
||||
Package: https://www.npmjs.com/package/vfile/v/6.0.3
|
||||
|
||||
File diff suppressed because it is too large.
Load diff
@@ -58,15 +58,5 @@
|
||||
"file": "licenses/Node-22.19.0-LICENSE.txt",
|
||||
"source": "https://raw.githubusercontent.com/nodejs/node/v22.19.0/LICENSE",
|
||||
"sha256": "e991d81497a85bb24fc6bffae0a3637a6accd6c6bc5ce1f2c5698bd555cf9d49"
|
||||
},
|
||||
{
|
||||
"file": "licenses/frida-17.23.2-COPYING.txt",
|
||||
"source": "https://raw.githubusercontent.com/frida/frida/9adf8ed33ab6f1122b17399ee96dcbe101b941c9/COPYING",
|
||||
"sha256": "5ea1544b51a28bc823b03159190d4108f9fb4f4ef912389f5137c6d295e175b2"
|
||||
},
|
||||
{
|
||||
"file": "licenses/LGPL-2.0.txt",
|
||||
"source": "https://www.gnu.org/licenses/old-licenses/lgpl-2.0.txt",
|
||||
"sha256": "cc535c21133c895b56b374c8a1dc1eb948d99003ed2b47372069456b62f42b24"
|
||||
}
|
||||
]
|
||||
@@ -85,17 +85,6 @@ Windows failures retain their constraint, requested coordinate, Win32 code,
|
||||
and system message. Unsupported filesystems and reparse paths are distinct
|
||||
from OS access denial and missing packaged controls.
|
||||
|
||||
A failed runtime-parent admission additionally reports
|
||||
`runtimeAllocation: "not-started"`: no runtime directory was created. The
|
||||
Windows adapter uses that fact with numeric sharing/lock codes 32/33 to retain
|
||||
a retryable private-runtime failure, including after successful native
|
||||
authority caching. Missing allocation evidence, other codes, and opaque error
|
||||
text do not establish a safe retry. Analysis errors propagate the producer's
|
||||
retry disposition through JavaScript, source-map and WABT workflows; transient
|
||||
failures report `category: unavailable` and retain the original reason.
|
||||
Incomplete cleanup blocks an operation retry until its owned resources settle.
|
||||
REA adds no automatic retry loop or new analysis cache for this behavior.
|
||||
|
||||
Ordinary drive-absolute paths accept backslashes, forward slashes, or mixed
|
||||
separators. File identity retains the original requested spelling. Separator
|
||||
translation does not resolve dot components, repeated separators, or extend
|
||||
|
||||
@@ -87,8 +87,6 @@ napi_value failureValue(napi_env env, const Failure& failure) {
|
||||
set(env, error, "requestedPath", string(env, failure.path));
|
||||
set(env, error, "win32Code", number(env, failure.win32));
|
||||
set(env, error, "win32Message", string(env, detail));
|
||||
if (failure.runtimeDirectoryUnallocated)
|
||||
set(env, error, "runtimeAllocation", string(env, std::string("not-started")));
|
||||
return error;
|
||||
}
|
||||
|
||||
|
||||
@@ -33,8 +33,6 @@ struct Failure : std::runtime_error {
|
||||
DWORD win32;
|
||||
std::wstring path;
|
||||
std::string constraint;
|
||||
// Affirmative proof for a failed runtime-parent admission; omission is unknown.
|
||||
bool runtimeDirectoryUnallocated = false;
|
||||
Failure(std::string constraint, std::wstring path = L"", DWORD code = GetLastError())
|
||||
: std::runtime_error(constraint), win32(code), path(std::move(path)),
|
||||
constraint(std::move(constraint)) {}
|
||||
|
||||
@@ -212,12 +212,7 @@ static void verifyPrivate(HANDLE handle, const std::wstring& path, bool root) {
|
||||
}
|
||||
|
||||
std::unique_ptr<Runtime> createRuntime(const std::wstring& parentPath, const std::wstring& prefix) {
|
||||
std::unique_ptr<File> parent;
|
||||
try { parent = openFile(parentPath, 0, true); }
|
||||
catch (Failure& failure) {
|
||||
failure.runtimeDirectoryUnallocated = true;
|
||||
throw;
|
||||
}
|
||||
auto parent = openFile(parentPath, 0, true);
|
||||
require(!prefix.empty() && prefix.find_first_of(L"\\/:\"<>|?*") == std::wstring::npos,
|
||||
"Runtime prefix must be one filename component", parentPath, ERROR_INVALID_PARAMETER);
|
||||
std::array<unsigned char, 16> random;
|
||||
|
||||
+4
-8
@@ -130,7 +130,7 @@
|
||||
"test": "npm run test:with-build",
|
||||
"test:with-build": "npm run test:prepare && vitest run",
|
||||
"test:run": "vitest run",
|
||||
"test:python": "python3 -m unittest bridge/native/test_rea_lldb_tracer.py -v && python3 -m unittest discover -s experiments/analysis-efficiency -p 'test_*.py' -v",
|
||||
"test:python": "python3 -m unittest bridge/native/test_rea_lldb_tracer.py -v",
|
||||
"test:local": "node scripts/run-development-tests.mjs local",
|
||||
"test:fast": "vitest run --project domain --project services --project adapters --project composition --project conformance --project evaluation",
|
||||
"pretest:boundary": "npm run test:prepare",
|
||||
@@ -167,7 +167,6 @@
|
||||
"verify:legacy-simulator": "npm run build:cached && node scripts/verify/apple/legacy-simulator.mjs",
|
||||
"verify:architecture-guards": "node scripts/verify/architecture-guards.mjs",
|
||||
"verify:apktool": "npm run build:cached && node scripts/verify-apktool.mjs",
|
||||
"verify:pcap": "npm run build:cached && node scripts/verify-pcap.mjs",
|
||||
"verify:flutter": "npm run build:cached && node scripts/verify-flutter.mjs",
|
||||
"verify:adb": "npm run build:cached && node scripts/verify-adb.mjs",
|
||||
"verify:ghidra": "npm run build:cached && node scripts/verify-real-ghidra.mjs",
|
||||
@@ -207,7 +206,7 @@
|
||||
"fixtures:harmony": "node scripts/fixtures/harmony/fetch.mjs",
|
||||
"verify:agent": "npm run build:cached && node scripts/verify-agent-experience.mjs",
|
||||
"verify:hopper:linux": "npm run verify:fixtures && npm run build:cached && node scripts/verify-real-hopper-linux.mjs",
|
||||
"verify:setup:linux": "npm run verify:fixtures && npm run build:cached && node scripts/verify-linux-setup-e2e.mjs",
|
||||
"verify:setup:linux": "npm run build:cached && node scripts/verify-linux-setup-e2e.mjs",
|
||||
"build:fixtures": "node scripts/build-conformance-fixtures.mjs",
|
||||
"build:ghidra-windows-fixture": "node scripts/create-ghidra-windows-fixture.mjs",
|
||||
"verify:fixtures": "npm run build:fixtures && node scripts/verify-conformance-fixtures.mjs",
|
||||
@@ -237,7 +236,7 @@
|
||||
"docs:preview": "vitepress preview docs",
|
||||
"docs:generate": "node scripts/check-dependency-install.mjs && node scripts/run-exclusive.mjs artifacts npm run docs:prepare",
|
||||
"docs:check": "node scripts/check-dependency-install.mjs && node scripts/run-exclusive.mjs artifacts turbo run docs:check:built && npm run test:local -- tests/conformance/readmeConsistency.test.ts",
|
||||
"docs:check:built": "node scripts/generate-package-metadata.mjs --check && node scripts/generate-skill-metadata.mjs --check && node scripts/generate-product-catalog.mjs --check && node scripts/generate-completion-ledger.mjs --check && node scripts/check-doc-facts.mjs && node scripts/generate-error-schema.mjs --check && npm run licenses:check",
|
||||
"docs:check:built": "node scripts/generate-package-metadata.mjs --check && node scripts/generate-skill-metadata.mjs --check && node scripts/generate-product-catalog.mjs --check && node scripts/generate-completion-ledger.mjs --check && node scripts/check-doc-facts.mjs && node scripts/generate-error-schema.mjs --check",
|
||||
"docs:error-schema": "node scripts/check-dependency-install.mjs && node scripts/run-exclusive.mjs artifacts turbo run artifacts:error-schema",
|
||||
"prepack": "node scripts/prepack.mjs",
|
||||
"prepare": "node scripts/prepare.mjs",
|
||||
@@ -279,10 +278,7 @@
|
||||
"artifacts:error-schema": "node scripts/generate-error-schema.mjs",
|
||||
"test:prepare": "node scripts/check-dependency-install.mjs && node scripts/run-exclusive.mjs artifacts turbo run artifacts:mcp-catalog artifacts:product-catalog artifacts:managed-evidence",
|
||||
"evidence:check:built": "node scripts/generate-completion-ledger.mjs --check",
|
||||
"docs:prepare": "node scripts/generate-package-metadata.mjs && turbo run artifacts:product-catalog artifacts:managed-evidence artifacts:error-schema",
|
||||
"verify:web:qlog": "npm run build:cached && node scripts/verify-qlog-captures.mjs",
|
||||
"licenses:generate": "node scripts/generate-third-party-inventory.mjs",
|
||||
"licenses:check": "node scripts/generate-third-party-inventory.mjs --check"
|
||||
"docs:prepare": "node scripts/generate-package-metadata.mjs && turbo run artifacts:product-catalog artifacts:managed-evidence artifacts:error-schema"
|
||||
},
|
||||
"lint-staged": {
|
||||
"*.{cjs,cts,js,jsx,mjs,mts,ts,tsx}": [
|
||||
|
||||
@@ -55,7 +55,6 @@ export const SCOPES = {
|
||||
"tests/boundary/providers/native/artifactProvider.extractionCompleteness.test.ts",
|
||||
"tests/boundary/filesystem/setupUnavailableProvider.test.ts",
|
||||
"tests/boundary/filesystem/windowsNpxRegistration.test.ts",
|
||||
"tests/acceptance/setup/homeDirectoryFallback.test.ts",
|
||||
"tests/boundary/filesystem/webScriptManifestPaths.test.ts",
|
||||
"tests/boundary/process/ProcessEvidence.host.test.ts",
|
||||
"tests/acceptance/webModuleCli.test.ts",
|
||||
|
||||
@@ -1,120 +0,0 @@
|
||||
import { createHash } from "node:crypto";
|
||||
import { readFile } from "node:fs/promises";
|
||||
import { dirname, join } from "node:path";
|
||||
import { fileURLToPath } from "node:url";
|
||||
|
||||
import { ensureGeneratedFile } from "./lib/generated-file.mjs";
|
||||
|
||||
const arguments_ = new Set(process.argv.slice(2));
|
||||
for (const argument of arguments_)
|
||||
if (argument !== "--check")
|
||||
throw new Error(`Unknown inventory option: ${argument}`);
|
||||
const root = join(dirname(fileURLToPath(import.meta.url)), "..");
|
||||
const lock = JSON.parse(
|
||||
await readFile(join(root, "package-lock.json"), "utf8"),
|
||||
);
|
||||
const entries = Object.entries(lock.packages)
|
||||
.filter(([path]) => path !== "")
|
||||
.map(([path, record]) => ({
|
||||
path,
|
||||
name: record.name ?? path.slice(path.lastIndexOf("node_modules/") + 13),
|
||||
version: record.version,
|
||||
license: record.license ?? "UNDECLARED",
|
||||
resolved: record.resolved,
|
||||
integrity: record.integrity,
|
||||
dev: record.dev === true,
|
||||
optional: record.optional === true,
|
||||
}))
|
||||
.sort((left, right) =>
|
||||
left.path < right.path ? -1 : left.path > right.path ? 1 : 0,
|
||||
);
|
||||
for (const entry of entries)
|
||||
for (const field of ["name", "version", "resolved", "integrity"])
|
||||
if (typeof entry[field] !== "string" || entry[field].length === 0)
|
||||
throw new Error(`Missing locked ${field}: ${entry.path}`);
|
||||
const runtime = entries.filter(({ dev }) => !dev);
|
||||
const runtimeFingerprint = createHash("sha256")
|
||||
.update(JSON.stringify(runtime))
|
||||
.digest("hex");
|
||||
const source = [
|
||||
"REA npm dependency inventory",
|
||||
"Prepared from the root package-lock.json; refresh this inventory when locked dependencies change.",
|
||||
"License identifiers are upstream lockfile declarations, not a legal assessment.",
|
||||
"Runtime includes transitive and optional platform packages; development includes build, test and website tooling.",
|
||||
`Locked package entries: ${entries.length}; runtime: ${runtime.length}.`,
|
||||
"Full runtime copyright/license/NOTICE texts: npm-runtime-notices.txt.",
|
||||
"",
|
||||
...entries.flatMap((entry) => [
|
||||
`${entry.name}@${entry.version} | ${entry.dev ? "development" : "runtime"}${entry.optional ? ", optional" : ""} | ${entry.license}`,
|
||||
` Lockfile path: ${entry.path}`,
|
||||
` Package: https://www.npmjs.com/package/${entry.name}/v/${entry.version}`,
|
||||
` Archive: ${entry.resolved}`,
|
||||
` Integrity: ${entry.integrity}`,
|
||||
]),
|
||||
"",
|
||||
].join("\n");
|
||||
await ensureGeneratedFile({
|
||||
path: join(root, "licenses/npm-dependencies.txt"),
|
||||
source,
|
||||
check: arguments_.has("--check"),
|
||||
generateCommand: "npm run licenses:generate",
|
||||
});
|
||||
|
||||
if (arguments_.has("--check")) {
|
||||
const notices = await readFile(
|
||||
join(root, "licenses/npm-runtime-notices.txt"),
|
||||
"utf8",
|
||||
);
|
||||
const headings = [...notices.matchAll(/^===== (.+) =====$/gmu)];
|
||||
const sections = new Map();
|
||||
for (const [index, heading] of headings.entries()) {
|
||||
if (sections.has(heading[1]))
|
||||
throw new Error(`Duplicate runtime notice: ${heading[1]}`);
|
||||
sections.set(
|
||||
heading[1],
|
||||
notices.slice(
|
||||
heading.index + heading[0].length + 1,
|
||||
headings[index + 1]?.index,
|
||||
),
|
||||
);
|
||||
}
|
||||
for (const entry of runtime) {
|
||||
const identity = `${entry.name}@${entry.version}`;
|
||||
const section = sections.get(identity);
|
||||
if (section === undefined)
|
||||
throw new Error(`Missing runtime notice: ${identity}`);
|
||||
const metadata = [
|
||||
`Declared license: ${entry.license}`,
|
||||
`Archive: ${entry.resolved}`,
|
||||
`Integrity: ${entry.integrity}`,
|
||||
"",
|
||||
].join("\n");
|
||||
if (!section.startsWith(metadata))
|
||||
throw new Error(`Runtime notice metadata differs for ${identity}`);
|
||||
}
|
||||
if (
|
||||
!notices
|
||||
.slice(0, headings[0]?.index)
|
||||
.includes(
|
||||
`Runtime dependency fingerprint (SHA-256): ${runtimeFingerprint}\n`,
|
||||
)
|
||||
)
|
||||
throw new Error(
|
||||
`Runtime notice fingerprint differs; refresh verified notices for ${runtimeFingerprint}`,
|
||||
);
|
||||
const references = JSON.parse(
|
||||
await readFile(join(root, "licenses/upstream-sources.json"), "utf8"),
|
||||
);
|
||||
for (const reference of references) {
|
||||
const bytes = await readFile(join(root, reference.file));
|
||||
if (createHash("sha256").update(bytes).digest("hex") !== reference.sha256)
|
||||
throw new Error(`Preserved notice digest differs: ${reference.file}`);
|
||||
}
|
||||
}
|
||||
console.log(
|
||||
JSON.stringify({
|
||||
locked_packages: entries.length,
|
||||
runtime_packages: runtime.length,
|
||||
runtime_dependency_fingerprint: runtimeFingerprint,
|
||||
}),
|
||||
);
|
||||
@@ -10,7 +10,6 @@ import json
|
||||
import os
|
||||
from pathlib import Path
|
||||
import secrets
|
||||
import select
|
||||
import stat
|
||||
import subprocess
|
||||
import tempfile
|
||||
@@ -119,7 +118,6 @@ class XWindowAttributes(ctypes.Structure):
|
||||
def parse_args() -> argparse.Namespace:
|
||||
parser = argparse.ArgumentParser()
|
||||
parser.add_argument("--probe", action="store_true")
|
||||
parser.add_argument("--owner-stdin", action="store_true")
|
||||
parser.add_argument("--hopper")
|
||||
parser.add_argument("--socket")
|
||||
parser.add_argument(
|
||||
@@ -135,43 +133,6 @@ def parse_args() -> argparse.Namespace:
|
||||
return parser.parse_args()
|
||||
|
||||
|
||||
class OwnerLifetime:
|
||||
"""The launcher's private pipe is a lifetime capability, independent of PIDs."""
|
||||
|
||||
def __init__(self, enabled: bool) -> None:
|
||||
self._poll = select.poll() if enabled else None
|
||||
if self._poll is not None:
|
||||
# Node/libuv can implement piped stdio with a Unix socket pair.
|
||||
mode = os.fstat(0).st_mode
|
||||
if not (stat.S_ISFIFO(mode) or stat.S_ISSOCK(mode)):
|
||||
raise AdapterFailure(
|
||||
INVALID_LAUNCH_COMMAND,
|
||||
"invalid_launch_command",
|
||||
"owner lifetime requires a private stdin pipe",
|
||||
)
|
||||
self._poll.register(0, select.POLLIN | select.POLLHUP | select.POLLERR)
|
||||
|
||||
def alive(self) -> bool:
|
||||
if self._poll is None:
|
||||
return True
|
||||
for _, events in self._poll.poll(0):
|
||||
if events & (select.POLLHUP | select.POLLERR | select.POLLNVAL):
|
||||
return False
|
||||
if events & select.POLLIN and not os.read(0, 4096):
|
||||
return False
|
||||
return True
|
||||
|
||||
|
||||
def wait_for_hopper(child: subprocess.Popen[bytes], owner: OwnerLifetime) -> int:
|
||||
while owner.alive():
|
||||
try:
|
||||
return child.wait(timeout=0.1)
|
||||
except subprocess.TimeoutExpired:
|
||||
continue
|
||||
# run_launch's finally owns cleanup of both direct, unreaped children.
|
||||
return 0
|
||||
|
||||
|
||||
def digest(path: Path) -> str:
|
||||
value = hashlib.sha256()
|
||||
with path.open("rb") as file:
|
||||
@@ -611,7 +572,6 @@ def start_xvfb(
|
||||
"-auth",
|
||||
str(authority),
|
||||
],
|
||||
stdin=subprocess.DEVNULL,
|
||||
stdout=subprocess.DEVNULL,
|
||||
stderr=subprocess.PIPE,
|
||||
)
|
||||
@@ -667,9 +627,6 @@ def run_launch(args: argparse.Namespace) -> int:
|
||||
"invalid_launch_command",
|
||||
"missing Hopper launch coordinates",
|
||||
)
|
||||
owner = OwnerLifetime(args.owner_stdin)
|
||||
if not owner.alive():
|
||||
return 0
|
||||
hopper = Path(args.hopper)
|
||||
socket = Path(args.socket)
|
||||
try:
|
||||
@@ -697,8 +654,6 @@ def run_launch(args: argparse.Namespace) -> int:
|
||||
child: subprocess.Popen[bytes] | None = None
|
||||
display: int | None = None
|
||||
try:
|
||||
if not owner.alive():
|
||||
return 0
|
||||
hopper_environment = dict(os.environ)
|
||||
for name in ("WAYLAND_DISPLAY", "WAYLAND_SOCKET"):
|
||||
hopper_environment.pop(name, None)
|
||||
@@ -711,10 +666,7 @@ def run_launch(args: argparse.Namespace) -> int:
|
||||
"XDG_SESSION_TYPE": "x11",
|
||||
}
|
||||
)
|
||||
# Children must not consume or retain REA's lifetime pipe.
|
||||
child = subprocess.Popen(
|
||||
command, env=hopper_environment, stdin=subprocess.DEVNULL
|
||||
)
|
||||
child = subprocess.Popen(command, env=hopper_environment)
|
||||
leader = os.getpid()
|
||||
os.environ["XAUTHORITY"] = str(authority)
|
||||
|
||||
@@ -750,12 +702,10 @@ def run_launch(args: argparse.Namespace) -> int:
|
||||
observed: list[tuple[int, int, int, int, int]] = []
|
||||
dialog: tuple[int, int, int, int, int] | None = None
|
||||
while time.monotonic() < deadline:
|
||||
if not owner.alive():
|
||||
return 0
|
||||
if socket.exists():
|
||||
x11.XCloseDisplay(display)
|
||||
display = None
|
||||
return wait_for_hopper(child, owner)
|
||||
return child.wait()
|
||||
if not hopper_is_owned(leader, hopper):
|
||||
if child.poll() is None:
|
||||
time.sleep(0.1)
|
||||
@@ -799,7 +749,7 @@ def run_launch(args: argparse.Namespace) -> int:
|
||||
x11.XFlush(display)
|
||||
x11.XCloseDisplay(display)
|
||||
display = None
|
||||
return wait_for_hopper(child, owner)
|
||||
return child.wait()
|
||||
except AdapterFailure as error:
|
||||
raise error.with_stderr(capture)
|
||||
finally:
|
||||
|
||||
@@ -52,11 +52,6 @@ export const toolFamilyCatalog = (sources) => {
|
||||
surface: "android-provider",
|
||||
contracts: sources.androidContracts.ANDROID_TOOL_CONTRACTS,
|
||||
},
|
||||
{
|
||||
id: "pcap",
|
||||
surface: "pcap-provider",
|
||||
contracts: sources.pcapContracts.PCAP_TOOL_CONTRACTS,
|
||||
},
|
||||
{
|
||||
id: "flutter",
|
||||
surface: "flutter-provider",
|
||||
@@ -256,10 +251,6 @@ export const providerCatalog = (sources) => {
|
||||
identity: sources.androidProvider.JADX_PROVIDER_IDENTITY,
|
||||
contracts: sources.androidContracts.ANDROID_TOOL_CONTRACTS,
|
||||
},
|
||||
{
|
||||
identity: sources.pcapProvider.PCAP_PROVIDER_IDENTITY,
|
||||
contracts: sources.pcapContracts.PCAP_TOOL_CONTRACTS,
|
||||
},
|
||||
{
|
||||
identity: sources.flutterProvider.FLUTTER_PROVIDER_IDENTITY,
|
||||
contracts: sources.flutterContracts.FLUTTER_TOOL_CONTRACTS,
|
||||
@@ -281,11 +272,6 @@ export const providerCatalog = (sources) => {
|
||||
contracts:
|
||||
sources.webNetworkCaptureContracts.WEB_NETWORK_CAPTURE_TOOL_CONTRACTS,
|
||||
},
|
||||
{
|
||||
identity: sources.webNetworkCaptureProvider.SAZ_CAPTURE_PROVIDER_IDENTITY,
|
||||
contracts:
|
||||
sources.webNetworkCaptureContracts.WEB_NETWORK_CAPTURE_TOOL_CONTRACTS,
|
||||
},
|
||||
{
|
||||
identity:
|
||||
sources.webNetworkCaptureProvider.MITMPROXY_CAPTURE_PROVIDER_IDENTITY,
|
||||
|
||||
@@ -68,8 +68,8 @@ const SOURCE_PATHS = {
|
||||
flutterProvider: "dist/flutter/FlutterBuildProvider.js",
|
||||
androidProvider: "dist/android/JadxRelease.js",
|
||||
apktoolContracts: "dist/contracts/apktool/apktoolToolContracts.js",
|
||||
pcapContracts: "dist/contracts/pcap/pcapToolContracts.js",
|
||||
pcapProvider: "dist/pcap/PcapProvider.js",
|
||||
flutterContracts: "dist/contracts/flutter/flutterToolContracts.js",
|
||||
flutterProvider: "dist/flutter/FlutterBuildProvider.js",
|
||||
apktoolProvider: "dist/apktool/ApktoolProvider.js",
|
||||
jebContracts: "dist/contracts/jeb/jebToolContracts.js",
|
||||
jebProvider: "dist/jeb/JebProvider.js",
|
||||
|
||||
@@ -1,3 +0,0 @@
|
||||
export function assertCleanLinuxHopperRuntime(
|
||||
launcherPaths?: readonly string[],
|
||||
): Promise<void>;
|
||||
@@ -1,70 +0,0 @@
|
||||
import { readFile, readdir, stat } from "node:fs/promises";
|
||||
import { basename } from "node:path";
|
||||
|
||||
/**
|
||||
* Observe leftover demo processes on a dedicated clean Linux runner, including
|
||||
* groups reparented after their launcher exits. This is not ownership proof and
|
||||
* never authorizes signaling; unrelated runtime processes also block this lane.
|
||||
*/
|
||||
export const assertCleanLinuxHopperRuntime = async (
|
||||
launcherPaths = [
|
||||
"/opt/hopper/bin/Hopper",
|
||||
...(process.env.HOPPER_LAUNCHER_PATH === undefined
|
||||
? []
|
||||
: [process.env.HOPPER_LAUNCHER_PATH]),
|
||||
],
|
||||
) => {
|
||||
const launchers = [];
|
||||
for (const path of launcherPaths) {
|
||||
try {
|
||||
launchers.push(await stat(path, { bigint: true }));
|
||||
} catch (error) {
|
||||
if (error?.code !== "ENOENT") throw error;
|
||||
}
|
||||
}
|
||||
// /proc exposes the executed file even when argv[0] names a removed symlink.
|
||||
// Compare file identity, not a display path or a process name.
|
||||
let inspectionError;
|
||||
for (const entry of await readdir("/proc", { withFileTypes: true })) {
|
||||
if (!entry.isDirectory() || !/^\d+$/u.test(entry.name)) continue;
|
||||
let retainedRuntime;
|
||||
try {
|
||||
// procfs preserves argument boundaries. A caller merely mentioning a
|
||||
// runtime in its script text or other arguments is not that runtime.
|
||||
const arguments_ = (
|
||||
await readFile(`/proc/${entry.name}/cmdline`, "utf8")
|
||||
).split("\0");
|
||||
retainedRuntime =
|
||||
arguments_[0] === "/opt/hopper/bin/Hopper" ||
|
||||
basename(arguments_[0] ?? "") === "Xvfb" ||
|
||||
(basename(arguments_[0] ?? "") === "python3" &&
|
||||
basename(arguments_[1] ?? "") === "hopper-demo-x11.py");
|
||||
if (!retainedRuntime && launchers.length > 0) {
|
||||
const executable = await stat(`/proc/${entry.name}/exe`, {
|
||||
bigint: true,
|
||||
});
|
||||
retainedRuntime = launchers.some(
|
||||
({ dev, ino }) => dev === executable.dev && ino === executable.ino,
|
||||
);
|
||||
}
|
||||
} catch (error) {
|
||||
if (error?.code === "ENOENT" || error?.code === "ESRCH") continue;
|
||||
// Other users' process facts may be unreadable. The setup lane launches
|
||||
// providers as the caller; unreadable caller-owned processes fail closed.
|
||||
if (error?.code === "EACCES") {
|
||||
const owner = await stat(`/proc/${entry.name}`).catch((cause) => {
|
||||
if (cause?.code === "ENOENT") return undefined;
|
||||
throw cause;
|
||||
});
|
||||
if (owner === undefined || owner.uid !== process.getuid()) continue;
|
||||
}
|
||||
// Finish the inventory so an unrelated restricted process cannot mask a
|
||||
// positively identified leak. Unknown caller processes still fail closed.
|
||||
inspectionError ??= error;
|
||||
continue;
|
||||
}
|
||||
if (retainedRuntime)
|
||||
throw new Error("Clean Linux runner retained a Hopper demo process");
|
||||
}
|
||||
if (inspectionError !== undefined) throw inspectionError;
|
||||
};
|
||||
@@ -1,130 +0,0 @@
|
||||
import assert from "node:assert/strict";
|
||||
import { execFile } from "node:child_process";
|
||||
import { setTimeout as delay } from "node:timers/promises";
|
||||
import { promisify } from "node:util";
|
||||
|
||||
import { Client } from "@modelcontextprotocol/client";
|
||||
import { StdioClientTransport } from "@modelcontextprotocol/client/stdio";
|
||||
|
||||
import { verifyNoTokenOwnedProcesses } from "../../dist/process/ProcessOwnership.js";
|
||||
import {
|
||||
observeProcessStartIdentity,
|
||||
signalProcessWithStartIdentity,
|
||||
} from "../../dist/process/ProcessOwnershipObservation.js";
|
||||
import { startUnrelatedHopperSentinel } from "./unrelated-hopper-sentinel.mjs";
|
||||
import {
|
||||
requireMcpEvidenceResult,
|
||||
requireMcpLifecycleResult,
|
||||
} from "./mcp-verifier-results.mjs";
|
||||
|
||||
const execFileAsync = promisify(execFile);
|
||||
|
||||
/** Prove actual MCP owner exit releases the demo singleton for subsequent CLI/MCP sessions. */
|
||||
export async function verifyLinuxHopperOwnerExit({
|
||||
primary,
|
||||
secondary,
|
||||
serverCommand,
|
||||
serverArgs,
|
||||
environment,
|
||||
}) {
|
||||
const sentinel = await startUnrelatedHopperSentinel();
|
||||
const outcomes = [];
|
||||
try {
|
||||
for (const mode of ["graceful", "SIGKILL"]) {
|
||||
const transport = new StdioClientTransport({
|
||||
command: serverCommand,
|
||||
args: serverArgs,
|
||||
env: environment,
|
||||
stderr: "pipe",
|
||||
});
|
||||
// Drain launcher diagnostics even on the deliberately interrupted owner.
|
||||
transport.stderr?.resume();
|
||||
const client = new Client({ name: "hopper-owner-exit", version: "1" });
|
||||
const options = { timeout: 180_000 };
|
||||
try {
|
||||
await client.connect(transport);
|
||||
const ownerPid = transport.pid;
|
||||
assert.ok(ownerPid !== null);
|
||||
const owner = await observeProcessStartIdentity(ownerPid);
|
||||
assert.equal(owner?.state, "readable");
|
||||
requireMcpLifecycleResult(
|
||||
await client.callTool(
|
||||
{
|
||||
name: "open_binary",
|
||||
arguments: { path: primary },
|
||||
},
|
||||
options,
|
||||
),
|
||||
"open_binary",
|
||||
);
|
||||
const procedures = requireMcpEvidenceResult(
|
||||
await client.callTool(
|
||||
{ name: "list_procedures", arguments: {} },
|
||||
options,
|
||||
),
|
||||
"list_procedures",
|
||||
);
|
||||
assert.ok(procedures.length > 0);
|
||||
const status = requireMcpLifecycleResult(
|
||||
await client.callTool(
|
||||
{ name: "binary_session", arguments: {} },
|
||||
options,
|
||||
),
|
||||
"binary_session",
|
||||
);
|
||||
const runId = status.analysis_run?.run_id;
|
||||
assert.equal(typeof runId, "string");
|
||||
assert.equal(status.analysis_provider_binding?.provider.id, "hopper");
|
||||
assert.equal((await verifyNoTokenOwnedProcesses(runId)).cleaned, false);
|
||||
if (mode === "graceful") await client.close();
|
||||
else {
|
||||
assert.equal(
|
||||
await signalProcessWithStartIdentity(
|
||||
ownerPid,
|
||||
owner.identity,
|
||||
"SIGKILL",
|
||||
),
|
||||
"signaled",
|
||||
);
|
||||
}
|
||||
const deadline = Date.now() + 10_000;
|
||||
let cleanup;
|
||||
do {
|
||||
cleanup = await verifyNoTokenOwnedProcesses(runId);
|
||||
if (cleanup.cleaned) break;
|
||||
await delay(100);
|
||||
} while (Date.now() < deadline);
|
||||
assert.equal(cleanup.cleaned, true, cleanup.reason);
|
||||
// The SIGKILL case must recover the stale lease for both target identities.
|
||||
for (const target of [primary, secondary]) {
|
||||
const result = await execFileAsync(
|
||||
process.execPath,
|
||||
[
|
||||
"scripts/rea.mjs",
|
||||
"inspect",
|
||||
target,
|
||||
"--provider",
|
||||
"hopper",
|
||||
"--format",
|
||||
"json",
|
||||
],
|
||||
{ env: environment, timeout: 180_000, maxBuffer: 16 * 1024 * 1024 },
|
||||
);
|
||||
assert.ok(JSON.parse(result.stdout).normalized_result);
|
||||
}
|
||||
outcomes.push({
|
||||
mode,
|
||||
ownedProcessesStopped: true,
|
||||
sameTargetReopened: true,
|
||||
differentTargetReopened: true,
|
||||
});
|
||||
} finally {
|
||||
await client.close();
|
||||
await transport.close();
|
||||
}
|
||||
}
|
||||
} finally {
|
||||
assert.equal(await sentinel.verifyAndClose(), true);
|
||||
}
|
||||
return { outcomes, unrelatedHopperSurvived: true };
|
||||
}
|
||||
@@ -1,31 +0,0 @@
|
||||
import type { z } from "zod";
|
||||
|
||||
import type { analysisStringSchema } from "../../src/domain/hopperValues.js";
|
||||
|
||||
type VerifierCall = (
|
||||
name: string,
|
||||
arguments_?: Record<string, unknown>,
|
||||
) => Promise<unknown>;
|
||||
|
||||
interface StringExpectation {
|
||||
readonly value: string;
|
||||
readonly encoding: string;
|
||||
readonly symbol?: string;
|
||||
readonly recognitionOptional?: boolean;
|
||||
}
|
||||
|
||||
/** Verify source bytes, observed decoding, address filters and literal searches. */
|
||||
export function verifyHopperStringObjects(
|
||||
call: VerifierCall,
|
||||
expectations: readonly StringExpectation[],
|
||||
inventory?: readonly z.output<typeof analysisStringSchema>[] | null,
|
||||
): Promise<{
|
||||
readonly sourceBytesVerified: true;
|
||||
readonly recognition: readonly {
|
||||
readonly value: string;
|
||||
readonly address: string;
|
||||
readonly state: "observed" | "not_observed";
|
||||
readonly decodedObject: "verified" | "unverified";
|
||||
}[];
|
||||
readonly displayEscapesExcludedFromMatching: true;
|
||||
}>;
|
||||
@@ -1,16 +1,13 @@
|
||||
import assert from "node:assert/strict";
|
||||
import { mcpTextValue } from "./mcp-verifier-results.mjs";
|
||||
|
||||
const fixtureSymbolPrefix = process.platform === "darwin" ? "_" : "";
|
||||
|
||||
/** Exercise literal/regex search, Unicode identities and cache invalidation in Hopper. */
|
||||
export async function verifyHopperSearch(call, invalid, procedure) {
|
||||
const address = procedure.address;
|
||||
const original = await call("address_name", { address });
|
||||
let stringCoverage;
|
||||
try {
|
||||
await verifySymbolNames(call, invalid, address);
|
||||
stringCoverage = await verifySearchModes(call, address);
|
||||
await verifySearchModes(call, address);
|
||||
} finally {
|
||||
await call("set_address_name", { address, name: original });
|
||||
}
|
||||
@@ -29,7 +26,7 @@ export async function verifyHopperSearch(call, invalid, procedure) {
|
||||
symbolUtf16LimitValidatedBeforeMutation: true,
|
||||
regexAndCaseModes: true,
|
||||
annotationCacheInvalidation: true,
|
||||
stringCoverage,
|
||||
escapedUtf8AndByteStrings: true,
|
||||
};
|
||||
}
|
||||
|
||||
@@ -106,26 +103,11 @@ async function verifySearchModes(call, address) {
|
||||
[{ address, value: "REA_Search_Upper" }],
|
||||
);
|
||||
const strings = await call("list_strings");
|
||||
const linux = process.platform === "linux";
|
||||
const fullLiteral = "REA_LONG_LITERAL_" + "x".repeat(4096) + "needle";
|
||||
// Recognition is a provider/loader capability, not an adapter guarantee.
|
||||
// Always retain the original size in raw-byte coverage; Linux additionally
|
||||
// requires an extent observed to produce native fragmented string objects.
|
||||
const fullBytes = Buffer.from(fullLiteral + "\0");
|
||||
const raw = await call("read_bytes", {
|
||||
address: `${fixtureSymbolPrefix}rea_long_literal`,
|
||||
length: fullBytes.length,
|
||||
});
|
||||
assert.equal(raw.complete, true);
|
||||
assert.equal(raw.bytes_hex, fullBytes.toString("hex"));
|
||||
const long = linux
|
||||
? "REA_FRAGMENTED_LITERAL_" + "x".repeat(512) + "fragment_tail"
|
||||
: fullLiteral;
|
||||
const longItem = strings.find(
|
||||
(item) => long.startsWith(item.value) && item.value.startsWith("REA_"),
|
||||
const long = "REA_LONG_LITERAL_" + "x".repeat(4096) + "needle";
|
||||
const longItem = strings.find((item) =>
|
||||
item.value.startsWith("REA_LONG_LITERAL_"),
|
||||
);
|
||||
assert.ok(longItem, "fixture omitted its real long literal");
|
||||
if (!linux) assert.equal(longItem.address, raw.address);
|
||||
assert.ok(long.startsWith(longItem.value));
|
||||
assert.ok(longItem.provider_value.endsWith("…"));
|
||||
assert.equal(longItem.string.termination, "missing");
|
||||
@@ -176,7 +158,7 @@ async function verifySearchModes(call, address) {
|
||||
}
|
||||
assert.deepEqual(
|
||||
await call("search_strings", {
|
||||
pattern: linux ? "fragment_tail" : "needle",
|
||||
pattern: "needle",
|
||||
mode: "literal",
|
||||
case_sensitive: true,
|
||||
}),
|
||||
@@ -194,122 +176,36 @@ async function verifySearchModes(call, address) {
|
||||
}),
|
||||
expected,
|
||||
);
|
||||
const objects = await verifyHopperStringObjects(
|
||||
call,
|
||||
[
|
||||
{
|
||||
value: "REA_UTF8_é_😀",
|
||||
encoding: "utf-8",
|
||||
symbol: `${fixtureSymbolPrefix}rea_utf8_literal`,
|
||||
recognitionOptional: linux,
|
||||
},
|
||||
{ value: 'REA_ESCAPED_"\\line\nend\t\r', encoding: "utf-8" },
|
||||
{ value: "REA_LITERAL_BACKSLASH_\\n", encoding: "utf-8" },
|
||||
{
|
||||
value: "REA_LITERAL_…",
|
||||
encoding: "utf-8",
|
||||
symbol: `${fixtureSymbolPrefix}rea_ellipsis_literal`,
|
||||
recognitionOptional: linux,
|
||||
},
|
||||
{
|
||||
value: "REA_LATIN1_ÿ",
|
||||
encoding: "latin-1",
|
||||
symbol: `${fixtureSymbolPrefix}rea_latin1_literal`,
|
||||
recognitionOptional: linux,
|
||||
},
|
||||
],
|
||||
strings,
|
||||
);
|
||||
return {
|
||||
fullLiteralSourceBytes: fullBytes.length,
|
||||
fragmentedLiteralSourceBytes: Buffer.byteLength(long),
|
||||
fullLiteralRecognition: {
|
||||
address: raw.address,
|
||||
state: strings.some((item) => item.address === raw.address)
|
||||
? "observed"
|
||||
: "not_observed",
|
||||
// Linux validates the original through raw bytes; its required decoded
|
||||
// fragment/dossier checks exercise the separate supported-size literal.
|
||||
decodedObject: linux ? "unverified" : "verified",
|
||||
},
|
||||
...objects,
|
||||
};
|
||||
await verifyHopperStringObjects(call, [
|
||||
{ value: "REA_UTF8_é_😀", encoding: "utf-8" },
|
||||
{ value: 'REA_ESCAPED_"\\line\nend\t\r', encoding: "utf-8" },
|
||||
{ value: "REA_LITERAL_BACKSLASH_\\n", encoding: "utf-8" },
|
||||
{ value: "REA_LITERAL_…", encoding: "utf-8" },
|
||||
{ value: "REA_LATIN1_ÿ", encoding: "latin-1" },
|
||||
]);
|
||||
}
|
||||
|
||||
/** Compare native string identities and values with the source fixture's bytes. */
|
||||
export async function verifyHopperStringObjects(
|
||||
call,
|
||||
expectations,
|
||||
inventory = null,
|
||||
) {
|
||||
// Reuse only the caller's inventory for this unchanged document, never live
|
||||
// state from an earlier session. Address-filter and search checks remain real.
|
||||
const strings = inventory ?? (await call("list_strings"));
|
||||
const recognition = [];
|
||||
for (const {
|
||||
value,
|
||||
encoding,
|
||||
symbol,
|
||||
recognitionOptional = false,
|
||||
} of expectations) {
|
||||
const expectedBytes = Buffer.from(
|
||||
value + "\0",
|
||||
encoding.replaceAll("-", ""),
|
||||
);
|
||||
let sourceBytes;
|
||||
if (symbol !== undefined) {
|
||||
const raw = await call("read_bytes", {
|
||||
address: symbol,
|
||||
length: expectedBytes.length,
|
||||
});
|
||||
sourceBytes = raw;
|
||||
assert.equal(raw.complete, true);
|
||||
assert.equal(raw.bytes_hex, expectedBytes.toString("hex"));
|
||||
}
|
||||
const item = strings.find((candidate) =>
|
||||
sourceBytes === undefined
|
||||
? candidate.value === value
|
||||
: candidate.address === sourceBytes.address,
|
||||
);
|
||||
if (item === undefined && recognitionOptional) {
|
||||
assert.ok(
|
||||
symbol,
|
||||
"optional recognition requires independent source-byte coverage",
|
||||
);
|
||||
recognition.push({
|
||||
value,
|
||||
address: sourceBytes.address,
|
||||
state: "not_observed",
|
||||
decodedObject: "unverified",
|
||||
});
|
||||
continue;
|
||||
}
|
||||
export async function verifyHopperStringObjects(call, expectations) {
|
||||
const strings = await call("list_strings");
|
||||
for (const { value, encoding } of expectations) {
|
||||
const item = strings.find((candidate) => candidate.value === value);
|
||||
assert.ok(
|
||||
item,
|
||||
`Hopper omitted the decoded string ${JSON.stringify(value)}`,
|
||||
);
|
||||
assert.equal(
|
||||
item.value,
|
||||
value,
|
||||
"native string decoding changed the source value",
|
||||
);
|
||||
recognition.push({
|
||||
value,
|
||||
address: item.address,
|
||||
state: "observed",
|
||||
decodedObject: "verified",
|
||||
});
|
||||
assert.equal(item.string.encoding, encoding);
|
||||
assert.equal(item.string.encoding_status, "inferred");
|
||||
assert.equal(item.string.termination, "present_or_not_required");
|
||||
const expectedBytes = Buffer.from(
|
||||
value + "\0",
|
||||
encoding.replaceAll("-", ""),
|
||||
);
|
||||
assert.equal(item.string.byte_length, expectedBytes.length);
|
||||
const bytes =
|
||||
sourceBytes ??
|
||||
(await call("read_bytes", {
|
||||
address: item.address,
|
||||
length: expectedBytes.length,
|
||||
}));
|
||||
assert.equal(bytes.complete, true);
|
||||
const bytes = await call("read_bytes", {
|
||||
address: item.address,
|
||||
length: expectedBytes.length,
|
||||
});
|
||||
assert.equal(bytes.bytes_hex, expectedBytes.toString("hex"));
|
||||
assert.deepEqual(await call("list_strings", { address: item.address }), [
|
||||
item,
|
||||
@@ -329,7 +225,7 @@ export async function verifyHopperStringObjects(
|
||||
);
|
||||
return {
|
||||
sourceBytesVerified: true,
|
||||
recognition,
|
||||
inferredEncodingReported: true,
|
||||
displayEscapesExcludedFromMatching: true,
|
||||
};
|
||||
}
|
||||
|
||||
@@ -16,12 +16,6 @@ const isMcpMode =
|
||||
const isMcpDoctorMode = args[0] === "mcp" && args[1] === "doctor";
|
||||
const packageRoot = resolve(dirname(fileURLToPath(import.meta.url)), "..");
|
||||
|
||||
// Windows home lookup throws for an empty USERPROFILE. Dependencies resolve
|
||||
// home during import, before REA's own resolver can apply its account fallback.
|
||||
if (process.platform === "win32" && process.env.USERPROFILE === "") {
|
||||
delete process.env.USERPROFILE;
|
||||
}
|
||||
|
||||
// Playwright's registry assumes one of its three desktop host platforms when
|
||||
// it chooses the browser cache directory. Termux reports `android`, although
|
||||
// its Node runtime and filesystem are POSIX-compatible. Keep the cache path
|
||||
|
||||
+5
-15
@@ -401,7 +401,7 @@ class WebsiteTranslationChecks(unittest.TestCase):
|
||||
server.shutdown()
|
||||
worker.join()
|
||||
|
||||
def test_every_reading_page_loads_theme_before_styles(self):
|
||||
def test_every_reading_page_offers_light_and_dark_theme_colors(self):
|
||||
site = ROOT / "website/_site"
|
||||
english_pages = reading_pages(ROOT / "website/public")
|
||||
self.assertTrue(english_pages)
|
||||
@@ -412,20 +412,10 @@ class WebsiteTranslationChecks(unittest.TestCase):
|
||||
for path in {original, site / relative if code == "en" else site / code / relative}:
|
||||
with self.subTest(language=code, page=str(path.relative_to(ROOT))):
|
||||
doc = Document(path.read_text())
|
||||
colors = [node for node in doc.nodes if node.tag == "meta" and node.attrs.get("name") == "theme-color"]
|
||||
self.assertEqual(len(colors), 1)
|
||||
self.assertEqual(colors[0].attrs.get("content"), "#ffffff")
|
||||
self.assertNotIn("media", colors[0].attrs)
|
||||
theme = [node for node in doc.nodes if node.tag == "script" and (node.attrs.get("src") or "").endswith("/assets/theme.js")]
|
||||
self.assertEqual(len(theme), 1)
|
||||
for deferred in ("defer", "async", "type"):
|
||||
self.assertNotIn(deferred, theme[0].attrs)
|
||||
stylesheet = next(node for node in doc.nodes if node.tag == "link" and node.attrs.get("rel") == "stylesheet")
|
||||
self.assertLess(theme[0].start, stylesheet.start)
|
||||
toggle = [node for node in doc.nodes if "data-theme-toggle" in node.attrs]
|
||||
self.assertEqual(len(toggle), 1)
|
||||
self.assertEqual(toggle[0].tag, "button")
|
||||
self.assertIn("hidden", toggle[0].attrs)
|
||||
media = sorted(node.attrs.get("media") for node in doc.nodes if node.tag == "meta" and node.attrs.get("name") == "theme-color")
|
||||
self.assertEqual(media, ["(prefers-color-scheme: dark)", "(prefers-color-scheme: light)"])
|
||||
styles = (ROOT / "website/public/assets/styles.css").read_text()
|
||||
self.assertTrue("@media (prefers-color-scheme: dark)" in styles, "styles.css has no dark color scheme block")
|
||||
|
||||
|
||||
if __name__ == "__main__":
|
||||
|
||||
@@ -12,7 +12,6 @@ import { tmpdir } from "node:os";
|
||||
import { promisify } from "node:util";
|
||||
|
||||
import { completeVerifierRun, createVerifierRun } from "./lib/verifier-run.mjs";
|
||||
import { assertCleanLinuxHopperRuntime } from "./lib/clean-linux-hopper-runtime.mjs";
|
||||
|
||||
const execFileAsync = promisify(execFile);
|
||||
const verifierRun = createVerifierRun();
|
||||
@@ -20,12 +19,12 @@ const command = process.env.REA_VERIFY_SERVER_COMMAND;
|
||||
if (process.platform !== "linux" || process.getuid?.() !== 0)
|
||||
throw new Error("Linux setup verification requires a root Linux runner");
|
||||
if (!command) throw new Error("REA_VERIFY_SERVER_COMMAND is required");
|
||||
await assertCleanLinuxHopperRuntime();
|
||||
try {
|
||||
await access("/opt/hopper/bin/Hopper");
|
||||
throw new Error("Linux setup verification requires a clean runner");
|
||||
} catch (error) {
|
||||
if (error?.code !== "ENOENT") throw error;
|
||||
if (error instanceof Error && error.message.includes("clean runner"))
|
||||
throw error;
|
||||
}
|
||||
|
||||
const runJson = async (args) => {
|
||||
@@ -36,25 +35,14 @@ const runJson = async (args) => {
|
||||
return JSON.parse(stdout);
|
||||
};
|
||||
|
||||
const plan = await runJson([
|
||||
"setup",
|
||||
"--install-hopper",
|
||||
"--dry-run",
|
||||
"--json",
|
||||
]);
|
||||
if (
|
||||
plan.status !== "planned" ||
|
||||
!plan.plannedActions.some(({ kind }) => kind === "install_hopper") ||
|
||||
plan.appliedActions.length !== 0
|
||||
)
|
||||
throw new Error("setup did not produce a read-only Hopper installation plan");
|
||||
const plan = await runJson(["setup", "--json"]);
|
||||
if (plan.status !== "needs_confirmation")
|
||||
throw new Error("setup did not produce a read-only confirmation plan");
|
||||
await access("/opt/hopper/bin/Hopper").then(
|
||||
() => {
|
||||
throw new Error("setup plan mutated the clean runner");
|
||||
},
|
||||
(error) => {
|
||||
if (error?.code !== "ENOENT") throw error;
|
||||
},
|
||||
() => undefined,
|
||||
);
|
||||
|
||||
const installed = await runJson([
|
||||
@@ -70,7 +58,7 @@ if (
|
||||
throw new Error(
|
||||
`approved setup did not become ready: ${JSON.stringify(installed)}`,
|
||||
);
|
||||
const doctor = await runJson(["doctor", "--provider", "hopper", "--json"]);
|
||||
const doctor = await runJson(["doctor", "--json"]);
|
||||
if (doctor.healthy !== true)
|
||||
throw new Error(`doctor is unhealthy: ${JSON.stringify(doctor)}`);
|
||||
|
||||
@@ -79,6 +67,8 @@ await execFileAsync(command, ["analyze", "/usr/bin/true"], {
|
||||
timeout: 180_000,
|
||||
maxBuffer: 10 * 1024 * 1024,
|
||||
});
|
||||
process.env.HOPPER_TARGET_PATH = "/usr/bin/true";
|
||||
process.env.HOPPER_SECOND_TARGET_PATH = "/usr/bin/false";
|
||||
process.env.REA_VERIFY_SERVER_ARGS_JSON = '["mcp"]';
|
||||
await import("./verify-real-hopper-linux.mjs");
|
||||
|
||||
@@ -105,24 +95,28 @@ try {
|
||||
await rm(modifiedDirectory, { recursive: true, force: true });
|
||||
}
|
||||
|
||||
const repeated = await runJson(["setup", "--yes", "--json"]);
|
||||
const repeated = await runJson([
|
||||
"setup",
|
||||
"--yes",
|
||||
"--install-hopper",
|
||||
"--json",
|
||||
]);
|
||||
if (
|
||||
repeated.status !== "ready" ||
|
||||
repeated.plannedActions.length !== 0 ||
|
||||
repeated.appliedActions.length !== 0
|
||||
repeated.appliedActions.includes("installed_hopper")
|
||||
)
|
||||
throw new Error("a second setup was not idempotent");
|
||||
await assertCleanLinuxHopperRuntime();
|
||||
const completedVerifierRun = await completeVerifierRun(verifierRun);
|
||||
if (
|
||||
completedVerifierRun.process_lineage.status !== "verified" ||
|
||||
completedVerifierRun.process_lineage.descendants.length !== 0
|
||||
)
|
||||
throw new Error("Linux setup verification did not prove owned child cleanup");
|
||||
const { stdout: processes } = await execFileAsync("ps", [
|
||||
"-ax",
|
||||
"-o",
|
||||
"command=",
|
||||
]);
|
||||
if (/\/opt\/hopper\/bin\/Hopper|\bXvfb\b|hopper-demo-x11\.py/u.test(processes))
|
||||
throw new Error("Linux setup verification leaked a Hopper demo session");
|
||||
|
||||
console.log(
|
||||
JSON.stringify({
|
||||
verifier_run: completedVerifierRun,
|
||||
verifier_run: await completeVerifierRun(verifierRun),
|
||||
status: "verified",
|
||||
setup: true,
|
||||
cli: true,
|
||||
|
||||
@@ -236,52 +236,6 @@ try {
|
||||
const hci = await inspect({ path: bluetooth, fields: ["bthci_cmd.opcode"] });
|
||||
assert.deepEqual(hci.packets[0]["bthci_cmd.opcode"], ["0x0c03"]);
|
||||
assert.deepEqual(await readFile(path), source);
|
||||
// Exercise the incremental summary workflow against the same owned bytes
|
||||
// using real installed Wireshark tools; these inputs are format fixtures.
|
||||
const pcapTool = (await client.listTools()).tools.find(
|
||||
(t) => t.name === "inspect_pcap_capture",
|
||||
);
|
||||
assert.ok(pcapTool?.outputSchema);
|
||||
const pcapAjv = new Ajv2020({ strict: false, validateFormats: false });
|
||||
assert.ok(pcapAjv.validateSchema(pcapTool.inputSchema));
|
||||
assert.ok(pcapAjv.validateSchema(pcapTool.outputSchema));
|
||||
for (const capturePath of [path, bluetooth]) {
|
||||
const response = await client.callTool({
|
||||
name: pcapTool.name,
|
||||
arguments: { path: capturePath, detail: "summary" },
|
||||
});
|
||||
assert.notEqual(response.isError, true, JSON.stringify(response));
|
||||
assert.ok(
|
||||
pcapAjv.validate(pcapTool.outputSchema, response.structuredContent),
|
||||
pcapAjv.errorsText(),
|
||||
);
|
||||
const summary = parseEvidence(response.structuredContent).normalized_result;
|
||||
assert.equal(
|
||||
summary.summary.target.sha256,
|
||||
createHash("sha256")
|
||||
.update(await readFile(capturePath))
|
||||
.digest("hex"),
|
||||
);
|
||||
const source = {
|
||||
kind: "retained-evidence",
|
||||
evidence_id: summary.parent_evidence_id,
|
||||
};
|
||||
const page = await client.callTool({
|
||||
name: "inspect_analysis_view",
|
||||
arguments: {
|
||||
source,
|
||||
view: { kind: "pcap", facet: "protocols", limit: 10 },
|
||||
},
|
||||
});
|
||||
assert.notEqual(page.isError, true, JSON.stringify(page));
|
||||
assert.equal(
|
||||
parseEvidence(page.structuredContent).normalized_result
|
||||
.parent_evidence_id,
|
||||
source.evidence_id,
|
||||
);
|
||||
cases++;
|
||||
}
|
||||
|
||||
assert.deepEqual(await readFile(bluetooth), bluetoothSource);
|
||||
for (const input of [
|
||||
{ path, fields: ["frame.number"], display_filter: "this is not a filter" },
|
||||
|
||||
@@ -1,131 +0,0 @@
|
||||
import assert from "node:assert/strict";
|
||||
import { execFile } from "node:child_process";
|
||||
import { mkdtemp, readdir, rmdir } from "node:fs/promises";
|
||||
import { tmpdir } from "node:os";
|
||||
import { join, resolve } from "node:path";
|
||||
import { promisify } from "node:util";
|
||||
import { Client } from "@modelcontextprotocol/client";
|
||||
import { StdioClientTransport } from "@modelcontextprotocol/client/stdio";
|
||||
import { toolContract } from "../dist/contracts/toolContracts.js";
|
||||
import { hashStableFile } from "../dist/filesystem/StableFileHash.js";
|
||||
import { mcpTextValue } from "./lib/mcp-verifier-results.mjs";
|
||||
|
||||
const args = process.argv.slice(2);
|
||||
if (args.includes("--help") || args.includes("-h")) {
|
||||
console.log(
|
||||
"Usage: npm run verify:pcap -- [--pcap PATH]\nRequires caller-supplied tshark/capinfos. Without --pcap, only client readiness is verified.",
|
||||
);
|
||||
process.exit(0);
|
||||
}
|
||||
if (!(args.length === 0 || (args.length === 2 && args[0] === "--pcap")))
|
||||
throw new Error("Expected --pcap PATH");
|
||||
const path = args[1] === undefined ? null : resolve(args[1]);
|
||||
// This parent is shared by independent CLI/MCP owners. A leased Windows
|
||||
// runtime root would prevent their native admission of its directory handle.
|
||||
const root = await mkdtemp(join(tmpdir(), "rea-pcap-verifier-"));
|
||||
const environment = Object.fromEntries(
|
||||
Object.entries(process.env).filter(([, value]) => typeof value === "string"),
|
||||
);
|
||||
Object.assign(environment, {
|
||||
TMPDIR: root,
|
||||
TMP: root,
|
||||
TEMP: root,
|
||||
});
|
||||
const entrypoint = resolve("scripts/rea.mjs");
|
||||
const execute = promisify(execFile);
|
||||
const client = new Client({ name: "pcap-real-verifier", version: "1" });
|
||||
const transport = new StdioClientTransport({
|
||||
command: process.execPath,
|
||||
args: [entrypoint, "mcp"],
|
||||
env: environment,
|
||||
stderr: "pipe",
|
||||
});
|
||||
transport.stderr?.resume();
|
||||
try {
|
||||
await client.connect(transport);
|
||||
const readiness = await run("inspect_pcap_client", {});
|
||||
assert(readiness.client.tshark_version && readiness.client.capinfos_version);
|
||||
if (path === null)
|
||||
console.log("[unverified] Capture inspection: no --pcap was supplied");
|
||||
else {
|
||||
const identity = await hashStableFile(path);
|
||||
const result = await run("inspect_pcap_capture", { path });
|
||||
assert.deepEqual(result.target, { path, ...identity });
|
||||
assert(result.packet_count >= 0);
|
||||
assert(
|
||||
result.endpoints.every(
|
||||
(entry) => entry.packet_count <= result.packet_count,
|
||||
),
|
||||
);
|
||||
assert(
|
||||
result.protocol_distribution.every(
|
||||
(entry) => entry.packet_count <= result.packet_count,
|
||||
),
|
||||
);
|
||||
const partial =
|
||||
result.endpoint_count > result.endpoints.length ||
|
||||
result.dns_query_count > result.dns_queries.length ||
|
||||
result.tls_sni_count > result.tls_sni_values.length ||
|
||||
result.protocol_count > result.protocol_distribution.length ||
|
||||
result.http_request_uri_count > result.http_request_uris.length ||
|
||||
result.unattributed_dns_packet_count > 0 ||
|
||||
result.dns_queries.some(
|
||||
(entry) =>
|
||||
entry.response_address_count > entry.response_addresses.length,
|
||||
);
|
||||
assert.equal(result.coverage, partial ? "partial" : "complete");
|
||||
assert.deepEqual(
|
||||
await hashStableFile(path),
|
||||
identity,
|
||||
"Input capture must remain unchanged",
|
||||
);
|
||||
console.log(
|
||||
`[ok] ${result.packet_count} packets; ${result.endpoint_count} addresses; coverage=${result.coverage}`,
|
||||
);
|
||||
}
|
||||
} finally {
|
||||
try {
|
||||
await client.close();
|
||||
} finally {
|
||||
await transport.close();
|
||||
}
|
||||
assert.deepEqual(
|
||||
await readdir(root),
|
||||
[],
|
||||
`Owned capture resources remain under ${root}`,
|
||||
);
|
||||
await rmdir(root);
|
||||
}
|
||||
console.log("All asserted pcap CLI/MCP checks passed");
|
||||
|
||||
async function run(name, input) {
|
||||
const contract = toolContract(name);
|
||||
const { stdout } = await execute(
|
||||
process.execPath,
|
||||
[
|
||||
entrypoint,
|
||||
name.replaceAll("_", "-"),
|
||||
...(input.path === undefined ? [] : [input.path]),
|
||||
"--json",
|
||||
],
|
||||
{ env: environment, timeout: 360_000, maxBuffer: 8 * 1024 * 1024 },
|
||||
);
|
||||
const cli = contract.outputSchema.parse(JSON.parse(stdout));
|
||||
const response = await client.callTool(
|
||||
{ name, arguments: input },
|
||||
{ timeout: 360_000 },
|
||||
);
|
||||
assert.notEqual(response.isError, true, mcpTextValue(response));
|
||||
const mcp = contract.outputSchema.parse(JSON.parse(mcpTextValue(response)));
|
||||
assert.deepEqual(mcp.normalized_result, cli.normalized_result);
|
||||
assert.deepEqual(mcp.subject, cli.subject);
|
||||
if (input.path !== undefined) {
|
||||
assert.equal(cli.subject.local_path, input.path);
|
||||
assert.equal(
|
||||
cli.subject.digest.sha256,
|
||||
cli.normalized_result.target.sha256,
|
||||
);
|
||||
}
|
||||
console.log(`[ok] ${name}: named output schema and CLI/MCP Evidence parity`);
|
||||
return cli.normalized_result;
|
||||
}
|
||||
@@ -1,215 +0,0 @@
|
||||
#!/usr/bin/env node
|
||||
import assert from "node:assert/strict";
|
||||
import { execFile } from "node:child_process";
|
||||
import { createHash } from "node:crypto";
|
||||
import { readFile, writeFile } from "node:fs/promises";
|
||||
import { isAbsolute } from "node:path";
|
||||
import { fileURLToPath } from "node:url";
|
||||
import { promisify } from "node:util";
|
||||
import { Client } from "@modelcontextprotocol/client";
|
||||
import { StdioClientTransport } from "@modelcontextprotocol/client/stdio";
|
||||
import { Ajv2020 } from "ajv/dist/2020.js";
|
||||
import { parseEvidence } from "../dist/domain/evidence.js";
|
||||
|
||||
// Caller-supplied producer evidence stays local; no fixture capture or secrets are bundled.
|
||||
const [controlPath, lossPath, reportPath] = process.argv.slice(2);
|
||||
if (
|
||||
![controlPath, lossPath, reportPath].every(
|
||||
(value) => typeof value === "string" && isAbsolute(value),
|
||||
)
|
||||
)
|
||||
throw new Error(
|
||||
"Usage: node scripts/verify-qlog-captures.mjs /absolute/control/origin.qlog /absolute/loss/origin.qlog /absolute/new-report.json",
|
||||
);
|
||||
const entrypoint = fileURLToPath(new URL("./rea.mjs", import.meta.url));
|
||||
const client = new Client({ name: "qlog-producer-verifier", version: "1" });
|
||||
const environment = {
|
||||
PATH: process.env.PATH ?? "/usr/bin:/bin",
|
||||
REA_LOG_LEVEL: "silent",
|
||||
HOPPER_LAUNCHER_PATH: "/rea-unconfigured-deep-provider/hopper",
|
||||
};
|
||||
const transport = new StdioClientTransport({
|
||||
command: process.execPath,
|
||||
args: [entrypoint, "mcp"],
|
||||
env: environment,
|
||||
stderr: "pipe",
|
||||
});
|
||||
let diagnostics = "";
|
||||
transport.stderr?.on("data", (bytes) => {
|
||||
if (diagnostics.length < 65536) diagnostics += bytes.toString("utf8");
|
||||
});
|
||||
const ajv = new Ajv2020({ strict: false, validateFormats: false });
|
||||
const measurements = [];
|
||||
try {
|
||||
try {
|
||||
await client.connect(transport);
|
||||
} catch (cause) {
|
||||
throw new Error(`MCP startup failed: ${diagnostics}`, { cause });
|
||||
}
|
||||
const tool = (await client.listTools()).tools.find(
|
||||
(tool) => tool.name === "inspect_web_network_capture",
|
||||
);
|
||||
assert.ok(tool?.outputSchema);
|
||||
for (const schema of [tool.inputSchema, tool.outputSchema])
|
||||
assert.ok(ajv.validateSchema(schema));
|
||||
const validateOutput = ajv.compile(tool.outputSchema);
|
||||
for (const [lane, path] of [
|
||||
["control", controlPath],
|
||||
["loss", lossPath],
|
||||
]) {
|
||||
const source = await readFile(path);
|
||||
const raw = JSON.parse(source.toString("utf8"));
|
||||
const sha256 = createHash("sha256").update(source).digest("hex");
|
||||
assert.equal(raw.qlog_format, "JSON");
|
||||
assert.equal(raw.qlog_version, "0.3");
|
||||
const input = { capture_path: path, format: "qlog" };
|
||||
assert.ok(ajv.validate(tool.inputSchema, input));
|
||||
const response = await client.callTool({
|
||||
name: tool.name,
|
||||
arguments: input,
|
||||
});
|
||||
assert.notEqual(response.isError, true);
|
||||
assert.ok(
|
||||
validateOutput(response.structuredContent),
|
||||
JSON.stringify(validateOutput.errors),
|
||||
);
|
||||
const mcp = parseEvidence(response.structuredContent);
|
||||
const completed = await promisify(execFile)(
|
||||
process.execPath,
|
||||
[entrypoint, "inspect-web-network-capture", path, "qlog", "--json"],
|
||||
{ env: environment, timeout: 40_000, maxBuffer: 96 * 1024 * 1024 },
|
||||
);
|
||||
const cli = parseEvidence(JSON.parse(completed.stdout));
|
||||
assert.equal(cli.evidence_id, mcp.evidence_id);
|
||||
assert.deepEqual(cli.normalized_result, mcp.normalized_result);
|
||||
const capture = mcp.normalized_result;
|
||||
assert.equal(capture.artifact.sha256, sha256);
|
||||
assert.equal(
|
||||
capture.total_records,
|
||||
raw.traces.reduce((sum, trace) => sum + trace.events.length, 0),
|
||||
);
|
||||
for (const [ordinal, original] of raw.traces
|
||||
.flatMap((trace) => trace.events)
|
||||
.entries()) {
|
||||
const record = capture.records[ordinal];
|
||||
assert.equal(record.ordinal, ordinal);
|
||||
assert.equal(record.reported.name, original.name);
|
||||
assert.equal(record.reported.time, original.time);
|
||||
assert.deepEqual(record.binary_fields, []);
|
||||
assert.ok(
|
||||
record.numeric_literals.some(
|
||||
(number) =>
|
||||
number.pointer === "/time" &&
|
||||
Number(number.literal) === original.time,
|
||||
),
|
||||
);
|
||||
}
|
||||
assert.equal(capture.qlog.body_bytes, "not-reported");
|
||||
assert.equal(mcp.authority, "historical-reference");
|
||||
assert.equal(
|
||||
mcp.analysis_profile.parameters.qlog_profile,
|
||||
"aioquic-1.5.0-json-0.3",
|
||||
);
|
||||
const trace = capture.qlog.traces[0];
|
||||
assert.equal(trace.vantage_point, "server");
|
||||
const stream = trace.streams.find(
|
||||
(stream) => stream.stream_id === "0" && stream.direction === "sent",
|
||||
);
|
||||
assert.ok(stream);
|
||||
assert.equal(stream.unique_bytes, "32803");
|
||||
assert.equal(
|
||||
stream.frame_length_sum,
|
||||
lane === "control" ? "32803" : "33972",
|
||||
);
|
||||
assert.equal(stream.repeated_bytes, lane === "control" ? "0" : "1169");
|
||||
assert.equal(trace.loss_declarations.length, lane === "control" ? 0 : 1);
|
||||
if (lane === "loss")
|
||||
assert.deepEqual(trace.loss_declarations[0].packet_number, {
|
||||
state: "reported",
|
||||
value: "5",
|
||||
});
|
||||
// Structurally-known secrets may not survive in Evidence, including sidecars.
|
||||
const serialized = JSON.stringify(mcp);
|
||||
for (const original of raw.traces.flatMap((trace) => trace.events)) {
|
||||
if (
|
||||
original.name === "transport:parameters_set" &&
|
||||
typeof original.data.stateless_reset_token === "string"
|
||||
)
|
||||
assert.ok(!serialized.includes(original.data.stateless_reset_token));
|
||||
for (const frame of original.data.frames ?? []) {
|
||||
if (
|
||||
frame.frame_type === "new_connection_id" &&
|
||||
typeof frame.reset_token === "string"
|
||||
)
|
||||
assert.ok(!serialized.includes(frame.reset_token));
|
||||
if (frame.frame_type === "new_token" && typeof frame.token === "string")
|
||||
assert.ok(!serialized.includes(frame.token));
|
||||
}
|
||||
}
|
||||
const retained = await client.callTool({
|
||||
name: "inspect_analysis_view",
|
||||
arguments: {
|
||||
source: { kind: "retained-evidence", evidence_id: mcp.evidence_id },
|
||||
view: { kind: "api-surface" },
|
||||
},
|
||||
});
|
||||
assert.equal(retained.isError, true);
|
||||
assert.equal(
|
||||
JSON.parse(retained.content.find((item) => item.type === "text").text)
|
||||
.error.code,
|
||||
"unsupported_target",
|
||||
);
|
||||
const selected = await client.callTool({
|
||||
name: tool.name,
|
||||
arguments: { ...input, record_ordinals: [capture.total_records - 1, 0] },
|
||||
});
|
||||
const subset = parseEvidence(selected.structuredContent).normalized_result;
|
||||
assert.deepEqual(
|
||||
subset.records.map((record) => record.ordinal),
|
||||
[capture.total_records - 1, 0],
|
||||
);
|
||||
assert.deepEqual(subset.qlog, capture.qlog);
|
||||
measurements.push({
|
||||
lane,
|
||||
path,
|
||||
sha256,
|
||||
evidence_id: mcp.evidence_id,
|
||||
profile_digest: mcp.analysis_profile.digest,
|
||||
events: capture.total_records,
|
||||
stream_id: stream.stream_id,
|
||||
unique_bytes: stream.unique_bytes,
|
||||
frame_length_sum: stream.frame_length_sum,
|
||||
repeated_bytes: stream.repeated_bytes,
|
||||
loss_declarations: trace.loss_declarations.length,
|
||||
cli_mcp_parity: true,
|
||||
retained_reference: true,
|
||||
selected_scope_preserved: true,
|
||||
auth_exclusions: true,
|
||||
});
|
||||
}
|
||||
await client.ping();
|
||||
const report = {
|
||||
status: "passed",
|
||||
profile: "aioquic-1.5.0-json-0.3",
|
||||
measurements,
|
||||
limitations: [
|
||||
"Caller supplies provenance; format selection does not authenticate the producer.",
|
||||
"These known loopback cases do not establish WAN behavior, other qlog producers, platforms or general completeness.",
|
||||
"No PCAP or keylog is read by this verifier; repeated STREAM coverage is not proof of retransmission or network loss.",
|
||||
],
|
||||
};
|
||||
await writeFile(reportPath, JSON.stringify(report, null, 2) + "\n", {
|
||||
flag: "wx",
|
||||
mode: 0o600,
|
||||
});
|
||||
console.log(
|
||||
JSON.stringify({
|
||||
status: report.status,
|
||||
cases: measurements.length,
|
||||
report: reportPath,
|
||||
}),
|
||||
);
|
||||
} finally {
|
||||
await client.close();
|
||||
await transport.close();
|
||||
}
|
||||
@@ -11,8 +11,7 @@ createVerifierRun();
|
||||
|
||||
if (process.platform !== "linux")
|
||||
throw new Error("Linux real-Hopper verification must run on Linux");
|
||||
const configuredLauncher = process.env.HOPPER_LAUNCHER_PATH;
|
||||
const launcher = configuredLauncher ?? "/opt/hopper/bin/Hopper";
|
||||
const launcher = process.env.HOPPER_LAUNCHER_PATH ?? "/opt/hopper/bin/Hopper";
|
||||
await access(launcher);
|
||||
await access("/usr/bin/Xvfb");
|
||||
await access("/usr/bin/xauth");
|
||||
@@ -29,7 +28,5 @@ try {
|
||||
process.env.HOPPER_LAUNCHER_PATH = alternateLauncher;
|
||||
await import("./verify-real-hopper.mjs");
|
||||
} finally {
|
||||
if (configuredLauncher === undefined) delete process.env.HOPPER_LAUNCHER_PATH;
|
||||
else process.env.HOPPER_LAUNCHER_PATH = configuredLauncher;
|
||||
await rm(alternateDirectory, { recursive: true, force: true });
|
||||
}
|
||||
@@ -47,7 +47,6 @@ import {
|
||||
} from "./lib/real-hopper-boundaries.mjs";
|
||||
import { startUnrelatedHopperSentinel } from "./lib/unrelated-hopper-sentinel.mjs";
|
||||
import { snapshotHopperRuntime } from "./lib/real-hopper-cleanup.mjs";
|
||||
import { verifyLinuxHopperOwnerExit } from "./lib/real-hopper-owner-exit.mjs";
|
||||
const execFileAsync = promisify(execFile);
|
||||
const verifierRun = createVerifierRun();
|
||||
const timeout = 180_000;
|
||||
@@ -578,14 +577,6 @@ if (sessionsAfter.length > 0) {
|
||||
}
|
||||
if (summary === undefined)
|
||||
throw new Error("Real-Hopper verification did not produce a summary");
|
||||
if (process.platform === "linux")
|
||||
summary.ownerExit = await verifyLinuxHopperOwnerExit({
|
||||
primary: targetA,
|
||||
secondary: targetB,
|
||||
serverCommand,
|
||||
serverArgs,
|
||||
environment: serverEnvironment,
|
||||
});
|
||||
const completedVerifierRun = await completeVerifierRun(verifierRun);
|
||||
if (
|
||||
completedVerifierRun.process_lineage.status !== "verified" ||
|
||||
|
||||
Loaded 100 of 370 files, more files were not shown because too many files have changed in this diff.
Show more
Reference in new issue
Block a user