open-gsio

Stack:

• vike
• react
• cloudflare workers
• itty-router
• mobx-state-tree
• openai sdk

Quickstart

1. bun i
2. Add your own GROQ_API_KEY in .dev.vars
3. In isolated shells, run bun run server:dev and bun run client:dev

Note: it should be possible to use pnpm in place of bun

Testing

The project uses Vitest for testing frontend components and hooks. Tests are located in __tests__ directories next to the code they test.

To run tests:

• bun run test - Run all tests once
• bun run test:watch - Run tests in watch mode
• bun run test:coverage - Run tests with coverage report

Deploying

1. Setup the KV_STORAGE bindings in wrangler.jsonc
2. Add another GROQ_API_KEY in secrets.json
3. Run bun run deploy && bun run deploy:secrets && bun run deploy

Note: Subsequent deployments should omit bun run deploy:secrets

Local Inference (Apple Silicon Only)

##### 
# install mlx-omni-server (custom homebrew wrapper)
brew tap seemueller-io/tap
brew install seemueller-io/tap/mlx-omni-server
#####
# Run mlx-omni-server
bun run openai:local
####
# Override OPENAI_* variables in .dev.vars
sed -i '' '/^OPENAI_API_KEY=/d' .dev.vars; echo 'OPENAI_API_KEY=not-needed' >> .dev.vars
sed -i '' '/^OPENAI_API_ENDPOINT=/d' .dev.vars; echo 'OPENAI_API_ENDPOINT=http://localhost:10240' >> .dev.vars
### Restart open-gsio server so it uses the new variables
bun run server:dev

Adding models for local inference

MODEL_TO_ADD=mlx-community/gemma-3-4b-it-8bit
# Chat completions endpoint
curl http://localhost:10240/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{
    "model: $MODEL_TO_ADD,
    "messages": [{"role": "user", "content": "Hello"}]
  }'

History

May 2025

Hash	Change
049bf97	Add seemueller.ai sidebar link and constrain Hero heading width
6be5f68	Consolidate configuration files (CI, bundler, environment)
a047f19	Expand Markdown usage guide for end‑users

---

April 2025

Hash	Change
ce3457a	Introduce custom error page and purge dead code
806c933	Fix duplicaterobots.txt entries (SEO)
4bbe8ea · e909e0b	Restore bundle‑size safeguards and switch tobun as package manager
7f1520b·aa71f86	Automate VPN block‑list deployment; retire legacy pull script
b332c93	Repair CI job for block‑list updates
d506e7d	Deprecate experimental Mixtral model

---

March 2025

Hash	Change
8b9e9eb	Add per‑model max_tokens limits
cb0d912	Expose Cloudflare AI models for staging
85de6ed·cec4f70	Shrink production bundles: re‑enable minifier and drop unused assets
4805c7e · 9709f61	Refresh landing‑page copy (“Welcomehome”)

---

February 2025

Hash	Change
8d70eef·886d45a	Ship runtime theme switching with dynamic navigation colors
4efaa93/194b168	Polish resume & selector styling (padding, borders)
7f925d1·0b9088a	Refine responsive chat: correct breakpoints, input scaling, MobX typing
0865897	Remove deprecated DocumentAPI
e355540	Fix background rendering issues

---

January 2025

Hash	Change
d8b47c9 ·361a523	Enable full LaTeX/KaTeX math rendering
64a0513·6ecc4f5	Set default model to llama‑v3p1‑70b‑instruct and limit model list
0ad9dc4	Add rate‑limit middleware
42f371b·1f526ce	Launch VPN blocker with live CIDR validation and CI workflow
f7464a1	Remove user‑uploaded attachments to cut storage costs
e9c3a12	Rotate Fireworks API credentials

---

Late 2024 Highlights

Area	Notable Work
Generative UX	Image‑generation pipeline; model‑selection UI; seasonal prompt packs
Analytics	Worker‑based metrics engine, event capture, tail helpers
Model Support	GROQ & Anthropic streaming integrations with attachment handling
Feedback Loop	Modal‑driven user‑feedback feature with dedicated store
Payments	On‑chain ETH/DOGE processor with dynamic deposit addresses
Performance	Tokenizer limits, LightningCSS minifier, esbuild migration
Mobile & A11y	Dynamic textarea sizing, cookie‑consent banner, iMessage‑style bubbles

August 2024 - December 2024

History is available by request.

License

MIT License

Copyright (c) 2025 Geoff Seemueller

Permission is hereby granted, free of charge, to any person obtaining a copy of this software and associated documentation files (the "Software"), to deal in the Software without restriction, including without limitation the rights to use, copy, modify, merge, publish, distribute, sublicense, and/or sell copies of the Software, and to permit persons to whom the Software is furnished to do so, subject to the following conditions:

The above copyright notice and this permission notice shall be included in all copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE SOFTWARE.