DEV Community

sword luan
sword luan

Posted on

OpenMAIC Offline Test: 7,039 Passed, 45 Failed, and a Real Editable PPTX

#testing #opensource #ai

OpenMAIC reached the top of GitHub Trending, so I tested it as today's single main experiment instead of writing a feature summary.

The scope was deliberately narrow and reproducible:

  1. install the pinned source,
  2. run the full test suite,
  3. run a production build,
  4. call the project's own PPTX export path,
  5. keep every failure and limitation in the record.

The first install failed

The first installation exited with code 1. The workspace compiled, but pnpm 11 stopped third-party build scripts that had not been explicitly approved. I kept that failure.

In a second isolated run, I allowed only the esbuild step required by the export path. The installation then exited with code 0.

The full test suite was not green

The complete test run produced:

  • 7,039 passed
  • 45 failed
  • 79 skipped

Most failures came from five-second timeouts in concurrent browser-storage tests, with another timeout in a remote-image export test. This is not a “fully green” result.

The export path worked

The focused PPTX export checks were stronger: three files and five tests all passed.

The Next.js production build also exited with code 0 and generated 52 static pages.

For the harvest artifact, I called OpenMAIC's production buildPptxBlob function directly. It produced a four-slide, 79,985-byte editable Chinese PPTX. I unpacked the file and verified that all four slide XML files and the expected preset text were present.

No paid model API was used.

What this experiment verified

  • installation after a documented permission adjustment,
  • production build,
  • focused PPTX export,
  • a real downloadable and editable output file.

What it did not verify

  • multi-agent course generation,
  • TTS,
  • video generation,
  • real-time classroom interaction,
  • end-to-end course quality using a live model.

Full report: https://jianailab.com/reports/openmaic-offline-classroom-export-test

Harvest package: https://jianailab.com/experiments/openmaic/openmaic-harvest-pack.zip

Repository: https://github.com/THU-MAIC/OpenMAIC

GitHub is the land. We are the experimental field.

Top comments (0)