b7513e5c6f* feat: Add smoke tests workflow for PR validation - Adds smoke-test label trigger for running tests without API keys - Runs backend tests excluding api_key_required markers - Runs full frontend test suite with mocked APIs - Provides fast feedback (~10-15 min) before lgtm label - Enables external contributors to validate changes without API costs - Comments results back to PR automatically Usage: Add 'smoke-test' label to any PR to trigger 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com> * fix: Fix YAML indentation in smoke-tests workflow script block * refactor: Focus smoke tests on critical functionality only - Run only 10 essential backend test files (version, schema, serialization, etc.) - Run only frontend unit tests (skip integration/e2e) - Reduce timeout from 15 to 8 minutes - Target critical functionality without external dependencies - Avoid problematic database/API-dependent tests * fix: Use correct Jest CLI option --testPathPatterns * add frontend tests * add tests * change to essential tests * fix: Create superuser in test_load_bundles_from_urls test The test_load_bundles_from_urls test was failing because the load_bundles_from_urls function expects a superuser to exist in the database, but the test client fixture sets LANGFLOW_AUTO_LOGIN=false by default, which doesn't create a superuser. This fix creates a superuser in the test database before calling the function, resolving the 'Superuser not found in the database' error. 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com> * add on conditions * fix: Check PR labels correctly for smoke test trigger Change condition from github.event.label.name to github.event.pull_request.labels.*.name to work with all trigger events (synchronize, opened, etc), not just labeled events. 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com> * add workdispatch * remove initial test * adding timeout minutes * edit env var --------- Co-authored-by: Claude <noreply@anthropic.com>
104 lines
No EOL
3.5 KiB
YAML
104 lines
No EOL
3.5 KiB
YAML
name: Smoke Tests
|
|
|
|
on:
|
|
pull_request:
|
|
types: [opened, labeled, synchronize, reopened]
|
|
workflow_dispatch:
|
|
|
|
jobs:
|
|
smoke-tests:
|
|
if: contains(github.event.pull_request.labels.*.name, 'smoke-test')
|
|
name: "Smoke Tests (No API Keys)"
|
|
runs-on: ubuntu-latest
|
|
timeout-minutes: 20
|
|
|
|
steps:
|
|
- name: Checkout PR
|
|
uses: actions/checkout@v4
|
|
with:
|
|
fetch-depth: 0
|
|
|
|
- name: Set up Python 3.12
|
|
uses: actions/setup-python@v4
|
|
with:
|
|
python-version: "3.12"
|
|
|
|
- name: Install uv
|
|
uses: astral-sh/setup-uv@v3
|
|
with:
|
|
version: "latest"
|
|
|
|
- name: Install backend dependencies
|
|
run: |
|
|
uv sync --dev
|
|
|
|
- name: Run backend smoke tests (critical tests only)
|
|
run: |
|
|
uv run pytest \
|
|
src/backend/tests/unit/test_database.py \
|
|
src/backend/tests/unit/test_login.py \
|
|
src/backend/tests/unit/api/v1/test_validate.py \
|
|
src/backend/tests/unit/test_endpoints.py \
|
|
src/backend/tests/unit/api/v1/test_flows.py \
|
|
src/backend/tests/unit/graph/test_graph.py \
|
|
src/backend/tests/unit/services/flow/test_flow_runner.py \
|
|
src/backend/tests/unit/test_chat_endpoint.py \
|
|
src/backend/tests/unit/api/v1/test_api_key.py \
|
|
src/backend/tests/unit/api/v1/test_endpoints.py \
|
|
src/backend/tests/unit/components/languagemodels/test_openai_model.py \
|
|
src/backend/tests/unit/components/agents/test_agent_component.py \
|
|
src/backend/tests/unit/services/tracing/test_tracing_service.py \
|
|
src/backend/tests/unit/custom/component/test_component_instance_attributes.py \
|
|
src/backend/tests/unit/schema/test_schema_message.py \
|
|
-m 'not api_key_required' \
|
|
--tb=short \
|
|
--maxfail=5 \
|
|
-v
|
|
env:
|
|
LANGFLOW_SUPERUSER: admin
|
|
LANGFLOW_SUPERUSER_PASSWORD: 123456
|
|
|
|
- name: Setup Node.js
|
|
uses: actions/setup-node@v3
|
|
with:
|
|
node-version: "21"
|
|
cache: "npm"
|
|
cache-dependency-path: src/frontend/package-lock.json
|
|
|
|
- name: Install frontend dependencies
|
|
run: |
|
|
cd src/frontend
|
|
npm ci
|
|
|
|
- name: Run frontend smoke tests (unit tests only)
|
|
run: |
|
|
cd src/frontend
|
|
CI=true npx jest --ci --watchAll=false --passWithNoTests
|
|
env:
|
|
NODE_ENV: test
|
|
|
|
- name: Comment on PR with results
|
|
if: always()
|
|
uses: actions/github-script@v6
|
|
with:
|
|
script: |
|
|
const conclusion = '${{ job.status }}';
|
|
const emoji = conclusion === 'success' ? '✅' : '❌';
|
|
const status = conclusion === 'success' ? 'passed' : 'failed';
|
|
|
|
const comment = `${emoji} **Smoke tests ${status}**
|
|
|
|
Critical functionality validated (~5-8 minutes):
|
|
|
|
- **Backend**: 10 essential test files (imports, schema, serialization, core utils)
|
|
- **Frontend**: Unit tests only (components, utilities)
|
|
- **Coverage**: Core functionality without external dependencies
|
|
|
|
View details in the [Actions tab](https://github.com/${{ github.repository }}/actions/runs/${{ github.run_id }}).`;
|
|
|
|
await github.rest.issues.createComment({
|
|
issue_number: context.payload.pull_request.number,
|
|
owner: context.repo.owner,
|
|
repo: context.repo.repo,
|
|
body: comment
|
|
}); |