feat: Add smoke tests workflow for PR validation (#9125)
* feat: Add smoke tests workflow for PR validation - Adds smoke-test label trigger for running tests without API keys - Runs backend tests excluding api_key_required markers - Runs full frontend test suite with mocked APIs - Provides fast feedback (~10-15 min) before lgtm label - Enables external contributors to validate changes without API costs - Comments results back to PR automatically Usage: Add 'smoke-test' label to any PR to trigger 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com> * fix: Fix YAML indentation in smoke-tests workflow script block * refactor: Focus smoke tests on critical functionality only - Run only 10 essential backend test files (version, schema, serialization, etc.) - Run only frontend unit tests (skip integration/e2e) - Reduce timeout from 15 to 8 minutes - Target critical functionality without external dependencies - Avoid problematic database/API-dependent tests * fix: Use correct Jest CLI option --testPathPatterns * add frontend tests * add tests * change to essential tests * fix: Create superuser in test_load_bundles_from_urls test The test_load_bundles_from_urls test was failing because the load_bundles_from_urls function expects a superuser to exist in the database, but the test client fixture sets LANGFLOW_AUTO_LOGIN=false by default, which doesn't create a superuser. This fix creates a superuser in the test database before calling the function, resolving the 'Superuser not found in the database' error. 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com> * add on conditions * fix: Check PR labels correctly for smoke test trigger Change condition from github.event.label.name to github.event.pull_request.labels.*.name to work with all trigger events (synchronize, opened, etc), not just labeled events. 🤖 Generated with [Claude Code](https://claude.ai/code) Co-Authored-By: Claude <noreply@anthropic.com> * add workdispatch * remove initial test * adding timeout minutes * edit env var --------- Co-authored-by: Claude <noreply@anthropic.com>
This commit is contained in:
Yuqi Tang
GitHub
parent
ab90aa7439
commit
b7513e5c6f
2 changed files with 113 additions and 0 deletions
104
.github/workflows/smoke-tests.yml
vendored
Normal file
104
.github/workflows/smoke-tests.yml
vendored
Normal file
|
|
@ -0,0 +1,104 @@
|
|||
name: Smoke Tests
|
||||
|
||||
on:
|
||||
pull_request:
|
||||
types: [opened, labeled, synchronize, reopened]
|
||||
workflow_dispatch:
|
||||
|
||||
jobs:
|
||||
smoke-tests:
|
||||
if: contains(github.event.pull_request.labels.*.name, 'smoke-test')
|
||||
name: "Smoke Tests (No API Keys)"
|
||||
runs-on: ubuntu-latest
|
||||
timeout-minutes: 20
|
||||
|
||||
steps:
|
||||
- name: Checkout PR
|
||||
uses: actions/checkout@v4
|
||||
with:
|
||||
fetch-depth: 0
|
||||
|
||||
- name: Set up Python 3.12
|
||||
uses: actions/setup-python@v4
|
||||
with:
|
||||
python-version: "3.12"
|
||||
|
||||
- name: Install uv
|
||||
uses: astral-sh/setup-uv@v3
|
||||
with:
|
||||
version: "latest"
|
||||
|
||||
- name: Install backend dependencies
|
||||
run: |
|
||||
uv sync --dev
|
||||
|
||||
- name: Run backend smoke tests (critical tests only)
|
||||
run: |
|
||||
uv run pytest \
|
||||
src/backend/tests/unit/test_database.py \
|
||||
src/backend/tests/unit/test_login.py \
|
||||
src/backend/tests/unit/api/v1/test_validate.py \
|
||||
src/backend/tests/unit/test_endpoints.py \
|
||||
src/backend/tests/unit/api/v1/test_flows.py \
|
||||
src/backend/tests/unit/graph/test_graph.py \
|
||||
src/backend/tests/unit/services/flow/test_flow_runner.py \
|
||||
src/backend/tests/unit/test_chat_endpoint.py \
|
||||
src/backend/tests/unit/api/v1/test_api_key.py \
|
||||
src/backend/tests/unit/api/v1/test_endpoints.py \
|
||||
src/backend/tests/unit/components/languagemodels/test_openai_model.py \
|
||||
src/backend/tests/unit/components/agents/test_agent_component.py \
|
||||
src/backend/tests/unit/services/tracing/test_tracing_service.py \
|
||||
src/backend/tests/unit/custom/component/test_component_instance_attributes.py \
|
||||
src/backend/tests/unit/schema/test_schema_message.py \
|
||||
-m 'not api_key_required' \
|
||||
--tb=short \
|
||||
--maxfail=5 \
|
||||
-v
|
||||
env:
|
||||
LANGFLOW_SUPERUSER: admin
|
||||
LANGFLOW_SUPERUSER_PASSWORD: 123456
|
||||
|
||||
- name: Setup Node.js
|
||||
uses: actions/setup-node@v3
|
||||
with:
|
||||
node-version: "21"
|
||||
cache: "npm"
|
||||
cache-dependency-path: src/frontend/package-lock.json
|
||||
|
||||
- name: Install frontend dependencies
|
||||
run: |
|
||||
cd src/frontend
|
||||
npm ci
|
||||
|
||||
- name: Run frontend smoke tests (unit tests only)
|
||||
run: |
|
||||
cd src/frontend
|
||||
CI=true npx jest --ci --watchAll=false --passWithNoTests
|
||||
env:
|
||||
NODE_ENV: test
|
||||
|
||||
- name: Comment on PR with results
|
||||
if: always()
|
||||
uses: actions/github-script@v6
|
||||
with:
|
||||
script: |
|
||||
const conclusion = '${{ job.status }}';
|
||||
const emoji = conclusion === 'success' ? '✅' : '❌';
|
||||
const status = conclusion === 'success' ? 'passed' : 'failed';
|
||||
|
||||
const comment = `${emoji} **Smoke tests ${status}**
|
||||
|
||||
Critical functionality validated (~5-8 minutes):
|
||||
|
||||
- **Backend**: 10 essential test files (imports, schema, serialization, core utils)
|
||||
- **Frontend**: Unit tests only (components, utilities)
|
||||
- **Coverage**: Core functionality without external dependencies
|
||||
|
||||
View details in the [Actions tab](https://github.com/${{ github.repository }}/actions/runs/${{ github.run_id }}).`;
|
||||
|
||||
await github.rest.issues.createComment({
|
||||
issue_number: context.payload.pull_request.number,
|
||||
owner: context.repo.owner,
|
||||
repo: context.repo.repo,
|
||||
body: comment
|
||||
});
|
||||
|
|
@ -18,6 +18,7 @@ from langflow.initial_setup.setup import (
|
|||
update_projects_components_with_latest_component_versions,
|
||||
)
|
||||
from langflow.interface.components import aget_all_types_dict
|
||||
from langflow.services.auth.utils import create_super_user
|
||||
from langflow.services.database.models import Flow
|
||||
from langflow.services.database.models.folder.model import Folder
|
||||
from langflow.services.deps import get_settings_service, session_scope
|
||||
|
|
@ -238,6 +239,14 @@ async def test_load_bundles_from_urls():
|
|||
]
|
||||
settings_service.auth_settings.AUTO_LOGIN = True
|
||||
|
||||
# Create a superuser in the test database since load_bundles_from_urls requires one
|
||||
async with session_scope() as session:
|
||||
await create_super_user(
|
||||
username=settings_service.auth_settings.SUPERUSER,
|
||||
password=settings_service.auth_settings.SUPERUSER_PASSWORD,
|
||||
db=session,
|
||||
)
|
||||
|
||||
temp_dirs, components_paths = await load_bundles_from_urls()
|
||||
|
||||
try:
|
||||
|
|
|
|||
Loading…
Add table
Add a link
Reference in a new issue