🚸 Verify lineage for scripts created by agents using a deterministic function

[sheetalgiri]

• Added verify_lineage() function that parses a Python script with ast and checks:

  • lineage tracking calls (ln.track(...) / ln.finish(...) or imported equivalents)
  • LaminDB input retrieval patterns (e.g. ln.Artifact.get(...), ln.Collection.filter(...), etc.)
  • LaminDB output persistence patterns (.save() / ln.save(...))
  • suspicious non-LaminDB input reads (e.g. pd.read_*, open, np.load, etc.)

• Updated skills.md so that for every python script that the agent creates/plans to run, it verifies the lineage by calling the function and doing assertions on the verification results, make sure everything passes. If there is a failure, it goes back and makes modifications to the script and runs the function again.

Why:

• Agents can be unreliable when it comes to doing the lineage tracking properly

Limitations:

• Only supports python scripts

[codecov]

Codecov Report

❌ Patch coverage is 89.84962% with 27 lines in your changes missing coverage. Please review.
✅ Project coverage is 87.14%. Comparing base (112244e) to head (b898e0e).
⚠️ Report is 6 commits behind head on main.

Files with missing lines	Patch %	Lines
lamindb/core/_verify_lineage.py	89.81%	27 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #3846      +/-   ##
==========================================
- Coverage   91.55%   87.14%   -4.41%     
==========================================
  Files          88       89       +1     
  Lines       15747    16036     +289     
==========================================
- Hits        14417    13975     -442     
- Misses       1330     2061     +731     

Files with missing lines	Coverage Δ
lamindb/core/__init__.py	62.50% <100.00%> (-11.42%)	⬇️
lamindb/core/_context.py	89.41% <ø> (ø)
lamindb/core/_verify_lineage.py	89.81% <89.81%> (ø)

... and 15 files with indirect coverage changes

🚀 New features to boost your workflow:

• ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

[github-actions]

Deployment URL: https://305e5521.lamindb.pages.dev