Skip to content

Submit assessment for fullsend-ai/fullsend (68.2/100 Silver)#424

Open
dhshah13 wants to merge 2 commits into
ambient-code:mainfrom
dhshah13:submit/fullsend-ai-fullsend
Open

Submit assessment for fullsend-ai/fullsend (68.2/100 Silver)#424
dhshah13 wants to merge 2 commits into
ambient-code:mainfrom
dhshah13:submit/fullsend-ai-fullsend

Conversation

@dhshah13
Copy link
Copy Markdown

@dhshah13 dhshah13 commented May 12, 2026

AgentReady Leaderboard Submission

Field Value
Repository fullsend-ai/fullsend
Score 68.2/100 🥈 Silver
AgentReady Version v2.36.1
Commit 04646f66
Branch docs/686-forge-landscape
Date May 12, 2026

Made with Cursor

Summary by CodeRabbit

  • Chores
    • Added a new assessment report documenting a repository evaluation (overall score 68.2, Silver certification). Includes detailed per‑attribute findings, remediation guidance, and evaluation configuration/metadata for reference.

@coderabbitai
Copy link
Copy Markdown

coderabbitai Bot commented May 12, 2026

No actionable comments were generated in the recent review. 🎉

ℹ️ Recent review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: ASSERTIVE

Plan: Enterprise

Run ID: 6ac5a6c5-9ffb-47e9-a394-e6380e7bbcc1

📥 Commits

Reviewing files that changed from the base of the PR and between f43fe52 and 4d6b066.

📒 Files selected for processing (1)
  • submissions/fullsend-ai/fullsend/2026-05-12T17-32-35-assessment.json

📝 Walkthrough

Walkthrough

A new agentready assessment report file was added containing a repository evaluation snapshot with schema metadata, findings across multiple attributes (pass/fail/skipped), remediation guidance for issues, and overall scoring results.

Changes

Agentready Assessment Report

Layer / File(s) Summary
Assessment snapshot with findings and remediations
submissions/fullsend-ai/fullsend/2026-05-12T17-32-35-assessment.json
Complete agentready assessment artifact including repository metadata (path, commit, language stats), schema/version info, scored findings array with per-attribute status/evidence/remediation steps, evaluation configuration (weights, exclusions), execution duration, and overall certification result (68.2 score, Silver level).

Possibly related PRs

Suggested labels

released

🚥 Pre-merge checks | ✅ 4 | ❌ 1

❌ Failed checks (1 warning)

Check name Status Explanation Resolution
Title check ⚠️ Warning The title does not follow the Conventional Commits format (type(scope): description) required by the repository standards. Reformat the title to follow Conventional Commits format, e.g., 'chore(submissions): submit fullsend-ai/fullsend assessment (68.2/100 Silver)' or 'feat(submissions): add fullsend-ai/fullsend Silver certification'
✅ Passed checks (4 passed)
Check name Status Explanation
Description Check ✅ Passed Check skipped - CodeRabbit’s high-level summary is enabled.
Docstring Coverage ✅ Passed No functions found in the changed files to evaluate docstring coverage. Skipping docstring coverage check.
Linked Issues check ✅ Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check ✅ Passed Check skipped because no linked issues were found for this pull request.

✏️ Tip: You can configure your own custom pre-merge checks in the settings.

✨ Finishing Touches
🧪 Generate unit tests (beta)
  • Create PR with unit tests
✨ Simplify code
  • Create PR with simplified code

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands and usage tips.

coderabbitai[bot]
coderabbitai Bot previously requested changes May 12, 2026
Copy link
Copy Markdown

@coderabbitai coderabbitai Bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 1

🤖 Prompt for all review comments with AI agents
Verify each finding against current code. Fix only still-valid issues, skip the
rest with a brief reason, keep changes minimal, and validate.

Inline comments:
In `@submissions/fullsend-ai/fullsend/2026-05-12T17-32-35-assessment.json`:
- Around line 8-13: The assessment metadata currently leaks local user and path
info in fields like "executed_by", "command", "working_directory", and
"repository.path"; update the code that generates/writes this JSON to sanitize
those keys by replacing absolute paths with repo-relative paths, stripping or
anonymizing the username/hostname in "executed_by" and any embedded paths in
"command", and keeping only essential metadata (e.g., repo name and relative
path) before exporting; locate the serializer/writer that emits the assessment
JSON (the code that sets these keys) and apply the sanitization logic
consistently for any evidence arrays that include local paths.
🪄 Autofix (Beta)

Fix all unresolved CodeRabbit comments on this PR:

  • Push a commit to this branch (recommended)
  • Create a new PR with the fixes

ℹ️ Review info
⚙️ Run configuration

Configuration used: Path: .coderabbit.yaml

Review profile: ASSERTIVE

Plan: Enterprise

Run ID: f0864013-b698-4df2-8590-8afdbcee43ec

📥 Commits

Reviewing files that changed from the base of the PR and between 18d8783 and f43fe52.

📒 Files selected for processing (1)
  • submissions/fullsend-ai/fullsend/2026-05-12T17-32-35-assessment.json

Comment thread submissions/fullsend-ai/fullsend/2026-05-12T17-32-35-assessment.json Outdated
Copy link
Copy Markdown
Contributor

@jwm4 jwm4 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🤖 AgentReady Code Review

PR Status: 1 issue found (0 🔴 Critical, 0 🟡 Major, 1 🔵 Minor)
Score Impact: None - leaderboard data submission, no source code changes
Recommendation: Approve and merge


The PII concern CodeRabbit raised was properly addressed in the second commit. The JSON structure, schema version, and submissions/{org}/{repo}/{timestamp} path convention all look correct. No blocking issues.

🔵 Minor Issues

Missing trailing newline at EOF

All other submissions in submissions/ end with a trailing newline; this one doesn't. This is a bug in the JSON generation code rather than anything the submitter did wrong - tracked in #426.


Note on PII handling: The manual redaction in the second commit was the right call. We've filed #427 to make agentready submit strip those fields automatically so future submitters don't have to think about it.


🤖 Generated with Claude Code under the supervision of Bill Murdock

If this review was useful, react with 👍. Otherwise, react with 👎.

@jwm4 jwm4 dismissed coderabbitai[bot]’s stale review May 12, 2026 19:04

This is resolved now.

@github-actions
Copy link
Copy Markdown
Contributor

📉 Test Coverage Report

Branch Coverage
This PR 72.9%
Main 73.3%
Diff ⚠️ -0.4%

Coverage calculated from unit tests only

@jwm4
Copy link
Copy Markdown
Contributor

jwm4 commented May 12, 2026

@dhshah13 , the CI is failing on this PR, but it appears to be a defect of the CI, not a problem with your PR. I submitted a fix at #428 and once it merges, I should be able to merge your PR without needing any changes from you.

@dhshah13
Copy link
Copy Markdown
Author

Thanks @jwm4.

@jwm4
Copy link
Copy Markdown
Contributor

jwm4 commented May 20, 2026

@dhshah13, the schema fix (#428) has now been merged to main. Could you rebase your branch onto main to trigger a fresh CI run? That should pick up the fix and let validation pass.

git fetch upstream main
git rebase upstream/main
git push --force-with-lease

(Adjust upstream to whatever you have the ambient-code remote named.)

Bill Murdock with assistance from Claude Code

dhshah13 and others added 2 commits May 20, 2026 12:58
AgentReady v2.36.1 assessment of fullsend-ai/fullsend repository.

Co-authored-by: Cursor <cursoragent@cursor.com>
Remove absolute paths, username, and hostname from the submission
per CodeRabbit review feedback.

Co-authored-by: Cursor <cursoragent@cursor.com>
@dhshah13 dhshah13 force-pushed the submit/fullsend-ai-fullsend branch from b829b80 to 4d6b066 Compare May 20, 2026 16:58
@dhshah13
Copy link
Copy Markdown
Author

@jwm4 done.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants