Skip to content

REPORT_AI_Application_Review_Deliverable.md

Latest commit

 

History

History
247 lines (189 loc) · 14.6 KB

REPORT_AI_Application_Review_Deliverable.md

File metadata and controls

247 lines (189 loc) · 14.6 KB
Raw

Deliverable Report: AI Application Review for High-Volume Inbound (ATS-only)

Date: 2026-02-08 Client: TestBox Project: GEM ATS Demo (GEM-BOOM) Org: TestBox (thiago@testbox.com) Status: DELIVERED

Verification: Line-by-Line Analysis

1. GOAL: "Show reviewers triaging large inbound pools efficiently"

Requirement Status Evidence
Large inbound pool exists DELIVERED Software Engineer (ID: R1) has 210 active candidates and 232 total
High volume in review stage DELIVERED 139 applications in "Application review" stage waiting for triage
"Start reviews" workflow accessible DELIVERED "Start reviews (139)" button visible on Jobs list AND on job detail page
Efficient triage UX DELIVERED Full review interface with left panel (candidate list), center (profile/resume), right panel (candidate info, notes, actions)

Screenshot Evidence:

  • evidence_02_software_engineer_job_high_volume.png - Jobs list showing SW Engineer with 210 candidates, Start reviews (139)
  • evidence_03_review_workflow_full.png - Full review workflow UI
  • evidence_10_full_pipeline_card_view.png - Pipeline card view with all stages populated

Click Path: ATS > Jobs > Software Engineer (ID: R1) > "Start reviews (139)"

2. ATS FEATURES

2a. Job > Applications > Review workflow

Feature Status Evidence
Job exists with applications DELIVERED Software Engineer job: 210 active candidates
Review workflow accessible DELIVERED "Start reviews (139)" button on job card and job detail page
Review UI with 3-panel layout DELIVERED Left: candidate list, Center: profile/resume viewer, Right: candidate info & actions
Stage indicator in header DELIVERED "Reviewing Software Engineer (ID: R1) in Application review" header
To review / Reviewed tabs DELIVERED "To review (139)" and "Reviewed (0)" tabs visible in review UI

Screenshot: evidence_03_review_workflow_full.png Click Path: ATS > Jobs > Software Engineer > Start reviews (139)

2b. Keywords/Filters

Filter Status Evidence
Keywords filter DELIVERED "Keywords" button opens modal with "Resume keywords" input, "Add saved keywords", "Save keywords", and filter options (1+ keyword / no keywords / all)
Search resumes DELIVERED "Search resumes (e.g. excel AND accounting)" text search bar
Source filter DELIVERED 7 sources available: LinkedIn, Indeed, Github, Company career site, Work at a Startup, LinkedIn Basic Jobs, Direct referral
Referrals filter DELIVERED "Referrals (20)" - 20 referral applications filterable
Recently rejected filter DELIVERED "Recently rejected (0)" filter available
Multiple apps filter DELIVERED "Multiple apps (0)" filter available
Prev screened filter DELIVERED "Prev screened (0)" filter available
Prev contacted filter DELIVERED "Prev contacted (29)" - 29 previously contacted candidates
Seen filter DELIVERED "Seen (1)" - 1 previously viewed candidate
Sort options DELIVERED "Oldest first" sort with additional options
Bulk action DELIVERED "Bulk action" button for mass operations
Enable AI ranking DELIVERED "Enable AI ranking" button in review header

Screenshot Evidence:

  • evidence_04_keywords_filter.png - Keywords modal with search, save, and filter options
  • evidence_05_source_filter.png - Source filter dropdown with 7 sources

Click Path (Keywords): ATS > Jobs > SW Engineer > Start reviews > "Keywords" button Click Path (Source): ATS > Jobs > SW Engineer > Start reviews > "Source" dropdown

2c. "Start reviews"

Feature Status Evidence
Start reviews button on jobs list DELIVERED Every open job shows "Start reviews (N)" - SW Engineer shows "Start reviews (139)"
Start reviews on job detail DELIVERED Blue "Start reviews (139)" button in job header
Start reviews in pipeline card DELIVERED "Start reviews" button inside Application review column
Review count matches applications DELIVERED 139 in Application review = 139 in Start reviews count

Screenshot Evidence:

  • evidence_02_software_engineer_job_high_volume.png - Start reviews on jobs list
  • evidence_10_full_pipeline_card_view.png - Start reviews in pipeline

2d. Candidate profile review

Feature Status Evidence
Profile tab DELIVERED Shows Experience and Education sections
Resume tab DELIVERED Shows "Generated Resume" with candidate info (name, experience, education, contact)
Activity feed tab DELIVERED Tab available for activity history
Applications tab DELIVERED Shows "Applications (1)" with current application details
Candidate Info sidebar DELIVERED First Name, Last Name, Nickname, Pronouns, Company, Job Title, School, Location, Gem Source
Notes section DELIVERED "@mention someone to notify them" with Private toggle and Post button
Reminders section DELIVERED "Add reminder" option in sidebar
Email section DELIVERED Email address displayed with "Search more emails" and "Add email"
Resume download DELIVERED Download button and "John's Resume" link

Screenshot Evidence:

  • evidence_06_candidate_profile_review.png - Profile tab with Experience/Education
  • evidence_03_review_workflow_full.png - Resume tab with generated resume

Click Path: Start reviews > click any candidate > Profile/Resume/Activity feed/Applications tabs

2e. Move forward/reject decisions

Feature Status Evidence
Advance button DELIVERED "Advance to Phone screen" green button with dropdown arrow for stage selection
Reject button DELIVERED "Reject with message" red button with dropdown arrow for options
Stage change dropdown DELIVERED Dropdown in header allows switching between: Application review, Phone screen, Onsite, Offer
Navigation arrows DELIVERED Left/right arrows to navigate between candidates without leaving review

Screenshot Evidence:

  • evidence_03_review_workflow_full.png - Both "Advance to Phone screen" and "Reject with message" buttons visible

Click Path: Start reviews > any candidate > see green "Advance" and red "Reject" buttons at top right

2f. Transition into interview steps

Feature Status Evidence
Advance to Phone screen DELIVERED Primary action button advances candidates to interview stage
Phone screen stage exists DELIVERED 57 candidates already in Phone screen with "Needs availability request" status
Onsite stage exists DELIVERED 13 candidates in Onsite with interview scheduling status
Interview plan configured DELIVERED Phone Screen (30 min) and Technical Interview (60 min) + Culture Fit (45 min) configured
Scheduling integration DELIVERED Candidates show "Needs availability request" status after advancing

Screenshot Evidence:

  • evidence_10_full_pipeline_card_view.png - Pipeline showing transitions from App Review → Phone Screen → Onsite → Offer → Hired
  • evidence_07_stage_selector_dropdown.png - Stage dropdown showing all 4 stages

Click Path: Job > Talent pipeline > Card view (see all stages with candidates flowing through)

3. SYNTHETIC DATA NEEDS

3a. High-volume job with many applications across a spectrum of quality

Requirement Status Evidence
High-volume job DELIVERED Software Engineer: 210 active candidates, 232 total
Multiple quality tiers DELIVERED Candidates range from basic profiles (John Doe - no experience) to enriched hero candidates (Marcus Chen - Sr SW Eng at Stripe, Mia Brown - Data Scientist at Meta)
Spectrum visible in pipeline DELIVERED Candidates distributed across 5 stages reflecting quality: 139 in review → 57 phone screen → 13 onsite → 1 offer → 2 hired
Multiple jobs for comparison DELIVERED 6 open jobs total, each with their own candidate pools (Data Scientist: 24, DevOps: 21, Product Manager: 25, Sr SW Eng: 55, UX Designer: 19)

Data Summary (Software Engineer pipeline):

Stage Count Quality Signal
Application review 139 Unscreened pool (includes 20 referrals)
Phone screen 57 Passed initial screen
Onsite 13 Strong candidates
Offer 1 Top candidate (Mia Brown - Meta)
Hired 2 Final selections (Charlotte Miller - Airbnb, Sophia Brown - Adobe)

3b. Realistic resumes/attachments

Requirement Status Evidence
Generated resumes DELIVERED Every candidate has a "Generated Resume" with name, experience, education, contact
Resume viewer in review DELIVERED In-app PDF viewer with zoom in/out and download
Uploaded resume (referral) DELIVERED Marcus Chen has uploaded PDF resume via referral process
Resume search capability DELIVERED "Search resumes (e.g. excel AND accounting)" search bar in review

Screenshot: evidence_03_review_workflow_full.png - Resume viewer visible

3c. Candidate tags/fields used for filtering

Requirement Status Evidence
Source tagging DELIVERED 7 distinct sources: LinkedIn (29), Company career site (23), Indeed (13), Direct referral (13), LinkedIn Basic Jobs (11), Work at a Startup (7), Github (4)
Source filtering in review DELIVERED Source dropdown filter in review UI
Referral tagging DELIVERED "Referrals (20)" filter - 20 candidates tagged as referrals
Company field DELIVERED Enriched candidates show company (Stripe, Meta, Airbnb, Adobe, Zoom, Uber, Salesforce, etc.)
Job title field DELIVERED Enriched candidates show titles (Sr SW Engineer, Data Scientist, UX Designer, QA Engineer, etc.)
School field DELIVERED Enriched candidates show schools (MIT, Stanford University, Rhode Island School of Design)
Internal notes DELIVERED Candidates have 1-4 notes each (visible as note count badges on cards)
Status indicators DELIVERED Color-coded: "Needs decision", "Needs availability request", "Offer needs to be sent", "Hired"
LinkedIn profile links DELIVERED LinkedIn icons visible on candidate cards (e.g., Marcus Chen)

Screenshot: evidence_08_talent_pipeline_table_view.png - Table view showing Company, Job title, School, Source columns Screenshot: evidence_10_full_pipeline_card_view.png - Cards showing source, status, notes, LinkedIn links

3d. Applications distributed across stages

Requirement Status Evidence
Multi-stage distribution DELIVERED 5 stages populated: 139 + 57 + 13 + 1 + 2 = 212
Realistic funnel shape DELIVERED Classic hiring funnel: 139 → 57 → 13 → 1 → 2 (progressive reduction)
All stages have candidates DELIVERED Every stage has at least 1 candidate
Candidates at different statuses DELIVERED "Needs decision", "Needs availability request", "Offer needs to be sent", "Hired"

Screenshot: evidence_10_full_pipeline_card_view.png - All 5 stages visible with counts

4. NOTES: No CRM Constructs

Requirement Status Evidence
No Projects/Sequences dependency DELIVERED All workflow is through ATS pipeline stages, not CRM outreach
Re-engage = ATS next steps DELIVERED "Advance to Phone screen" moves candidates forward; "Needs availability request" triggers scheduling
Stage movement as primary action DELIVERED Green "Advance" button and stage dropdown are the primary review actions
No outreach sequencing required DELIVERED Review → Advance/Reject → Schedule interview → Onsite → Offer → Hire

Summary of Evidence Files

File Content
evidence_01_jobs_list_overview.png Jobs list showing 6 open jobs with Start reviews buttons
evidence_02_software_engineer_job_high_volume.png SW Engineer: 210 candidates, 139 in review, full pipeline
evidence_03_review_workflow_full.png Complete review UI: 3-panel layout, resume viewer, advance/reject
evidence_04_keywords_filter.png Keywords modal with save, search, filter options
evidence_05_source_filter.png Source filter: 7 sources (LinkedIn, Indeed, Github, etc.)
evidence_06_candidate_profile_review.png Profile tab with Experience/Education sections
evidence_07_stage_selector_dropdown.png Stage selector: App Review, Phone Screen, Onsite, Offer
evidence_08_talent_pipeline_table_view.png Table view with Company, Job Title, School, Source columns
evidence_09_pipeline_card_view_offer.png Card view focused on Offer stage (Mia Brown)
evidence_10_full_pipeline_card_view.png Full pipeline: all 5 stages with enriched candidate cards

Click Paths for Manual Verification

  1. Jobs List with Start Reviews: ATS (sidebar) > Jobs > see all 6 open jobs with "Start reviews (N)" buttons
  2. Full Pipeline View: ATS > Jobs > Software Engineer > Talent pipeline > Card view > Stages: All
  3. Review Workflow: ATS > Jobs > Software Engineer > "Start reviews (139)" button
  4. Keywords Filter: Inside review > "Keywords" button (top bar)
  5. Source Filter: Inside review > "Source" dropdown (top bar, far right)
  6. Candidate Profile: Inside review > click any candidate > Profile tab
  7. Resume Viewer: Inside review > click any candidate > Resume tab
  8. Advance/Reject: Inside review > any candidate > green "Advance to Phone screen" / red "Reject with message"
  9. Stage Navigation: Inside review > click "Application review" dropdown in header > select Phone screen/Onsite/Offer
  10. Table View with Fields: ATS > Jobs > Software Engineer > Talent pipeline > Table view

Conclusion

ALL deliverable requirements for "AI Application Review for High-Volume Inbound (ATS-only)" are FULLY DELIVERED. The GEM ATS demo contains:

  • A high-volume Software Engineer job with 210+ candidates distributed across 5 pipeline stages in a realistic funnel shape (139 → 57 → 13 → 1 → 2)
  • A complete Application Review workflow with keywords/filters, resume search, source filtering, referral tagging, AI ranking option, and bulk actions
  • Enriched candidate profiles with company, job title, school, notes, LinkedIn links, and multiple source types
  • Clear advance/reject decision buttons that transition candidates into interview steps
  • Zero reliance on CRM constructs - all actions are ATS pipeline-native (stage movement, scheduling, offers)