Financial AI Evaluator (Remote, Hourly Contractor) - #304667

CNTXT AI


Date: 7 hours ago
City: Manhattan, NY
Contract type: Full time
Remote

Position Summary

In this remote, hourly contractor role, you will evaluate AI-generated financial content and develop cases that test analytical reasoning accuracy. Your work directly improves how leading AI models handle financial information, making them more accurate, reliable, and clearly explained. Tasks may include:

  • Evaluating AI-generated responses across banking, insurance, accounting, and risk management for factual accuracy, analytical soundness, and correct application of financial principles

  • Identifying errors in financial methodology, flawed assumptions, misapplied regulations, and unsupported conclusions, fact-checking against reliable sources, and explaining corrections clearly in writing

  • Assessing AI reasoning across multi-document financial scenarios, including cross-referencing data across balance sheets, reports, and operational records

  • Developing prompts and test cases that test AI performance on practical financial operations and data analysis, including Excel-based evaluation tasks

  • Rating and comparing AI responses based on correctness, internal consistency, and adherence to the prompt

Profile Requirements

  • Bachelor's degree or higher in Finance, Accounting, Economics, Business, or a closely related field

  • Minimum 1 year of full-time professional experience in banking, insurance, accounting, or risk management

  • Ability to explain complex financial concepts clearly and accurately in writing

  • Full professional English proficiency

  • Reliable and self-directed, with consistent output quality in a remote, asynchronous workflow

Preferred Experience

  • Prior experience with AI data training, annotation, or model evaluation

  • Familiarity with multimodal AI tools or LLM evaluation workflows

About CNTXT AI

CNTXT AI builds artificial intelligence products and data solutions with a focus on making AI accurate, safe, and globally relevant for impact. Our work spans data services, custom AI solutions, and proprietary AI products, with deep expertise in Arabic-native and secure, sovereign solutions.

How to apply

To apply for this job you need to authorize on our website. If you don't have an account yet, please register.

Post a resume

Similar jobs

Transplant Coordinator – Living Donor Program

NewYork-Presbyterian Hospital, Manhattan, NY
$120,000 - $149,000 per year
2 days ago
Do more for patients than most can imagine. For skilled nursing professionals, the Renal & Pancreatic Transplantation Program at NewYork-Presbyterian represents a rare opportunity: the chance to bring new and life-changing advances to the patients who need them most. It’s the chance to care for over 260 highest acuity cases each year, achieving outcomes among the nation’s best. And it’s...

Community Technician - Palace - Tuesday-Saturday 11pm-7:30am

BRC - Bowery Residents' Committee, Inc., Manhattan, NY
$18.74 per hour
1 week ago
DUTIES/RESPONSIBILITIES: You will assist in monitoring this residential program for individuals experiencing homelessness, with a focus on maintaining a safe environment. Be part of a team with a commitment to engaging individuals in an approachable and empathetic manner while performing rounds and addressing the varied needs of individuals experiencing homelessness. You will manage conflict or challenging behaviors with self-awareness, emphasizing...

Senior Platform Engineer

Good Inside, Manhattan, NY
3 weeks ago
Who We Are Good Inside is redefining parenting - not as something that should “just come naturally,” but as a skill to learn and practice. Founded by Dr. Becky Kennedy and Dr. Erica Belsky, we combine sturdy leadership with innovative technology to give parents personalized guidance, AI-powered support, and a global community. Our mission: help parents raise resilient, confident kids...