Intelligence Analyst
micro1 is hiring an Intelligence Analyst for a remote role. It pays $30-$80/hr and Level rates it ; you can apply on micro1.
Level may earn a referral fee if you apply to a micro1 role through an Apply link. It does not change the order of jobs. How this works
Level's read on this job
- Level rates this role Works on AI ●●●○: the daily work is on AI products, without building the model.
- This is listed as a remote role.
- The posting mentions AI evaluation, all source analysis and source evaluation among its tools and skills.
- micro1 has 303 other open roles on Level.
- Posted in the last few days.
AI in this role
Evaluate and grade AI model outputs using intelligence tradecraft standards to train next-generation AI systems.
Role Title: Intelligence Analyst
Role Type: Contractor
Location: Remote
micro1 is engaging Intelligence Analysts to contribute to a customer-facing project focused on evaluating and advancing artificial intelligence capabilities. In this role, you'll apply your expertise to help train next-generation AI systems. Your work will shape how models learn, reason, and perform through high-quality, real-world input. No prior experience in AI is required — your domain knowledge is what matters.
Scope of Work
- Develop and map analytic cases to defined taxonomies across multiple evaluation areas, ensuring comprehensive coverage of relevant intelligence scenarios.
- Author complex test cases designed to evaluate model performance on source handling, analytic rigor, and nuanced uncertainty expression.
- Assess and grade AI-generated responses based on criteria such as reasoning, source use, recognition of limitations, and practical utility.
- Identify and flag instances where legitimate analytic exploration is over-refused by the model, providing clear documentation and feedback.
- Document edge cases and analytic disagreements, supporting continuous improvement of evaluation methodologies.
- Collaborate with project leads to refine procedures for source evaluation and confidence-level assignment.
- Contribute insights to help calibrate analytic standards and enhance the overall quality of AI system benchmarks.
Preferred Qualifications
- Demonstrated all-source analytic experience or deep expertise in a specific analytic discipline, ideally with a civilian-IC background.
- Strong proficiency in source evaluation, confidence-level assessment, and established analytic standards.
- Experience in teaching, mentoring, or leading analytic reviews, with a record of fostering analytic rigor.
- Exceptional written and verbal communication skills, with a focus on clarity and precision.
- Ability to identify and articulate nuanced model limitations and over-refusal scenarios.
- Familiarity with structured analytic techniques and intelligence tradecraft standards.
- Previous participation in AI evaluation or model assessment initiatives is a plus.
How we rate this
Intelligence Analyst at micro1 rates 65 out of 100 for how much of the daily work is AI. That makes it Works on AI (AI Level 3 of 4). The level is about AI in the job, not seniority.
Works on AI. The daily work is on AI products, without building the model.
- ●●●● Builds AI80 to 100
- ●●●○ Works on AI60 to 79
- ●●○○ Uses AI40 to 59
- ●○○○ Little AI0 to 39
Levels come from how often the tools, models and workflows of the role are named in the posting itself. Read the description and count the AI tools, models and workflows it names.
Prepare for this job
Built from this posting and from similar jobs on Level.
Skills and AI tools this role asks for
Questions you could be asked
- How do you decide that one model's output is better than another's for a given task?
- Tell me about a project where all source analysis was part of your work. What did you do?
- Tell me about a project where source evaluation was part of your work. What did you do?
- Tell me about a project where model evaluation was part of your work. What did you do?
- Describe a typical day in a role like this one: which parts run through AI directly?
Adapt your resume
- List these exact terms on your resume: AI Evaluation, All Source Analysis, Source Evaluation, and Model Evaluation. An applicant tracking system matches the wording, not the idea.
- Attach one line of real, concrete experience to at least one of them. A tool named with nothing behind it rarely survives a human read.
- Show where AI is part of your daily process, not a one-off project. This role expects it to be a running habit.
Want an expert to read your CV for this job?
Free. Send your CV and the role you want next. We reply by email within 2 to 4 business days.
Get new remote AI jobs (Works on AI ●●●○ or higher) by email
One email a week with the new remote AI jobs (Works on AI ●●●○ or higher), each rated for how much AI is in the work. No recruiter spam, unsubscribe in one click.
Free. One email a week. Unsubscribe in one click.
Similar roles
Other roles that work on AI, at other companies.
What kind of AI work fits you?
Answer 12 practical questions in about three minutes. Get a simple profile, the work it points to, and live roles to explore next.
Find my next stepMore jobs at micro1
About micro1 as a platform
Level reads micro1’s own pages for pay, entry steps and accepted countries, and sets them beside the other platforms. See the micro1 platform page or compare AI training platforms.